Senior Data Engineer
London, England, United Kingdom
Applications have closed
So Energy
We are an award-winning renewable energy supplier. See how much you could save by switching. Get a quote now!So Energy was created in 2015 because we knew energy suppliers could be better. Since then, we’re grown rapidly but sustainably, with 300,000+ customers and over 300 So Energists. But, we’re not done. We’re on the road to a million customers by the end of 2026 and, thanks to our recent merger with ESB Energy, we’re well on the way. We’re tech first, we’re customer-centric and we’re passionate about sustainability.
We want to do the best we can by our customers and by each other, so we’ve created a workplace that is encouraging, supportive and offers the opportunity for growth. As a company, we live by six core values that guide everything we do.
- Clear
- Honest
- Ambitious
- Inquisitive
- Caring
- Sustainable
We are looking for someone who enjoys building data pipelines and the engineering that goes along with them. We are looking for someone with experience in data engineering, keen to work with many different sources and leveraging modern cloud-based tools.
We are building a data analytics platform in GCP (Google Cloud Platform) that will accelerate So Energy’s disruption of the energy sector.
Our users are both internal and external are extremely important to us. Understanding how their experience is throughout the various touch points is very important. The business is hungry for more data and this role will be intrinsic to enabling the ambition of being a data driven organisation with reliable, trusted, and useful insights.
Requirements
- As a Senior Data Engineer at So Energy, you will be responsible for building the ETL data pipelines
- Technical ownership, develop and support the Data Pipelines and related engineering practices within GCP
- Any cloud experience
- Proven, hands-on experience in Data Engineering (up to 6+ years' experience)
- A good mentor to other team members for standards, problem solving and best practices
- Demonstrate experience building both real-time and batch data pipelines to match the evolving needs of the business
- Provide technical support to other teams within the organisation as required
- Code elegant strategic solutions that are reusable and maintainable
- Curious about the data itself and identify edge cases for suitable processing and testing
- Strong experience writing complex SQL and writing good quality python code
- An innovator who is not afraid to put forward ideas for improving team process or suggest new features to the team
- Preferable experience in data governance
What You will be doing:
- Build, test and deploy Data pipelines on Google Cloud Platform
- Implement pipelines using Google’s Dataflow, GCS, cloud functions, BigQuery, Dataproc, Apache Beam (Python), Composer (Airflow)
- De-duplicate, transform and conform as appropriate from source to target structures
- Build and support both batch and real-time pipelines
- Implement solutions to improve our observability, findability, data privacy and other data governance and architectural concerns
- Provision data for analytics, data science and machine learning purposes
- Detailed physical design of data storage solutions
- Logical and physical data modelling
- Implement data transformation rules for batch and data streaming in SQL and Python
- Implement CI / CD from Github to GCP
- Implement API calls inbound and outbound
- Write quality technical documentation
- Contribute as part of an Agile team
- Communicate status, blockers, and progress clearly
- Translate requirements to technical solutions
- Translate technical solutions or concepts to non-technical people
Benefits
What's in it for you?
- Competitive salary
- Hybrid remote working
- Life Assurance 4x Base Salary
- Bonus Up to 10% of Base Salary
- 25 days holiday, plus bank holidays, and an extra day holiday for your birthday
- Perkbox
- Ongoing support and development as well as a generous learning and development budget
- Free daily breakfast
- Great reward and recognition
- Exposure to all parts of a growing business
- Pension matching as part of auto-enrolment pension scheme
So Energy care about helping the energy industry become a much more diverse and inclusive environment and we work hard to lead by example. We are committed to Equal Employment Opportunity and building an inclusive environment for all.
If you are interested in finding out more please apply making sure to complete all the questions to the best of your ability and attached an up to date version of your CV.
Good luck!
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Airflow APIs BigQuery Data Analytics Dataflow Data governance Data pipelines Dataproc Engineering ETL GCP GitHub Google Cloud Machine Learning Pipelines Privacy Python SQL Streaming Testing
Perks/benefits: Career development Competitive pay Salary bonus
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Lead Data Analyst jobs
- Open Data Science Manager jobs
- Open MLOps Engineer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Engineer II jobs
- Open Sr Data Engineer jobs
- Open Data Manager jobs
- Open Principal Data Engineer jobs
- Open Data Analytics Engineer jobs
- Open Power BI Developer jobs
- Open Junior Data Scientist jobs
- Open Business Intelligence Developer jobs
- Open Data Scientist II jobs
- Open Senior Data Architect jobs
- Open Product Data Analyst jobs
- Open Sr. Data Scientist jobs
- Open Business Data Analyst jobs
- Open Manager, Data Engineering jobs
- Open Big Data Engineer jobs
- Open Data Analyst Intern jobs
- Open Data Quality Analyst jobs
- Open Principal Data Scientist jobs
- Open Data Product Manager jobs
- Open Azure Data Engineer jobs
- Open Junior Data Engineer jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open GCP-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Java-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open APIs-related jobs
- Open Deep Learning-related jobs
- Open PyTorch-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open TensorFlow-related jobs
- Open PhD-related jobs
- Open CI/CD-related jobs
- Open NLP-related jobs
- Open Kubernetes-related jobs
- Open Data governance-related jobs
- Open Airflow-related jobs
- Open Hadoop-related jobs
- Open Databricks-related jobs
- Open LLMs-related jobs
- Open Data warehouse-related jobs