Senior Data Engineer
Paris, FR
Applications have closed
Octopus Energy
Octopus customers pay less: Cheaper than price-cap prices, rewards for using less when the grid is stressed, and smart tariff savings for your home, car or batteryWe’re a leading energy technology company, resulting from the acquisition of the French supplier Plüm énergie, soon to become Octopus Energy France. We're providing a better experience for our customers through transparency, honesty and simplicity. We want to do better for the planet, through real long-term investment in renewable generation and a low CO2 future and better for our customer’s wallets with fair and affordable plans. We're revolutionizing what's possible in energy, through our proprietary platform and custom-built stack, cloud-based billing and sophisticated use of data science. We are relentlessly focused on customer satisfaction and cherish the reward of receiving tremendous reviews from our customers- we have the highest score among French energy providers on Google Reviews (4.8/5 ⭐️⭐️⭐️⭐️⭐️).
ROLE OVERVIEW
We’re looking for an experienced data engineer to join our central data team and support our team in France.
At Octopus we’ve developed a data platform that provides services to all parts of our business in the UK and around the world. The platform enables self-service of data analytics to hundreds of data hungry users as well as automation of all our data workflows from simple data transformation jobs to ML training and prediction.
In this role you’ll be responsible for building and maintaining new data pipelines and data applications to enable the generation team to develop, manage and optimise their renewable assets effectively. You’ll work with data analysts and scientists as well as tech, finance, asset management and investment teams to solve their data challenges.
As part of the wider data platform team you’ll contribute to the development of our cloud data platform with the support of a team of highly skilled data professionals. This is a fantastic opportunity to work on data problems that genuinely move us closer to Net Zero with a company that is passionate about building great technology to change the way we generate and use energy.
What You'll do
- Build and maintain data pipelines that deliver key data and insights to the business
- Integrate new data sources into the data platform through APIs or bulk data transfer
- Work closely with the data science and analytics teams to maintain and develop our central data models in dbt
- Build and maintain testing and documentation frameworks for our data sources
- Work with the business to scope and deliver new data engineering projects and requirements
- Maintain and build on our existing data infrastructure and tools
- Support the internationalisation of our data infrastructure as we continue to grow globally
Our Data Platform Stack
- Python as our main programming language
- Kubernetes for data services and task orchestration
- Airflow purely for job scheduling and tracking
- Circle CI for continuous deployment
- Parquet and Delta file formats on S3 for data lake storage
- Spark for data processing
- dbt for data modelling
- Presto and Spark
- SQL for analytics
- Streamlit for data applications
What You'll have
- First and foremost, we want our data engineers to be great software engineers with a passion for writing high quality code It would be helpful to have experience/expertise in the following (in rough priority order):
- Python / SparkSQL
- Experience modelling data for analytics - ideally experience using dbt as a modelling tool
- Experience in assuring data quality
- Experience deploying data services in a cloud environment (ideally AWS) The projects will be varied and we’re looking for someone who can work autonomously and proactively to scope problems and solve and deliver pragmatic solutions
Why else you'll love it here
- Wondering what the salary for this role is? Just ask us! On a call with one of our recruiters it's something we always cover as we genuinely want to match your experience with the correct salary. The reason why we don't advertise is because we honestly have a degree of flexibility and would never want salary to be a reason why someone doesn't apply to Octopus - what's more important to us is finding the right octofit!
- Octopus Energy is a unique culture we won best company to work for in 2022, on Glassdoor we we're voted 50 best places to work in 2022 and our Group CEO, Greg has recorded a podcast about our culture and how we empower our people - this is the same here in France
- We are an organisation where people learn, decide, and build quicker. Where people work with autonomy, alongside a wide range of amazing co-owners, on projects that break new ground. Equity option scheme, flexible working, excellent health insurance, soft mobility pack... we want your hard work to be rewarded with perks you actually care about!
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow APIs AWS Data Analytics Data pipelines Data quality Engineering Finance Kubernetes Machine Learning Parquet Pipelines Python Spark SQL Testing
Perks/benefits: Equity Flex hours
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Business Intelligence Engineer jobs
- Open Lead Data Analyst jobs
- Open MLOps Engineer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Sr Data Engineer jobs
- Open Data Engineer II jobs
- Open Data Manager jobs
- Open Data Analytics Engineer jobs
- Open Principal Data Engineer jobs
- Open Power BI Developer jobs
- Open Junior Data Scientist jobs
- Open Business Intelligence Developer jobs
- Open Product Data Analyst jobs
- Open Senior Data Architect jobs
- Open Data Scientist II jobs
- Open Sr. Data Scientist jobs
- Open Manager, Data Engineering jobs
- Open Business Data Analyst jobs
- Open Big Data Engineer jobs
- Open Data Quality Analyst jobs
- Open Data Analyst Intern jobs
- Open Principal Data Scientist jobs
- Open Data Product Manager jobs
- Open ETL Developer jobs
- Open Junior Data Engineer jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open GCP-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Java-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open APIs-related jobs
- Open Deep Learning-related jobs
- Open PyTorch-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open TensorFlow-related jobs
- Open PhD-related jobs
- Open CI/CD-related jobs
- Open NLP-related jobs
- Open Data governance-related jobs
- Open Kubernetes-related jobs
- Open Airflow-related jobs
- Open Hadoop-related jobs
- Open Databricks-related jobs
- Open LLMs-related jobs
- Open DevOps-related jobs