Data Engineer (KTL)

Kraken is the technology behind Octopus Energy. 
Our teamAll technology is written and maintained by a multi-discipline engineering team of around 250 people globally. This includes server-side, client-side and mobile engineers working closely with UX experts, copywriters and designers. 
We follow a Kanban-like approach, using Google docs and Asana to specify and manage work; Github, CircleCI and Terraform Enterprise as part of an immutable-infrastructure, continuous delivery pipeline; and Loggly, Sentry and Cloudwatch to measure performance and monitor production. 
Some of our coding conventions are open-source . 
Octopus is a great place to learn, work with some talented engineers and level-up your skills.  
Our technologyOn the server-side, we mainly use Python. Most of our websites are powered by Django, Django-REST-framework and GraphQL (Graphene).  
We use AWS heavily, employing most of the "Hashistack" (eg Packer, Consul, Terraform) as part of a continuous deployment pipeline. See, for example, Django, ELB health checks and continuous delivery. 
Client-side, we use React, Redux and SASS; our mobile apps are built using native code or React Native.
About the Role
We’re looking for an experienced data or software engineer to join our central data team and support the generation business. At Octopus we’ve developed a data platform that provides services to all parts of our business in the UK and around the world. The platform enables self-service of data analytics to hundreds of data hungry users as well as automation of all our data workflows from simple data transformation jobs to ML training and prediction. 
In this role you’ll be responsible for building and maintaining new data pipelines and data applications to enable the generation team to develop, manage and optimise their renewable assets effectively. You’ll work with data analysts and scientists as well as tech, finance, asset management and investment teams to solve their data challenges. As part of the wider data platform team you’ll contribute to the development of our cloud data platform with the support of a team of highly skilled data professionals.
This is a fantastic opportunity to work on data problems that genuinely move us closer to Net Zero with a company that is passionate about building great technology to change the way we generate and use energy.

What you'll do

• Build and maintain data pipelines that deliver key data and insights to the business
• Integrate new data sources into the data platform through APIs or bulk data transfer
• Work closely with the data science and analytics teams to maintain and develop our central data models in dbt
• Build and maintain testing and documentation frameworks for our data sources
• Work with the business to scope and deliver new data engineering projects and requirements
• Maintain and build on our existing data infrastructure and tools
• Support the internationalisation of our data infrastructure as we continue to grow globally

Our Data Platform Stack

• Python as our main programming language
• Kubernetes for data services and task orchestration
• Airflow purely for job scheduling and tracking
• Circle CI for continuous deployment
• Parquet and Delta file formats on S3 for data lake storage
• Spark for data processing
• dbt for data modelling
• Presto and SparkSQL for analytics
• Streamlet for data applications

What you'll have

• First and foremost, we want our data engineers to be great software engineers with a passion for writing high quality code
• It would be helpful to have experience/expertise in the following (in rough priority order): 
SparkSQLExperience modelling data for analytics - ideally experience using dbt as a modelling toolExperience in assuring data qualityExperience deploying data services in a cloud environment (ideally AWS)
• The projects will be varied and we’re looking for someone who can work autonomously and proactively to scope problems and solve and deliver pragmatic solutions

Why you'll love it here

• Wondering what the salary for this role is? Just ask us! On a call with one of our recruiters it's something we always cover as we genuinely want to match your experience with the correct salary. The reason why we don't advertise is because we honestly have a degree of flexibility and would never want salary to be a reason why someone doesn't apply to Octopus - what's more important to us is finding the right octofit!
• Octopus Energy is a unique culture. An organisation where people learn, decide, and build quicker. Where people work with autonomy, alongside a wide range of amazing co-owners, on projects that break new ground. We want your hard work to be rewarded with perks you actually care about! We won best company to work for in 2022, on Glassdoor we we're voted 50 best places to work in 2022 and our Group CEO, Greg has recorded a podcast about our culture and how we empower our people 
• Visit our perks hub - Octopus Employee Benefits

We would prefer someone who can work in our London office but will consider remote candidates (warning: the bar is much higher). You do need to be able to work in the UK without a VISA though.
Above all, we’re looking for someone who thrives on providing alternative opinions, challenging those around them and being challenged.
If this all sounds like you then we'd love to hear from you.
At Octopus, we're looking for genuinely decent people who are honest and empathetic. Our people are our strongest asset and the unique skills and perspectives people bring to the team are the driving force of our success. As an equal opportunity employer, we do not discriminate on the basis of any protected attribute. Our commitment is to provide equal opportunities, an inclusive work environment, and fairness for everyone.