Data Engineer
Manchester, UK
Applications have closed
Octopus Energy
Octopus customers pay less: Cheaper than price-cap prices, rewards for using less when the grid is stressed, and smart tariff savings for your home, car or batteryOur aim is to be the leading global provider of solutions that enable customers release £30bn of value per annum from distributed energy resources (DERs). We are building a Software as a Service (SaaS) subscription business with a global addressable market of £2.4 billion per annum, by digitally connecting hundreds of thousands of DERs with energy markets.
We have already attained a market leading position and KrakenFlex is a recognised thought leader and innovator in the industry. Our efforts have not gone unnoticed and we are pleased to announce that we now have the full support and backing of Octopus Energy, an award-winning UK energy supplier who share our passion and values.
As we enter the stage of rapid commercialisation and customer account growth, we have a number of exciting new offerings to launch to customers. We’re looking for an exceptional person to help us continuously deliver features that provide value to our customers. Our ideal engineer would be an individual who loves to engage with interesting software problems, with an interest in data related development and the passion to build and shape the future within a collaborative, community-based environment. We operate a highly agile development approach, giving wide scope to be involved with hands-on system-design, test driven development, deployment and operations.
Our data sources and problems are many and varied. We have some simple but high throughput data sources (e.g. over 600,000,000 rows a day and growing rapidly), complex unstructured and semi structured data and complex application data from our various microservices.
Our aim is to allow our business and our customers to answer increasingly complex questions, and gain new insights, based on our data, additional external data, and things we can learn and models we can extract from our data.
What you'll do
- Build and maintain data pipelines that deliver key data and insights to the business
- Integrate new data sources into the data platform through APIs or bulk data transfer
- Build and maintain testing and documentation frameworks for our data sources
- Work with the business to scope and deliver new data engineering projects and requirements
- Maintain and build on our existing data infrastructure and tools
- Support the internationalisation of our data infrastructure as we continue to grow globally
- Contribute to the software engineering and data engineering culture here at KrakenFlex
- Collaborate regularly with colleagues with many different professional specialities, including software engineers and data scientists, to create innovative solutions that delight our customers and colleagues
- Work as part of a team of engineers, regularly seeking feedback and growing your skills as technical professionals.
What you'll need
- In depth industry experience in software development & design
- Experience in Python
- Experience with data processing and pipeline technologies e.g. AWS Glue, Spark, Databricks, Airflow, dbt, Redshift, SQL, Athena, Parquet (don’t worry, we don’t expect or want you to have them all, and experience with other technologies doing the same jobs is also interesting).
- A drive to get things done in a collaborative, agile development environment
- An interest in working with data, both processing and analysing
- A proven ability to perform well in a fast-paced environment
- Excellent analytical and multitasking skills
It would be great if you had
- Experience with BI and/or Analytics tools, e.g. Athena, Tableau, Quicksight
- Experience working with data lakes and data at scale
- Experience with AWS or similar cloud providers, and serverless technologies e.g. AWS Lambda, Kinesis, DynamoDB, API Gateway
- Experience developing, securing or operating cloud scale applications or infrastructure; ideally terraform or cloudformation
Why else you'll love it here
- Wondering what the salary for this role is? Just ask us! On a call with one of our recruiters it's something we always cover as we genuinely want to match your experience with the correct salary. The reason why we don't advertise is because we honestly have a degree of flexibility and would never want salary to be a reason why someone doesn't apply to Octopus - what's more important to us is finding the right octofit!
- Octopus Energy is a unique culture. An organisation where people learn, decide, and build quicker. Where people work with autonomy, alongside a wide range of amazing co-owners, on projects that break new ground. We want your hard work to be rewarded with perks you actually care about! We won best company to work for in 2022, on Glassdoor we were voted 50 best places to work in 2022 and our Group CEO, Greg has recorded a podcast about our culture and how we empower our people
- Visit our perks hub - Octopus Employee Benefits
If this all sounds like you then we'd love to hear from you.
At Octopus, we're looking for genuinely decent people who are honest and empathetic. Our people are our strongest asset and the unique skills and perspectives people bring to the team are the driving force of our success. As an equal opportunity employer, we do not discriminate on the basis of any protected attribute. Our commitment is to provide equal opportunities, an inclusive work environment, and fairness for everyone.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Airflow APIs Athena AWS Databricks Data pipelines DynamoDB Engineering Kinesis Lambda Microservices Parquet Pipelines Python QuickSight Redshift Spark SQL Tableau Terraform Testing
Perks/benefits: Career development Startup environment
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Lead Data Analyst jobs
- Open MLOps Engineer jobs
- Open Data Science Manager jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Manager jobs
- Open Data Engineer II jobs
- Open Power BI Developer jobs
- Open Principal Data Engineer jobs
- Open Sr Data Engineer jobs
- Open Data Analytics Engineer jobs
- Open Business Intelligence Developer jobs
- Open Junior Data Scientist jobs
- Open Data Scientist II jobs
- Open Product Data Analyst jobs
- Open Senior Data Architect jobs
- Open Sr. Data Scientist jobs
- Open Business Data Analyst jobs
- Open Big Data Engineer jobs
- Open Data Analyst Intern jobs
- Open Azure Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Data Product Manager jobs
- Open Data Quality Analyst jobs
- Open Junior Data Engineer jobs
- Open Principal Data Scientist jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open GCP-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open Java-related jobs
- Open Privacy-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open APIs-related jobs
- Open Deep Learning-related jobs
- Open PyTorch-related jobs
- Open Snowflake-related jobs
- Open Consulting-related jobs
- Open TensorFlow-related jobs
- Open PhD-related jobs
- Open CI/CD-related jobs
- Open NLP-related jobs
- Open Kubernetes-related jobs
- Open Data governance-related jobs
- Open Airflow-related jobs
- Open Hadoop-related jobs
- Open LLMs-related jobs
- Open Databricks-related jobs
- Open Data warehouse-related jobs