Lead Data Engineer

We're looking for an experienced Data Engineer to join the UK's largest specialist parcel delivery company, leading the way in creating responsible delivery for everyone, everywhere. They do this by offering the most convenient way to send, receive and return packages without any cost.

Requirements

• Strong experience with Databricks in an AWS environment
• Experience in data integration and pipeline development
• Experience of AWS Cloud on data integration with Apache Spark, Glue, Kinesis, S3
• Strong real-life experience in python development
• Design, develop test, deploy, maintain and improve data integration pipeline
• Experience in Python and common python libraries
• Strong experience of advanced SQL
• Analytical experience with the database in writing complex queries, query optimization, debugging, user-defined functions, views, indexes, etc
• Experience with source control systems such as GitLab, and Jenkins build and continuous integration tools.

Responsibilities

• Utilize Databricks extensively within an AWS environment for various data engineering tasks

• Implement solutions using AWS services for efficient data handling
• Apply strong Python development skills to build robust and scalable data solutions
• Implement data pipelines for various use cases, ensuring reliability and scalability
• Utilize advanced SQL skills for data analysis, query optimization, debugging, and performance tuning
• Implementing DataBricks on top of AWS environment

What we offer

• Covered 20 days of vacation;
• Help and support from our caring HR team;
• Ability to join our tech hubs in Lisbon or Warsaw.