Lead Data Engineer

About the role

We are seeking a highly skilled and experienced Lead Data Engineer to join our dynamic team at Softeta.

As a Lead Data Engineer, you will be a leader of the team, working for a technology-based market research company founded in Copenhagen, Denmark, and operational worldwide. The company provides marketing and advertising tools and services that help publishers, agencies, and advertisers identify, build, reach, and measure audiences.

In this role, you will have to lead the team of Data Engineers and work and be responsible for setting up the pipelines to retrieve the data, collaborate with data science and UI teams, and ensure scalability and monitoring.

Responsibilities:

• Design and develop highly scalable, maintainable, and data-centric solutions using AWS;
• Leading modern data platform implementation starting from requirements identification and up to production releases;
• Ensure data quality processes, monitoring, and data cleansing;
• Perform data modeling and database design;
• Designing and implementing ETL/ELT solutions for transferring data between various sources and platforms
• Automating data processing workflows
• Optimizing the performance of databases, including designing and implementing data structures and using indexes appropriately

Technologies - AWS, Apache Spark, Scala, PostgreSQL.

Requirements

• Minimum of 5 years of experience in data engineering or a related field;
• Strong experience in designing and implementing scalable data pipelines and ETL processes;
• Experience with data lake concepts, data modeling, and database design;
• Proficiency in Scala and SQL for data processing and scripting;
• Good understanding of AWS Infrastructure management;
• Experience with Apache Spark;
• .NET and React skills would be a plus;
• Excellent leadership and communication skills.

Benefits

• Diverse and technically challenging projects;
• Training budget for professional and personal growth;
• Flexible working hours and hybrid or remote workplace model;
• Flexible schedule and Agile/SCRUM environment;
• Technical equipment which you can choose;
• Health insurance;
• Salary range - from 5500 EUR to 7000 EUR monthly before taxes.