Lead Data Engineer

Company Description

Who are we ?

MANGOPAY’s vision is to fuel the success of the platform economy.

We empower the platform economy with our platform-specific payment
infrastructure. Since 2013, we have supported 2,500+ clients in e-commerce, retail,
and cutting-edge platforms.

MANGOPAY has developed a payment solution that aims to fuel the success of the
platform economy. Built around our programmable e-wallet solution, MANGOPAY’s
payment infrastructure offers a simple and easily integrated solution that covers
platform payment needs with total integration, as well as flexibility and workflows for
many business models.

Our teams are split across Europe in eight different locations, with main offices in
Paris and Luxembourg. Platforms and marketplaces are thriving and we are looking
for outstanding profiles to tackle some of the most ambitious challenges in our field
and contribute to our robust growth

Job Description

MANGOPAY continues to grow at an incredible pace. The Data Team needs a Lead Data Engineer to help us deploy our data strategy and bring data to the next level. 

She/He will be leading our Data Engineering & Governance team, already composed of two data engineers, one data steward and two outsourced data engineers to augment the team's capabilities; with an ambition to hire 3 more resources. The Lead Data Engineer will report to the Head of Data & will have as colleague the Lead BI & Data Science.

The Data Engineering & Governance team is a team who develops and maintains all MANGOPAY Data infrastructure services. This includes overseeing the status of the data platform, data freshness and reliability. The team also ensures that the Data Scientists and Analysts have the necessary resources to complete their tasks. 

He/she will be responsible for the Data Engineering team who develop scripts (batches, ETL jobs...), optimize and industrialize the code and choose the right tools to deploy within the team. The Data Engineering & Governance team is also in contact with the SysOps and DBA team for certain architecture choices and the maintenance of the platform in operational conditions. Governance at Mangopay is quite recent & the new Lead will have the challenge to build the team as most of the choices are to be made and it’s an opportunity to build from scratch. The Data Platform needs modernization and one of the big challenges is the move to cloud.

We’re currently in the process of deploying a new cloud data platform. The data stack will be: Snowflake, Databricks & Looker (among others) on the cloud.

Responsibilities
Functional Requirements

• Supervise the Data Engineers & Data Stewards in your team and help them to improve their skills
• Ensure the follow-ups of the good health of the teams and their continuous improvement
• Carry the orga/mindset change induced by the scaling up
• Facilitate the work of the teams to ensure their ability to deliver
• Understanding client needs and being able to translate them to data analyses or new data projects
• Be an essential part of Mangopay's scaling
• With the Data team, evolve the Data Platform
• Lead the data engineering team in the migration of & on-premise data platform to cloud

Technical Requirements 

• Compare, analyze and propose technical solutions for data processing
• Maintain technical debt at the lowest possible level
• Share knowledge with other team members
• Willingness to address and deepen the issues of the banking environment, fight against fraud, money laundering ...
• Supervise and automate the ingestion of different data sources
• Guarantee the quality of the code and the product (high performance and scalable data processing solutions).

Current Technical environment (that needs modernization)

• Apache Big Data Ecosystem (Hadoop)
• Column-oriented DBMS (Clickhouse)
• Workflow management systems (Airflow)
• CI/CD tools (Gitlab)
• GNU/Linux operating system
• Stream processing platforms (Kafka)

Qualifications

Experience

• Significant experience as a Data Engineer
• Experience in being a technical lead and/or team management
• Have worked on an ETL platform (on-prem or on cloud)
• Python and/or Spark
• Maintenance and administration of BI Tools (Looker for example)
• Good English level

Nice to have

• Agile methodology 
• Experience on cloud (AWS, Azure and/or GCP)

Mindset

• Critical and optimization-driven mindset
• Analytical and solution-oriented approach
• Rigorous with a focus on reliability
• Proactive

Additional Information

• HR Call
• Interview with Head of Data
• Interview with Senior Data Engineer
• Informal team meeting