Data Engineering Lead
Amsterdam, Noord-Holland, Netherlands
Metyis
We are a dynamic and forward-thinking consultancy firm that operates across a wide range of industries, creating solutions that are tailored to specific needs. We bring long-lasting impact and growth to our partners and clients. We are Metyis....We are looking for an experienced professional to join our Data Engineer Team. As a Data Engineer Lead, you are responsible for all data landscape and data processes of our clients. We are Azure oriented, but also we love open source and clouds such as AWS and GCP.
Requirements
What we offer:
- Interact with senior stakeholders at our clients on regular basis to drive their business towards impactful change.
- Become the go-to person for end-to-end data handling, management, and analytics processes.
- Lead your team in creating the pipeline for Data management, data visualization, and analytics products, including automated services, and APIs.
- Working with Data Scientists to take data throughout its lifecycle - acquisition, exploration, data cleaning, integration, analysis, interpretation, and visualization.
- Become part of a fast-growing international and diverse team.
Who we are:
Metyis is a global and forward-thinking firm operating across a wide range of industries, developing and delivering Big Data, Digital Commerce, Marketing & Design solutions and Advisory services. At Metyis, our long-term partnership model brings long-lasting impact and growth to our business partners and clients through extensive execution capabilities.
With our team, you can experience a collaborative environment with highly skilled multidisciplinary experts, where everyone has room to build bigger and bolder ideas. Being part of Metyis means you can speak your mind and be creative with your knowledge. Imagine the things you can achieve with a team that encourages you to be the best version of yourself.
We are Metyis. Partners for Impact.
What you will do:
- Lead, influence & implement the technical roadmap of our clients, in light of overall technology and architecture roadmaps.
- Be responsible for the Architecture, making sure that technical and non-technical components work together in the product to deliver the customer needs.
- Lead and Develop the digital development and operations using Python, Spark, RESTful API, and Microsoft Azure Cloud, ideally with some Data Insights experience.
- Steer the technical excellence of the application and consistency with relevant digital frameworks, best practices, and standards.
- Coach and enable other product team members to deliver best-in-class products.
- Deliver data platforms, data insights and with the collaboration of the data science team – data products, such as recommendation systems, data lakes/hubs, data insights and dashboards.
- Lead project activities and will be responsible for the evaluation of business needs and objectives in collaboration with the project team and other stakeholders.
What you’ll bring
- 5-7 years of experience in a similar role with experience in developing and deploying ETL solutions on Azure.
- Solid knowledge of data warehousing principles, concepts, and best practices (e.g. ODS, data marts, data lakes, data vault, 3NF).
- Good understanding of common platforms and practices regarding digital development; Cloud-based setups, Advanced Analytics and computing environments, and GitHub (or similar) and CI/CD workflows.
- Experience in setting up automated testing frameworks including unit tests, integration tests.
- Understanding of modern cloud-based architecture (Lambda & Kappa architectures).
- Advanced SQL, data transformation, and data profiling skills.
- Experience in building production ETL/ELT pipelines at scale.
- Data governance experience.
- 3-5 years of hands-on experience with Azure: Data Factory, Databricks, Synapse (DWH), Azure Functions, App logic, and other data analytics services, including streaming.
- Experience with Airflow, Kubernetes, Great expectations is a plus.
- Programming languages: Python (PySpark), scripting languages like Bash.
- Basic knowledge of PowerBI is a plus.
- Customer-centric, passionate about delivering great digital products and services.
- Demonstrating true engineering craftsmanship mindset.
- Passionate about continuous improvement and working collaboratively.
- Strong problem-solving skills coupled with the ability to convey designs and ideas to a wider audience.
- Comfortable with ambiguity, highly autonomous.
- A Bachelor's Degree in Computer Science, Mathematics, Economics, Engineering, Operations Research. Statistics, Business or other related technical disciplines (Master's Degree is a plus).
In a changing world, diversity and inclusion are core values for team well-being and performance. At Metyis, we want to welcome and retain all talents, regardless of gender, age, origin or sexual orientation, and irrespective of whether or not they are living with a disability, as each of them has their own experience and identity.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow APIs Architecture AWS Azure Big Data CI/CD Computer Science Data Analytics Databricks Data governance Data management Data visualization Data Warehousing Economics ELT Engineering ETL GCP GitHub Kubernetes Lambda Mathematics Open Source Pipelines Power BI PySpark Python Research Spark SQL Statistics Streaming Testing
Perks/benefits: Team events
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Data Science Intern jobs
- Open Lead Data Analyst jobs
- Open Data Engineer II jobs
- Open Power BI Developer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Science Manager jobs
- Open Marketing Data Analyst jobs
- Open MLOps Engineer jobs
- Open Junior Data Scientist jobs
- Open Data Scientist II jobs
- Open Business Intelligence Developer jobs
- Open Business Data Analyst jobs
- Open Product Data Analyst jobs
- Open Data Analytics Engineer jobs
- Open Data Analyst Intern jobs
- Open Sr Data Engineer jobs
- Open Principal Data Scientist jobs
- Open Sr. Data Scientist jobs
- Open Senior Data Architect jobs
- Open Data Engineering Manager jobs
- Open Junior Data Engineer jobs
- Open Big Data Engineer jobs
- Open Data Quality Analyst jobs
- Open Research Scientist jobs
- Open Azure Data Engineer jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open Data quality-related jobs
- Open ML models-related jobs
- Open Business Intelligence-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open PhD-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open Finance-related jobs
- Open NLP-related jobs
- Open PyTorch-related jobs
- Open TensorFlow-related jobs
- Open LLMs-related jobs
- Open APIs-related jobs
- Open Generative AI-related jobs
- Open CI/CD-related jobs
- Open Snowflake-related jobs
- Open Consulting-related jobs
- Open Hadoop-related jobs
- Open Kubernetes-related jobs
- Open Data governance-related jobs
- Open Databricks-related jobs
- Open Airflow-related jobs