Data Engineer (m/f/d)
Barcelona, ES
Schwarz Gruppe
Die Schwarz Gruppe ist mit weltweit 575.000 Mitarbeitern in 32 Ländern eines der führenden Handelsunternehmen. Erfahren Sie mehr über uns.Data Engineer (m/f/d)
What You'll Do
- As a Data Engineer, you will contribute to bring data analytics to production at scale in LIDL. Taking part on data teams building data platforms or data products together with data science and data management teams.
-
Build and maintain scalable data pipelines (batch and real time) from different sources to insert high volumes of data in our lake and make data available for our stakeholders.
-
Collaborate with other data team members in Data management and Data platform in order to implement and improve our data solutions.
-
Data modelling: model our datasets to ease data consumptions for our stakeholders
What You'll Need
- Languages: Scala/Python and SQL
-
Big Data Frameworks: Databricks, Spark
-
Data Base: relational (SQL Server)
-
CI/CD flows & tools: Azure DevOps
-
Monitoring and alerting tools: Azure Monitoring, Grafana
-
MS’s degree in Computer Science, Engineering, or related field
-
4+ years’ experience in software development
-
2+ years’ experience in Big Data Frameworks
-
Experience in Agile methodology
-
Experience with data workflow management tools like Airflow
-
Experience in Cloud platforms, specially Microsoft Azure.
-
As a bonus, contribution to open-source projects.
Nice to have
-
Passion for learning new tools, languages and frameworks
-
Ability to be creative and innovation-minded, self-motivated and proactive.
-
Fast adaptation to changing requirements and strong problem-solving skills.
-
To work in a collaborative model, side by side with the business.
-
The position requires fluency in English and effective collaboration in English-speaking teams.
What We Offer
- You will be part of an international team composed by people from different countries and backgrounds, where you’ll be able to share your experience and knowledge to carry-out team work and meet the objectives.
- On top of this, you’ll have a personal follow-up with your management team to help you understanding all business-related questions and guide you in your professional career.
- We offer a competitive compensation and benefits package: lunch vouchers, health and dental insurance, transport, wellbeing, etc
We look forward to receiving your application.
Schwarz Global Services · Laura Hernandez Costa · Reference no. 42146
C/Bergara 13, floor 5, 08002 Barcelona
es.it.schwarz
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Airflow Azure Big Data CI/CD Computer Science Data Analytics Databricks Data management Data pipelines DevOps Engineering Grafana Open Source Pipelines Python Scala Spark SQL
Perks/benefits: Career development Competitive pay Flex vacation Health care Lunch / meals
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Data Science Manager jobs
- Open Lead Data Analyst jobs
- Open Marketing Data Analyst jobs
- Open Data Engineer II jobs
- Open Senior Business Intelligence Analyst jobs
- Open MLOps Engineer jobs
- Open Principal Data Engineer jobs
- Open Power BI Developer jobs
- Open Data Scientist II jobs
- Open Business Intelligence Developer jobs
- Open Data Analytics Engineer jobs
- Open Business Data Analyst jobs
- Open Sr Data Engineer jobs
- Open Data Analyst Intern jobs
- Open Junior Data Scientist jobs
- Open Product Data Analyst jobs
- Open Sr. Data Scientist jobs
- Open Senior Data Architect jobs
- Open Research Scientist jobs
- Open Big Data Engineer jobs
- Open Azure Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Principal Data Scientist jobs
- Open Data Quality Analyst jobs
- Open Data Product Manager jobs
- Open Data quality-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open PhD-related jobs
- Open Deep Learning-related jobs
- Open Data visualization-related jobs
- Open Finance-related jobs
- Open PyTorch-related jobs
- Open NLP-related jobs
- Open TensorFlow-related jobs
- Open APIs-related jobs
- Open Consulting-related jobs
- Open LLMs-related jobs
- Open CI/CD-related jobs
- Open Snowflake-related jobs
- Open Generative AI-related jobs
- Open Kubernetes-related jobs
- Open Hadoop-related jobs
- Open Data governance-related jobs
- Open Docker-related jobs
- Open Airflow-related jobs