AWS Lead Data Engineer
Machelen, Belgium
Devoteam
Guiding IT Transformations with creative tech solutions in AI, Cloud, Cybersecurity & Sustainability. A trusted partner to 2500+ companies.Company Description
Devoteam is a leading consulting firm focused on digital strategy, tech platforms and cybersecurity. By combining creativity, tech and data insights, we empower our customers to transform their business and unlock the future. With 25 years’ experience and 10,000 employees across Europe, the Middle East and Africa, Devoteam promotes responsible tech for people and works to create better change.
Join our global community of exceptional talents at Devoteam, where you’ll collaborate with multidisciplinary teams of data specialists, business consultants, solution architects, security experts, cloud engineers, developers, and more across over 20 countries in the EMEA region. As a member of our team, you’ll have the opportunity to work with the world’s leading partners, including AWS, Google Cloud, Microsoft, and ServiceNow, driving innovation and advancing your career.
Job Description
Here is a non-exhaustive list of your daily missions; we trust you to take them in hand and enrich them in your own way:
Participate in AWS Cloud projects (EC2, S3, Lambda, Redshift, EMR, Kinesis, DynamoDB, etc.) or other solutions hosted on an AWS architecture (Snowflake, Databricks, etc.).
Develop and automate data ingestion pipelines with appropriate processing layers in relevant technologies (Python, Spark, Kafka).
Industrialize Data Science algorithms.
Design scalable and generic data schemas to meet reporting or other needs (SQL).
Develop custom applications based on existing generic components to meet client needs (scenario scripting, training monitoring of predictive models and AI, reporting, etc.).
Supervise and mentor junior consultants, i.e., peer code review, application of best practices.
Assist our sales team in writing proposals and pre-sales meetings.
Contribute to the development of our internal community.
Participate in the recruitment of our future talents.
Qualifications
The list of technologies you would be working on includes:
Python, PySpark, or Scala Spark. Scikit-learn, MLlib, Tensorflow, Keras, PyTorch, LightGBM, XGBoost, Scikit-Learn, and Spark (to name a few).
Data architectures and environments like Hadoop, ElasticSearch, Kafka, etc.
AWS Big Data stack (Step Function, Lambda, ECR, S3, EC2, Code Build, Glue, automation and DevOps tools, EMR, Redshift, Athena).
Implementation of DevOps environments and Infrastructure as Code.
Familiarity with tools like Git, GitLab CI, Jenkins, Ansible, Terraform, Docker, Kubernetes, ML Flow, Airflow, or their equivalents in Cloud environments.
Additional Information
Do you want to join a team of "builders" working on real Data projects in production and at scale? You are in the right place!
You have at least 4 years of experience in data engineering and data platform architecture on AWS.
You have experience in data visualisation (PowerBI, Tableau, QlikView, D3.js, ...).
You have honed your software engineering skills to perfection working with: Git, Scala, Python and or SQL
You Build batch and streaming ELT pipelines with one eye closed.
Your data modelling experience gives you an edge in building analytics use cases.
You have a knack to understand business needs through use case analysis and your communication skills.
Next to data analytics, you are aware of the evermore growing need to process unstructured data and keep an active eye on emerging technologies.
You cultivate your know-how and constantly seek better ways to do things, with an unlimited willingness to share.
Next to French or Dutch you also master English both orally and in writing.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow Ansible Architecture Athena AWS Big Data Consulting Consulting firm D3 Data Analytics Databricks DevOps Docker DynamoDB EC2 Elasticsearch ELT Engineering GCP Git GitLab Google Cloud Hadoop Jenkins Kafka Keras Kinesis Kubernetes Lambda LightGBM Machine Learning Pipelines Power BI PySpark Python PyTorch QlikView Redshift Scala Scikit-learn Security Snowflake Spark SQL Streaming Tableau TensorFlow Terraform Unstructured data XGBoost
Perks/benefits: Career development
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Research Scientist jobs
- Open Data Science Manager jobs
- Open Data Engineer II jobs
- Open Principal Data Scientist jobs
- Open Business Data Analyst jobs
- Open Data Scientist II jobs
- Open BI Analyst jobs
- Open Sr Data Engineer jobs
- Open Business Intelligence Engineer jobs
- Open Lead Data Analyst jobs
- Open Sr. Data Scientist jobs
- Open Data Science Intern jobs
- Open Software Engineer, Machine Learning jobs
- Open Senior Business Intelligence Analyst jobs
- Open Junior Data Scientist jobs
- Open MLOps Engineer jobs
- Open Azure Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Data Analytics Engineer jobs
- Open Marketing Data Analyst jobs
- Open Data Engineer III jobs
- Open Junior Data Engineer jobs
- Open Data Analyst II jobs
- Open Data Engineering Manager jobs
- Open ETL Developer jobs
- Open Data quality-related jobs
- Open Tableau-related jobs
- Open Privacy-related jobs
- Open Excel-related jobs
- Open ML models-related jobs
- Open Data pipelines-related jobs
- Open APIs-related jobs
- Open PhD-related jobs
- Open PyTorch-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open LLMs-related jobs
- Open Consulting-related jobs
- Open TensorFlow-related jobs
- Open Deep Learning-related jobs
- Open Business Intelligence-related jobs
- Open Generative AI-related jobs
- Open CI/CD-related jobs
- Open NLP-related jobs
- Open Data governance-related jobs
- Open DevOps-related jobs
- Open Kubernetes-related jobs
- Open Git-related jobs
- Open Hadoop-related jobs
- Open Docker-related jobs