Data Engineer
Paris, France
Shippeo
Shippeo is a global leader in real-time multimodal transportation visibility, helping major shippers and logistics service providers deliver exceptional customer service and achieve operational excellence.Company Description
🚚 Founded in 2014, Shippeo is a French based SaaS company providing supply chain visibility. Shippeo has grown from 70 to 220 employees during the last two years and is continuing to rapidly scale after an additional $40M fundraising round in October 2022.
Shippeo is an exceptionally diverse company with colleagues from 27 different nationalities and speaking 29 languages. With offices throughout Europe, North America and recently Asia, Shippeo provides global coverage to all of our clients.
Job Description
The Data Intelligence Tribe is responsible for leveraging Shippeo’s data from our large shipper and carrier base, to build data products that help our users (shippers and carriers alike) and ML models to provide predictive insights. This tribe’s typical responsibilities are to:
- get accurately alerted in advance of any potential delays on their multimodal flows or anomalies so that they can proactively anticipate any resulting disruptions
- extract the data they need, get direct access to it or analyze it directly on the platform to gain actionable insights that can help them increase their operational performance and the quality and compliance of their tracking
- provide best-in-class data quality by implementing advanced cleansing & enhancement rules
As a Data Engineer at Shippeo, your objective is to ensure that data is available and exploitable by our Data Scientists and Analysts on our different data platforms. You will contribute to the construction and maintenance of Shippeo’s modern data stack that’s composed of different technology blocks:
- Data Acquisition (Kafka, KafkaConnect, RabbitMQ),
- Batch data transformation (Airflow, DBT),
- Cloud Data Warehousing (Snowflake, BigQuery),
- Stream/event data processing (Python, docker, Kubernetes) and all the underlying infrastructure that support these use cases.
Qualifications
Required:
- You have a degree (MSc or equivalent) in Computer Science.
- 3+ years of experience as a Data Engineer.
- Experience building, maintaining, testing and optimizing data pipelines and architectures
- Programming skills in Python and experience with asynchronous event processing (asyncio).
- Advanced working knowledge of SQL, experience working with relational databases and familiarity with a variety of databases.
- Working knowledge of message queuing and stream processing.
- Knowledge of Docker and Kubernetes.
- Knowledge of a cloud platform (preferably GCP).
- Experience working with workflow management systems such as Airflow.
Desired:
- Experience with cloud based data warehouse solutions (BigQuery, Snowflake).
- Experience with Kafka and KafkaConnect (Debezium).
- Experience with Infrastructure as code (Terraform/Terragrunt).
- Experience building and evolving CI/CD pipelines with Github Actions.
- Monitoring and alerting on Grafana / Prometheus.
- Experience working on Apache Nifi.
Additional Information
We are looking for talents who share our values:
- 🚀 Ambition
- 💙 Care
- 🎯 Deliver
- 🤝 Collaboration
Find out more about our values in Our Culture Book
If you identify with our values and enjoy working in a fast-paced and international environment, Shippeo is just the place for you!
We are committed to fostering diversity and inclusion within our workplace as we value the unique perspectives and experiences that individuals from all backgrounds bring to our team. We are dedicated to providing equal employment opportunities to all candidates, regardless of their background or abilities, and our commitment to inclusion is reflected in our policies, practices, and workplace culture.
We understand that candidates may have unique needs or questions related to disability inclusion. To facilitate this, you can reach our dedicated Disability Advisor at inclusion@shippeo.com with any inquiries or requests for accommodations during the application process.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow Architecture BigQuery CI/CD Computer Science Data pipelines Data quality Data warehouse Data Warehousing dbt Docker GCP GitHub Grafana Kafka Kubernetes Machine Learning ML models NiFi Pipelines Python RabbitMQ RDBMS Snowflake SQL Terraform Testing
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Data Science Manager jobs
- Open Lead Data Analyst jobs
- Open Data Engineer II jobs
- Open Data Manager jobs
- Open Senior Business Intelligence Analyst jobs
- Open MLOps Engineer jobs
- Open Principal Data Engineer jobs
- Open Power BI Developer jobs
- Open Data Scientist II jobs
- Open Business Intelligence Developer jobs
- Open Data Analytics Engineer jobs
- Open Junior Data Scientist jobs
- Open Business Data Analyst jobs
- Open Data Analyst Intern jobs
- Open Sr Data Engineer jobs
- Open Product Data Analyst jobs
- Open Sr. Data Scientist jobs
- Open Senior Data Architect jobs
- Open Big Data Engineer jobs
- Open Principal Data Scientist jobs
- Open Manager, Data Engineering jobs
- Open Data Quality Analyst jobs
- Open Azure Data Engineer jobs
- Open Research Scientist jobs
- Open Data Product Manager jobs
- Open Data quality-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open PhD-related jobs
- Open Deep Learning-related jobs
- Open Data visualization-related jobs
- Open Finance-related jobs
- Open PyTorch-related jobs
- Open TensorFlow-related jobs
- Open APIs-related jobs
- Open NLP-related jobs
- Open Consulting-related jobs
- Open LLMs-related jobs
- Open Snowflake-related jobs
- Open CI/CD-related jobs
- Open Generative AI-related jobs
- Open Kubernetes-related jobs
- Open Data governance-related jobs
- Open Hadoop-related jobs
- Open Airflow-related jobs
- Open Docker-related jobs