Data Engineer M/F
Lyon, Auvergne-Rhône-Alpes, France
Applications have closed
DataGalaxy
DataGalaxy is a powerful data catalog and knowledge platform that simplifies the organization and utilization of business metadata. Request for a demo today!We are looking for a Data Engineer to join our growing team of analytics experts in Lyon or Paris.
The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as developing new connectors plugins for the retrieve team.
The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing
data systems and building them from the ground up.
The Data Engineer will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects.
- Create and maintain optimal data systems and pipeline architecture
- Build processes supporting data transformation, data structures, metadata, dependency and workload management.
- Conduct complex data analysis and report on results
- Build algorithms and prototypes
- Identify opportunities for data acquisition
- Designs and evaluates open source and vendor tools for data acquisition and data lineage
- Collaborate with data scientists and architects on several projects
Requirements
- Previous experience (minimum 3 years) as a data engineer or in a similar role
- Good interpersonal skills, management and collaboration
- Values of diversity, transparency, humility and trust
- Experience designing, building, and maintaining data processing systems
- Spark (SQL or pyspark framework), SQL is mandatory
- Previous experiences on Google Cloud Platform (IAM, BigQuery, Cloud Dataflow, Cloud Composer, Cloud Functions, ...) or Amazon Web Services (IAM, Lambda, S3, EKS, ...) is mandatory
- Experiences with Delta is a plus
- Experiences with Kubernetes is a plus
- Stack: Python, Spark, Databricks, Delta Lake, Docker, Kubernetes, Elastic Search
Benefits
Today in the mid-development after raising funds, DataGalaxy is looking for collaborators who are curious, ambitious, and open-minded for the internationalization of its market.
DataGalaxy is expanding its teams in order to accelerate its growth and perfect what they offer. To join you must: “Be bold, be intentional, be humble.” DataGalaxy needs motivated candidates with creativity who believe in their values
At DataGalaxy you will find a friendly and dynamic environment where it is easy to find your place…
Being a part of the DataGalaxy team is also:
- Having the freedom to organize your work (day package, remote working at will).
- Having breakfast, lunch with the foodies in the teams and an end of week drink (if you’re up for it).
- Being part of a fun team and participating in fun and motivating termly outings.
- Having a good sense of humor and being humble.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: BigQuery Data analysis Databricks Dataflow Docker GCP Google Cloud Kubernetes Lambda Open Source PySpark Python Spark SQL
Perks/benefits: Team events Transparency
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Marketing Data Analyst jobs
- Open MLOps Engineer jobs
- Open AI Engineer jobs
- Open Junior Data Scientist jobs
- Open Data Engineer II jobs
- Open Senior Data Architect jobs
- Open Sr Data Engineer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Analytics Engineer jobs
- Open Power BI Developer jobs
- Open Manager, Data Engineering jobs
- Open Product Data Analyst jobs
- Open Principal Data Engineer jobs
- Open Business Data Analyst jobs
- Open Data Quality Analyst jobs
- Open Data Manager jobs
- Open Sr. Data Scientist jobs
- Open Data Scientist II jobs
- Open Big Data Engineer jobs
- Open Business Intelligence Developer jobs
- Open Data Analyst Intern jobs
- Open Principal Data Scientist jobs
- Open ETL Developer jobs
- Open Azure Data Engineer jobs
- Open Data Product Manager jobs
- Open Business Intelligence-related jobs
- Open Data quality-related jobs
- Open Privacy-related jobs
- Open Data management-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open ML models-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open APIs-related jobs
- Open PyTorch-related jobs
- Open PhD-related jobs
- Open TensorFlow-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open NLP-related jobs
- Open Data governance-related jobs
- Open Data warehouse-related jobs
- Open Databricks-related jobs
- Open Airflow-related jobs
- Open Hadoop-related jobs
- Open LLMs-related jobs
- Open DevOps-related jobs
- Open CI/CD-related jobs