Senior Data Engineer - Big Data
PT Porto
Farfetch
Farfetch bietet die weltweit größte Auswahl an Luxusmode für Damen und Herren. Shoppen Sie die aktuellen Kollektionen von internationalen Designern und Labels auf einer Webseite.WHAT YOU'LL DO
- Design scalable, end-to-end data pipelines to consume and integrate large volumes of complex data from multiple sources while using data flows management platforms
- Provide Data Engineering expertise to multiple teams across our organisation. Provide guidance to software engineers with industry and internal data best practices;
- Research and implement new data technologies;
- Work with other teams to understand needs and provide data solutions;
- Work with the Business Intelligence development team on migration and improvement of existing SQL Server-based ETLs to cloud based large-scale computation frameworks (Spark Databricks);
- Help develop new processes on the data warehouse platform and work with Data Scientists to transform big data into model-‐ ready forms to support projects.
WHO YOU ARE
- Experienced in working with large datasets (both structured and unstructured) using BigData related technologies such as Hive, Spark, kafka and NoSQL technologies;
- Experienced in data manipulation using a major programming language (Scala, Java, Python );
- Knowledgeable of distributed systems and distributed data processing frameworks (Spark, Flink);
- Experienced in building end to end data pipelines using data flow management/orchestration technologies (oozie, luigi, knowledge of Apache Airflow is a bonus) ;
- An excellent in grasping of algorithmic concepts in computer science (e.g., sorting, data structures);
- Experienced in the development and release of enterprise scale applications;
- Experienced with git version control and CI/CD deployment pipelines
REWARDS & BENEFITS
- Health insurance for the whole family, flexible working environment and well-being support and tools
- Extra days off, sabbatical program and days for you to give back for the community
- Training opportunities and free access to Udemy
- Flexible benefits program
- FARFETCH Equity plan
EQUAL OPPORTUNITIES STATEMENT
- FARFETCH is an equal opportunities employer ensuring that all applicants are treated equally and fairly throughout our recruitment process. We are determined that no applicant experiences discrimination on the basis of sex, race, ethnicity, religion or belief, disability, age, gender identity, ancestry, sexual orientation, veteran status, marriage and civil partnership, pregnancy and maternity, or any other basis prohibited by applicable law. We continue to build our consciously inclusive culture as part of our Positively FARFETCH strategy throughout our business, partnerships and communities.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow Big Data Business Intelligence CI/CD Computer Science Databricks Data pipelines Distributed Systems Engineering Flink Git Kafka NoSQL Oozie Pipelines Python Research Scala Spark SQL
Perks/benefits: Flex hours Health care Insurance Salary bonus
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open MLOps Engineer jobs
- Open Lead Data Analyst jobs
- Open Data Science Manager jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Manager jobs
- Open Data Engineer II jobs
- Open Principal Data Engineer jobs
- Open Power BI Developer jobs
- Open Sr Data Engineer jobs
- Open Business Intelligence Developer jobs
- Open Junior Data Scientist jobs
- Open Data Analytics Engineer jobs
- Open Product Data Analyst jobs
- Open Data Scientist II jobs
- Open Sr. Data Scientist jobs
- Open Business Data Analyst jobs
- Open Senior Data Architect jobs
- Open Data Analyst Intern jobs
- Open Big Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Azure Data Engineer jobs
- Open Data Product Manager jobs
- Open Data Quality Analyst jobs
- Open Research Scientist jobs
- Open Junior Data Engineer jobs
- Open GCP-related jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open Java-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open PhD-related jobs
- Open APIs-related jobs
- Open TensorFlow-related jobs
- Open PyTorch-related jobs
- Open NLP-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open CI/CD-related jobs
- Open LLMs-related jobs
- Open Kubernetes-related jobs
- Open Generative AI-related jobs
- Open Data governance-related jobs
- Open Hadoop-related jobs
- Open Airflow-related jobs
- Open Docker-related jobs