Senior Data Engineer
Amsterdam
Applications have closed
Beat
Our mission is to help people move around the city quickly and conveniently. Simply put is your City, Your ride, your driver at a tap of a button.About us
Beat is one of the most exciting companies to ever come out of the ride-hailing space. One city at a time, all across the globe we make transportation affordable, convenient, and safe for everyone. We also help hundreds of thousands of people earn extra income as drivers.
Today we are the fastest-growing ride-hailing service in Latin America. But serving millions of rides every day pales in comparison to what lies ahead. Our plans for expansion are limitless. Our stellar engineering team operates across a number of European capitals where, right now, some of the world’s most ambitious and talented engineers are changing how cities will move in the future.
Beat is currently available in Greece, Peru, Chile, Colombia, Mexico and Argentina.
Team - Marketplace Matching
The Matching domain has embraced remote working, with teammates spread across Europe. The domain is split into separate engineering teams, as well as other crafts working independently.
We are a team of passionate people who want to build high-quality systems and adopt the industry's best practices.
Our first goal is to deliver products and features, but we also strive for high-grade engineering in everything we do, constantly balancing delivery with quality.
We are open to suggestions, ideas, and improvements and always take facts and data into consideration when making a technical decision. We do it with kindness, do not blame or judge others and leave our ego behind.
We all have different backgrounds, experiences, and specialisations, and we believe that cooperation and knowledge sharing are key to building a great team. This is why we encourage discussions so that we can all learn from each other. We trust each other, and we are all responsible for the systems we build. We mutually help ourselves if anyone needs support.
We take care in communicating clearly and have tailored our engineering processes to remote work.
About the role
You will join Matching domain’s Machine Learning (ML) team. The ML team is responsible for core tasks inside the domain such as the intelligent matching of drivers to user ride requests. We are concerned with the whole lifecycle of the development of a ML/DS product as our work starts with formalizing the business requirements and follows all appropriate steps until a well performing, ML-powered solution gets into BEAT’s production flow.
What you'll be doing:
- Work within a cross-functional team, highly skilled in data science, machine learning, software engineering and data engineering.
- Design, develop and support real-time data ingestion solutions.
- Develop components that will analyse, process and react to operational feeds in near real-time.
- Support the data engineering needs of the wider Matching domain.
- Be agile both within and across teams, democratizing access to data for anyone within the organization.
- Collaborate with the DE Chapter within BEAT to further develop existing core libraries and tools that support data engineers across different domains and teams.
What you need to have:
- Bachelor's or Master's degree in Computer Science or in a related Engineering field. Higher degrees are highly appreciated.
- Experience building and running large-scale real-time and batch data pipelines.
- Experience coding using both Object-Oriented and Functional Programming principles on top of the JVM.
- Good understanding of the way distributed storage and processing systems work.
What is good to have:
- Familiarity with the Apache Hadoop stack (YARN, HDFS, MapReduce and Hive).
- Hands-on experience with Apache Spark.
- Familiarity with ETL processes and industry best practices.
- Experience in developing with Scala.
- Familiarity with distributed messaging systems, preferably Apache Kafka.
- Hands-on experience with streaming technologies such as Spark Streaming, Apache Flink or Kafka Streams.
- Exposure to Kubernetes.
- Knowledge of relational databases and NoSQL technologies
- Previous experience working closely with ML teams.
Benefits & Perks:
- Competitive full-time salary
- Flexible working hours, top Line tools
- Working in a hyper-growth environment, you will enjoy numerous learning and career development opportunities
- Breakfast, high-quality daily lunch on a very low cost, fruit and snacks all day long
- Commuter Benefits Program
- A great opportunity to grow and work with the most amazing people in the industry
- Being part of an environment that offers challenging goals, autonomy and mentoring, which creates incredible opportunities, both for you and the company.
As part of our dedication to the diversity of our workforce, Beat is committed to Equal Employment Opportunity without regard for race, color, national origin, ethnicity, gender, disability, sexual orientation, gender identity, or religio
Tags: Agile Computer Science Data pipelines Engineering ETL Flink Hadoop HDFS Kafka Kubernetes Machine Learning NoSQL Pipelines RDBMS React Scala Spark Streaming
Perks/benefits: Career development Competitive pay Flex hours Flex vacation Startup environment
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Marketing Data Analyst jobs
- Open MLOps Engineer jobs
- Open AI Engineer jobs
- Open Senior Data Architect jobs
- Open Junior Data Scientist jobs
- Open Data Engineer II jobs
- Open Sr Data Engineer jobs
- Open Data Analytics Engineer jobs
- Open Power BI Developer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Principal Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Product Data Analyst jobs
- Open Business Data Analyst jobs
- Open Data Manager jobs
- Open Data Quality Analyst jobs
- Open Sr. Data Scientist jobs
- Open Data Scientist II jobs
- Open Big Data Engineer jobs
- Open Business Intelligence Developer jobs
- Open Data Analyst Intern jobs
- Open Principal Data Scientist jobs
- Open ETL Developer jobs
- Open Azure Data Engineer jobs
- Open Data Product Manager jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open Privacy-related jobs
- Open Data management-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open ML models-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open APIs-related jobs
- Open PyTorch-related jobs
- Open PhD-related jobs
- Open TensorFlow-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open NLP-related jobs
- Open Data governance-related jobs
- Open Data warehouse-related jobs
- Open Airflow-related jobs
- Open Databricks-related jobs
- Open Hadoop-related jobs
- Open LLMs-related jobs
- Open DevOps-related jobs
- Open Kubernetes-related jobs