Senior Data Engineer

Amsterdam (Netherlands)

Beat logo
Beat
Apply now Apply later

Posted 1 week ago

About us

Beat is one of the most exciting companies to ever come out of the ride-hailing space. One city at a time, all across the globe we make transportation affordable, convenient, and safe for everyone. We also help hundreds of thousands of people earn extra income as drivers. 

Today we are the fastest-growing ride-hailing service in Latin America. But serving millions of rides every day pales in comparison to what lies ahead. Our plans for expansion are limitless. Our stellar engineering team operates across a number of European capitals where, right now, some of the world’s most ambitious and talented engineers are changing how cities will move in the future.

Beat is currently available in Greece, Peru, Chile, Colombia, Mexico and Argentina.

About the role

Data is at the heart of this effort and is an essential ingredient in Beat's aggressive growth plan and vision for the future. We’re currently transitioning to a microservices architecture which requires novel solutions when it comes to ingestion and leverage of the data from different sources.

As a member of our team, you will help tackle some of the most fundamental data-driven challenges we face and your work will impact the entire Beat experience.

What you'll be doing:

  • Work closely with Data and Platform engineers for the design, development, enhancement and support of real-time data ingestion solutions.
  • Develop the core libraries and tools that support data engineers across different teams.
  • Develop components that will analyse, process and react to operational feeds in near real-time.
  • Be agile both within and across teams, democratizing access to data for anyone within the organization.

What you need to have:

  • Bachelor's or Master's degree in Computer Science or in a related Engineering field. Higher degrees are highly appreciated.
  • Experience building and running large-scale real-time and batch data pipelines.
  • Experience coding using both Object-Oriented  and Functional Programming principles on top of the JVM.
  • Good understanding of the way distributed storage and processing systems work.

What is good to have:

  • Familiarity with the Apache Hadoop stack (YARN, HDFS, MapReduce and Hive).
  • Hands-on experience with Apache Spark.
  • Familiarity with ETL processes and industry best practices.
  • Experience in developing with Scala.
  • Familiarity with distributed messaging systems, preferably Apache Kafka.
  • Hands-on experience with streaming technologies such as Spark Streaming, Apache Flink or Kafka Streams.
  • Exposure to Kubernetes.
  • Knowledge of relational databases and NoSQL technologies.

What's in it for you:

  • Competitive full-time salary
  • Defined contribution Pension plan
  • Flexible working hours, top Line tools.
  • Work permit cost covered
  • Commuter Benefits Program
  • Working in a hyper-growth environment, you will enjoy numerous learning and career development opportunities 
  • Breakfast, high-quality daily lunch on a very low cost, fruit and snacks all day long
  • A great opportunity to grow and work with the most amazing people in the industry
  • Being part of an environment that offers challenging goals, autonomy and mentoring, which creates incredible opportunities, both for you and the company.

As part of our dedication to the diversity of our workforce, Beat is committed to Equal Employment Opportunity without regard for race, color, national origin, ethnicity, gender, disability, sexual orientation, gender identity, or religion.

Job tags: Engineering ETL Hadoop HDFS Kafka Kubernetes NoSQL Scala Spark