Data Engineer - BD&D
Herzliya
Applications have closed
AppsFlyer
Get visibility into performance, scale installs, and maximize LTV with a new standard of measurement and deep linking solutions.Are you ready to take your career to the next level?
The core of AppsFlyer is our data - currently over 65 billion events a day -- and like our company, our data is growing rapidly. Managing and providing analytics for this data is a challenge the BI team faces every day.
Working with this enormous volume of data begins with massive ETL pipelines built using modern industry-standard tools such as Kafka, S3, Yarn/Hadoop, and especially Spark. Providing access to this data requires employing multiple database technologies, each suited to the specific analytics tasks. The databases we use are constantly evolving but currently include BigQuery, PostgreSQL, HBase, Neo4J, Druid, Redis, and more. We are big believers in working with the right tool for the right job, including programming languages. We run a truly polyglot shot with Scala, Clojure, Python, Ruby, Go and JavaScript being especially common here at AppsFlyer. The extreme growth rate of our data and client base means that solutions need to be designed to handle 10X growth or more. Supporting this rapid pace of growth and polyglot development is a sophisticated automated deployment and scaling infrastructure that deploys docker containers into multiple cloud environments.
We are looking for experienced engineers ready to jump right into a complex and dynamic environment to start getting things done by implementing clean, high-quality Data Engineering solutions using the most appropriate technology.
What you’ll do
- End-to-end development of both client-facing and data infrastructure features from data processing to database choice and implementation through to API development
- Improve the scalability and performance of existing AppsFlyer products, reimplementing them when necessary
- Work effectively and collaboratively within the rest of the team, with other development teams, and with all other business teams of the company
- Understand the AppsFlyer product and business and how your work is essential to improve it
- Continuously learn and follow new technologies both for personal growth and to ensure we are making the most informed technology choices possible
What you have:
- 3+ years of experience in data engineering in Big Data pipelines, cloud environments, Hadoop ecosystem, SQL and NoSQL databases, SaaS.
- Proficiency with Python and Scala
- Experience with Spark ecosystem with one of the languages mentioned
- Proficiency with SQL and experience with ETL and data modeling
- Experience in an agile development methodology, CI/CD, Git/Bitbucket, Jenkins, Airflow
- Ability to read deeply and reason across multiple coding bases and languages
- Positive attitude and willingness to take ownership
- A mindset of continuous learning and the desire to try new things
- Ability to see the "big picture" and to understand the business side of things
- Bachelor's degree in Computer Science or equivalent degree
Bonus Points
- Deep understanding of Big / Distributed Data concepts like partitioning and skew
- Ability to form strong mental models of complex data processing stacks
- Understanding of object stores like S3
- Being recommended by an AppsFlyer employee
As a global company operating from 20 offices worldwide, we reflect the human mosaic of the diverse and multicultural world in which we live. We ensure equal opportunities for all of our employees and promote the recruitment of diverse talents to our global teams without consideration of race, gender, culture, or sexual orientation. We value and encourage curiosity, diversity, and innovation from all our employees, customers, and partners.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Airflow API Development APIs Big Data BigQuery Bitbucket CI/CD Clojure Computer Science Data pipelines Docker Engineering ETL Git Hadoop HBase JavaScript Kafka Neo4j NoSQL Pipelines PostgreSQL Python Ruby Scala Spark SQL
Perks/benefits: Career development Salary bonus Startup environment Team events
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Marketing Data Analyst jobs
- Open MLOps Engineer jobs
- Open Junior Data Scientist jobs
- Open AI Engineer jobs
- Open Data Engineer II jobs
- Open Senior Data Architect jobs
- Open Sr Data Engineer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Analytics Engineer jobs
- Open Power BI Developer jobs
- Open Manager, Data Engineering jobs
- Open Product Data Analyst jobs
- Open Principal Data Engineer jobs
- Open Business Data Analyst jobs
- Open Data Quality Analyst jobs
- Open Data Manager jobs
- Open Sr. Data Scientist jobs
- Open Data Scientist II jobs
- Open Big Data Engineer jobs
- Open Business Intelligence Developer jobs
- Open Data Analyst Intern jobs
- Open Principal Data Scientist jobs
- Open ETL Developer jobs
- Open Azure Data Engineer jobs
- Open Data Product Manager jobs
- Open Business Intelligence-related jobs
- Open Data quality-related jobs
- Open Privacy-related jobs
- Open Data management-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open ML models-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open APIs-related jobs
- Open PyTorch-related jobs
- Open PhD-related jobs
- Open Consulting-related jobs
- Open TensorFlow-related jobs
- Open Snowflake-related jobs
- Open NLP-related jobs
- Open Data governance-related jobs
- Open Data warehouse-related jobs
- Open Airflow-related jobs
- Open Hadoop-related jobs
- Open Databricks-related jobs
- Open LLMs-related jobs
- Open DevOps-related jobs
- Open CI/CD-related jobs