Senior Data Engineer - Billing Platform
Herzliya
Applications have closed
AppsFlyer
Get visibility into performance, scale installs, and maximize LTV with a new standard of measurement and deep linking solutions.Are you ready to take your career to the next level?
AppsFlyer is rapidly growing. More customers are using more of our products while generating more data that we process and analyze in order to deliver insights that ensure our customers make the best choices. To accommodate AppsFlyer’s unique set of products, as well as the increasing volume of data that our customers generate, we have developed a unique billing platform that moves our business while processing and transforming large amounts of customer data from multiple data sources.
We are looking for a Senior Data Engineer to join our billing platform team!
Who are you, our Senior Data Engineer? You’re an experienced backend engineer with a strong background in writing ETLs and complicated data processing pipelines. You’re deeply familiar with modern data processing technologies (especially Spark), have a strong problem-solving attitude and, most importantly, you’re passionate about understanding the business side of the platform. Our platform engineers have an end-to-end understanding of the data our products generate and the commercial models and data structures in which they fit.
Working with this enormous volume of data begins with massive ETL pipelines built using cutting-edge technologies such as Kafka, BigQuery, Airflow, S3, PostgreSQL, Athena, SQS, Redis, and especially Spark. We are big believers in working with the right tool for the right job, including programming languages. We run a truly polyglot shot with Scala, Python, Go and Node being especially common here at AppsFlyer. The extreme growth rate of our data and client base means that solutions need to be designed to handle 10X growth or more.
What you’ll do
- Develop end-to-end data infrastructure features from data processing logic to database choice and implementation through to API development
- Improve the scalability and performance of existing data pipelines.
- Mentor, advise, and work collaboratively within the Business Data and Development group, with other development teams, and with all other business teams of the company
- Understand the AppsFlyer product and business and how your work is essential to improve it
- Continuously learn and follow new technologies both for personal growth and to ensure we are making the most informed technology choices possible
What you have
- 4+ years of experience in data engineering in Big Data environments
- 2+ years of experience with Spark and its ecosystem, preferably with Scala
- Experience with public cloud environments (AWS will be a bonus), Hadoop ecosystem, SQL and NoSQL databases, and SaaS
- Proficiency with Scala/Java and Python
- Proficiency with SQL and experience with ETL and data modeling
- Experience in an agile development methodology, CI/CD, Git/Bitbucket, Jenkins, Airflow
- Positive attitude and willingness to take ownership
- A mindset of continuous learning and the desire to try new things
- Ability to see the "big picture" and to understand the business side of things
As a global company operating from 20 offices worldwide, we reflect the human mosaic of the diverse and multicultural world in which we live. We ensure equal opportunities for all of our employees and promote the recruitment of diverse talents to our global teams without consideration of race, gender, culture, or sexual orientation. We value and encourage curiosity, diversity, and innovation from all our employees, customers, and partners.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Airflow API Development APIs Athena AWS Big Data BigQuery Bitbucket CI/CD Data pipelines Engineering ETL Git Hadoop Kafka NoSQL Pipelines PostgreSQL Python Scala Spark SQL
Perks/benefits: Career development Salary bonus
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open MLOps Engineer jobs
- Open Lead Data Analyst jobs
- Open Data Science Manager jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Manager jobs
- Open Data Engineer II jobs
- Open Power BI Developer jobs
- Open Principal Data Engineer jobs
- Open Sr Data Engineer jobs
- Open Business Intelligence Developer jobs
- Open Junior Data Scientist jobs
- Open Data Analytics Engineer jobs
- Open Data Scientist II jobs
- Open Product Data Analyst jobs
- Open Sr. Data Scientist jobs
- Open Senior Data Architect jobs
- Open Business Data Analyst jobs
- Open Data Analyst Intern jobs
- Open Big Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Azure Data Engineer jobs
- Open Data Quality Analyst jobs
- Open Data Product Manager jobs
- Open Junior Data Engineer jobs
- Open Principal Data Scientist jobs
- Open GCP-related jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open Java-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open PhD-related jobs
- Open APIs-related jobs
- Open TensorFlow-related jobs
- Open PyTorch-related jobs
- Open NLP-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open CI/CD-related jobs
- Open Kubernetes-related jobs
- Open LLMs-related jobs
- Open Generative AI-related jobs
- Open Data governance-related jobs
- Open Hadoop-related jobs
- Open Airflow-related jobs
- Open Docker-related jobs