Senior Data Engineer - Data & AI Group
Tel Aviv
Now developers and engineers can employ an end-to-end, cloud-native observability stack built on scalable and easy-to-use Open Source using a single UI and unified agent – at a cost that anyone can afford. Our customers unlock proactive troubleshooting, faster product delivery and a fully supported SaaS observability platform, all while compounding efficiencies in time and cost.
We are looking for an experienced Senior Data Engineer to join our 'Data & AI' group. As a key member of our team, you will play a crucial role in designing and building data models, developing infrastructure, and optimizing data processes to support our data analysis, data science and engineering teams. You will collaborate with various stakeholders to ensure efficient data ingestion, processing, and analysis, contributing to the overall success of our data-driven initiatives.
Key Responsibilities:
- Design and build robust data models and infrastructure to support data science and engineering teams.
- Develop and optimize data processes, including ETL/ELT pipelines, for efficient data ingestion and processing.
- Identify and understand business processes to derive actionable insights from the data.
- Collaborate with BI analysts to create comprehensive reports and dashboards.
- Implement and maintain scalable data solutions in a high-volume production environment.
- Utilize modern technologies such as M3DB, Open-Search, Grafana, etc., for data processing and analysis.
- Lead design initiatives for new products and contribute to best practices.
- Work closely with cloud providers like AWS for data storage, computation, and orchestration.
- Stay updated with advancements in data engineering, big data, and cloud technologies.
Requirements:
- Bachelor's degree in computer science, engineering, or a related field.
- 5+ years of hands-on experience in data engineering and BI development.
- Proficiency in SQL and Python for data manipulation and pipeline development.
- Experience with complex ETL/ELT processes and big data technologies
- Experience with Airflow.
- Strong analytical skills and attention to detail
- Excellent communication and collaboration abilities.
Preferred Qualifications:
- Experience with machine learning algorithms and AI implementation.
- Previous work with distributed systems, real-time analytics, and data visualization tools.
- Familiarity with the AWS cloud platform and big data technologies.
- Experience with Spark, Kafka, Elasticsearch, DynamoDB, and K8s. If you are passionate about leveraging data to drive business outcomes and thrive in a dynamic, data-driven environment, we encourage you to apply.
We care deeply about the warm, inclusive environment we’ve created and we value diversity – we welcome applications from those typically underrepresented in tech. If you like the sound of this role but are not totally sure whether you’re the right person, do apply anyway!
If this sounds like you, please join our team!
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow AWS Big Data Computer Science Data analysis Data visualization Distributed Systems DynamoDB Elasticsearch ELT Engineering ETL Grafana Kafka Kubernetes Machine Learning Open Source Pipelines Python Security Spark SQL
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Data Science Manager jobs
- Open Lead Data Analyst jobs
- Open MLOps Engineer jobs
- Open Data Manager jobs
- Open Senior Business Intelligence Analyst jobs
- Open Principal Data Engineer jobs
- Open Data Engineer II jobs
- Open Power BI Developer jobs
- Open Sr Data Engineer jobs
- Open Data Scientist II jobs
- Open Data Analytics Engineer jobs
- Open Product Data Analyst jobs
- Open Business Intelligence Developer jobs
- Open Junior Data Scientist jobs
- Open Business Data Analyst jobs
- Open Sr. Data Scientist jobs
- Open Data Analyst Intern jobs
- Open Senior Data Architect jobs
- Open Big Data Engineer jobs
- Open Principal Data Scientist jobs
- Open Junior Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Data Quality Analyst jobs
- Open Azure Data Engineer jobs
- Open Data Product Manager jobs
- Open Data quality-related jobs
- Open GCP-related jobs
- Open Business Intelligence-related jobs
- Open Java-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Data visualization-related jobs
- Open Finance-related jobs
- Open Deep Learning-related jobs
- Open PhD-related jobs
- Open PyTorch-related jobs
- Open APIs-related jobs
- Open TensorFlow-related jobs
- Open NLP-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open LLMs-related jobs
- Open CI/CD-related jobs
- Open Generative AI-related jobs
- Open Kubernetes-related jobs
- Open Hadoop-related jobs
- Open Data governance-related jobs
- Open Airflow-related jobs
- Open DevOps-related jobs