Senior Data Engineer
London, England
Algolia
Enterprises and developers use Algolia’s AI search infrastructure to understand users and show them what they’re looking for.- Developing data pipelines and ETL workflows mainly with Python, Airflow (AWS MWAA), Spark (AWS Glue, EMR), other AWS services managed with Terraform.
- Improving and maintaining our data warehouse (AWS Redshift).
- Support the Analytics Engineering team to build data models with dbt to be used by Analysts on business reports.
- Interacting with Engineering and Business teams to understand requirements.
- Design, build, enrich, scale up our data pipelines.
- Work with engineers, data analysts, business analysts to capture and model data.
- Monitor data integrity and growth.
- Help improve our data lake and data warehouse architecture, to increase performance, simplicity and autonomy of the users.
- Help analysts industrialise reports and dashboards to improve company productivity.
- Ensure every product is released with a data-driven approach.
- Strong experience designing and building data pipelines.
- Experience orchestrating pipelines with Airflow.
- Professional knowledge of Python.
- Strong experience working with cloud platforms and architecting them.
- Strong experience with data warehouses.
- Experience about infrastructure topics specific to data engineering.
- Interest in Big Data challenges (~600Tb of data, +14Tb per week, ~700M files, +1,2M per week, ~300 dbt models, ~70 Airflow DAGs)
- Interest in understanding the data and business requirements.
- Excellent spoken and written English skills.
- You are humble, curious, proactive, and strike a balance between creativity, resourcefulness, and pragmatism.
Nice to have...
- Experience using and managing AWS Redshift.
- Experience with a parallel data processing framework such as Apache Spark.
- Experience analysing data quality using dbt.
- Experience at our current stage and beyond ($50-200M ARR range, high growth, lots of change and building internal infrastructure).
REMOTE STRATEGY:
Algolia’s flexible workplace model is designed to empower all Algolians to fulfill our mission to power search and discovery with ease. We place an emphasis on an individual’s impact, contribution, and output, over their physical location. Algolia is a high-trust environment and our team members have the autonomy to choose where they want to work and when. We know community comes in many forms and strive to create opportunities for intentional in-person connection in our offices and virtually for our remote colleagues around the world.
We have a global presence with physical offices in San Francisco, NYC, Paris, London, Sydney and Bucharest.
ABOUT US:
Algolia prides itself on being a pioneer and market leader offering an AI Search solution that empowers 17,000+ businesses to compose customer experiences at internet scale that predict what their users want with blazing fast search and web browse experience. Algolia powers more than 30 billion search requests a week – four times more than Microsoft Bing, Yahoo, Baidu, Yandex and DuckDuckGo combined.
Algolia is part of a cadre of innovative new companies that are driving the next generation of software development, creating APIs that make developers’ lives easier; solutions that are better than building from scratch and better than having to tweak monolithic SaaS solutions.
In 2021, the company closed $150 million in series D funding and quadrupled its post-money valuation of $2.25 billion. Being well capitalized enables Algolia to continue to invest in its market leading platform, to better serve its thousands of customers–including Under Armor, Petsmart, Stripe, Gymshark, and Walgreens, to name just a few.
WHO WE'RE LOOKING FOR:
We’re looking for talented, passionate people to build the world’s best search & discovery technology. As an ownership-driven company, we seek team members who thrive within an environment based on autonomy and diversity. We're committed to building an inclusive and diverse workplace. We care about each other and the world around us, and embrace talented people regardless of their race, age, ancestry, religion, sex, gender identity, sexual orientation, marital status, color, veteran status, disability and socioeconomic background.
READY TO APPLY?
If you share our values and our enthusiasm for building the world’s best search & discovery technology, we’d love to review your application!
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow APIs Architecture AWS AWS Glue Big Data Data pipelines Data quality Data warehouse dbt Engineering ETL Pipelines Python Redshift Spark Terraform
Perks/benefits: Career development Flex hours Startup environment
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Data Science Manager jobs
- Open Lead Data Analyst jobs
- Open MLOps Engineer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Engineer II jobs
- Open Data Manager jobs
- Open Principal Data Engineer jobs
- Open Power BI Developer jobs
- Open Data Scientist II jobs
- Open Junior Data Scientist jobs
- Open Sr Data Engineer jobs
- Open Data Analytics Engineer jobs
- Open Product Data Analyst jobs
- Open Business Intelligence Developer jobs
- Open Business Data Analyst jobs
- Open Data Analyst Intern jobs
- Open Sr. Data Scientist jobs
- Open Senior Data Architect jobs
- Open Big Data Engineer jobs
- Open Principal Data Scientist jobs
- Open Manager, Data Engineering jobs
- Open Azure Data Engineer jobs
- Open Data Quality Analyst jobs
- Open Junior Data Engineer jobs
- Open Data Product Manager jobs
- Open Data quality-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open PhD-related jobs
- Open Deep Learning-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open PyTorch-related jobs
- Open APIs-related jobs
- Open TensorFlow-related jobs
- Open NLP-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open LLMs-related jobs
- Open CI/CD-related jobs
- Open Generative AI-related jobs
- Open Kubernetes-related jobs
- Open Hadoop-related jobs
- Open Data governance-related jobs
- Open Airflow-related jobs
- Open Databricks-related jobs