Senior Data Engineer
Remote
Gopuff
Gopuff delivers thousands of everyday items, at your door in 30 minutes. Get everyday value in your pocket. Instantly.#LI-Remote
Responsibilities
- Implement generalized platform solutions that process data at scale
- Develop Continuous Integration and Continuous Delivery processes to improve platform quality and stability
- Participate in proof of concepts and pilot new technologies that impact team architecture
- Engage in design and architectural review sessions with data engineers
- Conduct code reviews and knowledge sharing sessions across data engineering and partner teams
- Partner with software and analytics engineering teams to establish data contracts to improve data quality at every stage of the data lifecycle
Preferred Qualifications
- 5-8 years of experience in a Data Engineering role
- Experience building batch data pipelines using DAG-based tools such as Dagster or Airflow
- Experience developing real-time data pipelines using frameworks such as Apache Beam, Flink, Storm, Spark Streaming, etc.
- Experience with data warehouses, data lakes, and their underlying infrastructure
- Proficiency in Python, SQL, RESTful API development
- Experience with cloud computing platforms such as Azure, AWS
- Experience data observability and monitoring tooling such as Monte Carlo, Great Expectations, SodaSQL, Databand, etc.
- Experience in producing and consuming topics to/from Apache Kafka, AWS Kinesis, or Azure Event Hubs
- Experience with data governance, schema design, and schema evolution
- Experience implementing DevOps best practices within the data platform, including solutions for CI/CD, data observability, monitoring, and lineage
- Experience with Infrastructure as code tools such as Terraform
We also offer*:-Gopuff employee discount-Career growth opportunities-Internal rewards programs-Annual performance appraisal and bonus-Equity program *Not applicable for contractors or temporary employees.
At Gopuff, we know that life can be unpredictable. Sometimes you forget the milk at the store, run out of pet food for Fido, or just really need ice cream at 11 pm. We get it—stuff happens. But that’s where we come in, delivering all your wants and needs in just minutes.
And now, we’re assembling a team of motivated people to help us drive forward that vision to bring a new age of convenience and predictability to an unpredictable world.
Like what you’re hearing? Then join us on Team Blue.
Gopuff is an equal employment opportunity employer, committed to an inclusive workplace where we do not discriminate on the basis of race, sex, gender, national origin, religion, sexual orientation, gender identity, marital or familial status, age, ancestry, disability, genetic information, or any other characteristic protected by applicable laws. We believe in diversity and encourage any qualified individual to apply.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow API Development APIs Architecture AWS Azure CI/CD Dagster Data governance Data pipelines Data quality DevOps Engineering Flink Kafka Kinesis Machine Learning Monte Carlo Pipelines Python Spark SQL Streaming Terraform
Perks/benefits: Career development Health care Insurance Salary bonus
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Marketing Data Analyst jobs
- Open MLOps Engineer jobs
- Open Junior Data Scientist jobs
- Open Data Engineer II jobs
- Open AI Engineer jobs
- Open Senior Data Architect jobs
- Open Power BI Developer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Analytics Engineer jobs
- Open Sr Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Principal Data Engineer jobs
- Open Business Data Analyst jobs
- Open Product Data Analyst jobs
- Open Data Quality Analyst jobs
- Open Data Manager jobs
- Open Sr. Data Scientist jobs
- Open Big Data Engineer jobs
- Open Data Scientist II jobs
- Open Business Intelligence Developer jobs
- Open Data Analyst Intern jobs
- Open ETL Developer jobs
- Open Principal Data Scientist jobs
- Open Azure Data Engineer jobs
- Open Data Product Manager jobs
- Open Business Intelligence-related jobs
- Open Data quality-related jobs
- Open Privacy-related jobs
- Open Data management-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open ML models-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open APIs-related jobs
- Open PyTorch-related jobs
- Open Consulting-related jobs
- Open PhD-related jobs
- Open TensorFlow-related jobs
- Open Snowflake-related jobs
- Open NLP-related jobs
- Open Data governance-related jobs
- Open Data warehouse-related jobs
- Open Airflow-related jobs
- Open Hadoop-related jobs
- Open Databricks-related jobs
- Open LLMs-related jobs
- Open DevOps-related jobs
- Open CI/CD-related jobs