Principal Data Engineer

Gopuff is seeking a Principal Data Engineer to join its Data Engineering team. This individual will play a major role in shaping the team’s technical direction, designing and implementing the data architecture to enable analytics, data science, and machine learning at scale. The ideal candidate will also serve as a mentor to other data engineers, investing in the team’s development together. This position is a hands-on engineering role, with the core focus being on developing and deploying production-grade code.

Responsibilities

• Takes a hands-on role at piloting and developing tools in addition to enhancing existing platforms that power Gopuff’s data teams
• Architect and implement large-scale data processing systems that enable analytics, data science, and machine learning in a multi-cloud environment
• Develop best practices for data collection, storage, and processing that impact company-wide data strategy across Gopuff’s data lakes and data warehouses
• Partner with software and analytics engineering teams to establish data contracts to improve data quality at every stage of the data lifecycle 
• Participate in design and architectural review sessions with data engineers and software engineering partners
• Conduct code reviews and knowledge-sharing sessions across data engineering and partner teams
• Collaborate with engineering and product leadership to translate business requirements into technical solutions
• Partner with engineering teams to model foundational event schemas 

Qualifications

• 8+ years of experience in a data engineering role building end-to-end ETL/ELT pipelines
• Experience building batch data pipelines using DAG-based tools such as Dagster or Airflow
• Experience developing real-time data pipelines using frameworks such as Apache Beam, Flink, Storm, Spark Streaming, etc. 
• Experience with data warehouses, data lakes, and their underlying infrastructure
• Proficiency in Python, SQL, RESTful API development
• Experience with cloud computing platforms such as Azure, AWS
• Experience data observability and monitoring tooling such as Monte Carlo, Great Expectations, SodaSQL, Databand, etc. 
• Experience in producing and consuming topics to/from Apache Kafka, AWS Kinesis, or Azure Event Hubs 
• Experience with data governance, schema design, and schema evolution
• Experience implementing DevOps best practices within the data platform, including solutions for CI/CD, data observability, monitoring, and lineage
• Experience with Infrastructure as code tools such as Terraform

BenefitsWe want to help our employees stay safe and healthy! We offer comprehensive medical, dental, and vision insurance, optional FSAs and HSA plans, 401k, commuter benefits, supplemental employee, spouse and child life insurance to all eligible employees.
We also offer:-Gopuff employee discount-Career growth opportunities-Internal rewards programs-Annual performance appraisal and bonus-Equity program 
At Gopuff, we know that life can be unpredictable. Sometimes you forget the milk at the store, run out of pet food for Fido, or just really need ice cream at 11 pm. We get it—stuff happens. But that’s where we come in, delivering all your wants and needs in just minutes.
And now, we’re assembling a team of motivated people to help us drive forward that vision to bring a new age of convenience and predictability to an unpredictable world.
Like what you’re hearing? Then join us on Team Blue.
Gopuff is an equal employment opportunity employer, committed to an inclusive workplace where we do not discriminate on the basis of race, sex, gender, national origin, religion, sexual orientation, gender identity, marital or familial status, age, ancestry, disability, genetic information, or any other characteristic protected by applicable laws. We believe in diversity and encourage any qualified individual to apply.