Principal Data Engineer

United States

Full Time Senior-level / Expert
Gopuff logo

Gopuff

Gopuff delivers everything you need—food delivery, home essentials, snack delivery and alcohol near you. Download the Gopuff app.

View all employer listings

Apply now Apply later

Gopuff is seeking a Principal Data Engineer to join its Data Engineering team. This individual will play a major role in shaping the team’s technical direction, designing and implementing the data architecture to enable analytics, data science, and machine learning at scale. The ideal candidate will also serve as a mentor to other data engineers, investing in the team’s development together. This position is a hands-on engineering role, with the core focus being on developing and deploying production-grade code.

Responsibilities

  • Takes a hands-on role at piloting and developing tools in addition to enhancing existing platforms that power Gopuff’s data teams
  • Architect and implement large-scale data processing systems that enable analytics, data science, and machine learning in a multi-cloud environment
  • Develop best practices for data collection, storage, and processing that impact company-wide data strategy across Gopuff’s data lakes and data warehouses
  • Partner with software and analytics engineering teams to establish data contracts to improve data quality at every stage of the data lifecycle 
  • Participate in design and architectural review sessions with data engineers and software engineering partners
  • Conduct code reviews and knowledge-sharing sessions across data engineering and partner teams
  • Collaborate with engineering and product leadership to translate business requirements into technical solutions
  • Partner with engineering teams to model foundational event schemas 

Qualifications

  • 8+ years of experience in a data engineering role building end-to-end ETL/ELT pipelines
  • Experience building batch data pipelines using DAG-based tools such as Dagster or Airflow
  • Experience developing real-time data pipelines using frameworks such as Apache Beam, Flink, Storm, Spark Streaming, etc. 
  • Experience with data warehouses, data lakes, and their underlying infrastructure
  • Proficiency in Python, SQL, RESTful API development
  • Experience with cloud computing platforms such as Azure, AWS
  • Experience data observability and monitoring tooling such as Monte Carlo, Great Expectations, SodaSQL, Databand, etc. 
  • Experience in producing and consuming topics to/from Apache Kafka, AWS Kinesis, or Azure Event Hubs 
  • Experience with data governance, schema design, and schema evolution
  • Experience implementing DevOps best practices within the data platform, including solutions for CI/CD, data observability, monitoring, and lineage
  • Experience with Infrastructure as code tools such as Terraform
BenefitsWe want to help our employees stay safe and healthy! We offer comprehensive medical, dental, and vision insurance, optional FSAs and HSA plans, 401k, commuter benefits, supplemental employee, spouse and child life insurance to all eligible employees.
We also offer:-Gopuff employee discount-Career growth opportunities-Internal rewards programs-Annual performance appraisal and bonus-Equity program 
At Gopuff, we know that life can be unpredictable. Sometimes you forget the milk at the store, run out of pet food for Fido, or just really need ice cream at 11 pm. We get it—stuff happens. But that’s where we come in, delivering all your wants and needs in just minutes.
And now, we’re assembling a team of motivated people to help us drive forward that vision to bring a new age of convenience and predictability to an unpredictable world.
Like what you’re hearing? Then join us on Team Blue.
Gopuff is an equal employment opportunity employer, committed to an inclusive workplace where we do not discriminate on the basis of race, sex, gender, national origin, religion, sexual orientation, gender identity, marital or familial status, age, ancestry, disability, genetic information, or any other characteristic protected by applicable laws. We believe in diversity and encourage any qualified individual to apply.

Tags: Airflow API Development APIs AWS Azure CI/CD Dagster Data pipelines Data strategy DevOps Engineering ETL Kafka Kinesis Machine Learning Monte Carlo Pipelines Python Spark SQL Streaming Terraform

Perks/benefits: Career development Health care Insurance Salary bonus

Region: North America
Country: United States
Job stats:  2  0  0
Category: Engineering Jobs
  • Share this job via
  • or

Other jobs like this

Explore more AI/ML/Data Science career opportunities

Find open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general, filtered by job title or popular skill, toolset and products used.