Senior Staff Production Engineer, Data Foundations - Compute (Remote, EMEA)

Company Description

Shopify is a leading global commerce company, providing trusted tools to start, grow, market, and manage a retail business of any size. Shopify makes commerce better for everyone with a platform and services that are engineered for reliability, while delivering a better shopping experience for consumers everywhere. Shopify powers millions of businesses in more than 175 countries and is trusted by brands such as Allbirds, Gymshark, PepsiCo, Staples, and many more.

Job Description

The Data Foundations team is part of the Production Engineering organization that builds, operates, and improves the heart of Shopify’s technical platform to unlock the power of planet-scale infrastructure for all of Shopify’s merchants, buyers, and developers. 

The mission of the Data Foundations team is to provide Shopify developers with fast, reliable, trusted, intuitive, and interoperable building-blocks for applications and platforms that ingest, transform, and query offline data. The systems we manage empower data scientists, analysts, application developers and other users within Shopify to use data at a huge scale, enhancing the world-class platform we offer to our merchants.

We are looking for a senior staff engineer to join us to lead the Compute domain that owns the underlying engines to power the query, batch, and orchestration workloads of the Shopify data platform. This domain works in concert with the Data Foundations Lakehouse, where the 1st- and 3rd-party Shopify data are ingested and persisted, and Data Foundations Infrastructure, where the production engineering standards are applied and the common control plane is built.

You will work on things like:

• Drive technical strategy and delivery that impacts the technology stack of the Compute domain.
• Identify complex, high-leverage technical problems and deliver solutions in the Data Foundations team.
• Work hands-on with code and detailed technical design, while being able to step back and see the wider context in which the team’s solutions help the business.
• Act as a change agent for Shopify by aligning senior stakeholders and resolving conflicts on complex technical direction of large ambiguous efforts beyond Data Foundations.
• Drive change in our processes, tools and codebases beyond the Compute domain to deliver higher throughput and quality of engineering.
• Grow people in Compute by identifying learning opportunities and delivering on them.
• Demonstrate leadership to the dev community (internal or external to Shopify) through talks, engineering blogs or other activities.
• Attract others at the same level or higher to work at Shopify.
• Challenge or evolve our engineering culture - how we think about and approach problems.

Qualifications

Qualities you likely have to be well suited to this role:

• Deep programming experience, including familiarity with two or more mainstream programming languages (e.g. Go, Java, Scala, Python)
• Significant experience in the development and operation of large scale distributed systems
• Significant experience building and evolving enterprise data management systems in a cloud based platform
• Understanding - including architecture, internals and tuning - of two or more data processing engines (e.g. Trino, Spark)
• Able to make considered and highly impactful architectural decisions, understanding and clearly communicating assumptions and trade-offs
• Strong technical leadership to guide and mentor senior members of the team
• Strong communication skills, both verbal and written

Bonus

• Experience leading or contributing to Open Source Software projects
• Experience with data technologies in the e-commerce or related industries
• Experience creating and supporting systems used by Data Scientists

Additional Information

We know that looking for a new role can be both exciting and time-consuming, and we truly appreciate your effort. And remember, we want to know what you’re really interested in building and why you want to build it at Shopify, so please give us as much detail on this as you’d like in the answers on the next page. 👍 📖

Interested, but not ready to apply? 
Join the Shopify Talent Community to learn more about us, while you polish up your resume: https://www.shopify.com/careers/teams/engineering

#LI-KO3 #LI-REMOTE #LI-AH1

Our belief is that a strong commitment to diversity & inclusion enables us to truly make commerce better for everyone. We encourage applications from Indigenous peoples, racialized people, people with disabilities, people from gender and sexually diverse communities, and/or people with intersectional identities. Please take a look at our Sustainability Reports to learn more about Shopify’s commitments to our communities, and our planet.

At Shopify, we understand that experience comes in many forms. We’re dedicated to adding new perspectives to the team - so if your experience is this close to what we’re looking for, please consider applying.

Our belief is that a strong commitment to diversity & inclusion enables us to truly make commerce better for everyone. We encourage applications from Indigenous peoples, racialized people, people with disabilities, people from gender and sexually diverse communities, and/or people with intersectional identities. Please take a look at our Sustainability Reports to learn more about Shopify’s commitments to our communities, and our planet.

At Shopify, we understand that experience comes in many forms. We’re dedicated to adding new perspectives to the team - so if your experience is this close to what we’re looking for, please consider applying.