Staff Data Engineer, AWS Cost Data

Airbnb is a mission-driven company dedicated to helping create a world where anyone can belong anywhere. It takes a unified team committed to our core values to achieve this goal. Airbnb's various functions embody the company's innovative spirit and our fast-moving team is committed to leading as a 21st century company.

AWS Cost team @ Airbnb

Airbnb runs on AWS and infrastructure cost management is an important focus for Airbnb’s scale of operations. Airbnb has a complex technical stack which makes it difficult to understand the true cost of services that are several layers deep. This requires us to have robust data systems that are able to attribute costs to the right services and teams. The AWS cost team tackles these complex problems and helps Airbnb manage our overall costs. 

We are looking for a Staff Data Engineer to join the team and help us take our cost data program to the next level. This team builds solutions at Airbnb scale to help teams understand their costs and manage them. Candidates will need to be data-centric, develop a strong understanding of the Airbnb technology stack and lead projects across teams that have a direct impact on Airbnb’s bottom line. 

Some of our work is available in these public posts:

• Our Journey Towards Cloud Efficiency
• Achieving Insights and Savings with Cost Data

But this is just the beginning of our journey. There are new areas that you can help us explore like measuring Airbnb-wide utilization data (e.g. CPU utilization) and breaking new grounds for efficiency.

Like all teams at Airbnb, we value and promote the diversity of our workforce, our guests, our hosts, our marketplace platform, and the world. Simply put, you belong at Airbnb.

Responsibilities:

• Design, develop and manage large scale data processing systems to measure Airbnb’s infrastructure cost, usage and resource utilization
• Partner with Data Science and Program Managers to systematically scale systems and processes to manage ongoing costs 
• Develop deep understanding of Airbnb systems across all areas and work with teams across Airbnb to help them understand, plan and manage their costs
• Manage and deliver technical roadmap for Cost Data team
• Set standards of operational excellence by building data systems that are reliable, efficient, testable, & maintainable
• Evangelize high quality software engineering practices towards building data infrastructure and pipelines at scale
• Contribute to shared Data Engineering tooling & standards to improve the productivity and quality of output for Data Engineers across the company

Minimum Requirements: 

• 8+ years of relevant industry experience.
• Bachelor’s and/or Master’s degree in CS/EE, or equivalent experience.
• Experience designing, building and operating robust distributed systems.
• Working knowledge of relational databases and query authoring (SQL).
• Experience with Java / Scala / Spark
• Effectively work across team boundaries to establish overarching data architecture, and provide guidance to individual teams.
• Experience leading programs and driving technical decisions that impact multiple teams
• Excellent communication skills, both written and verbal.