Staff Data Engineer - Personalization

The Personalization team makes deciding what to play next easier and more enjoyable for every listener. From Daily Mix to Discover Weekly, we’re behind some of Spotify’s most-loved features. We built them by understanding the world of music and podcasts better than anyone else. Join us and you’ll keep millions of users listening by making great recommendations to each and every one of them. We ask that our team members be physically located in Central European time or Eastern Standard/Daylight time zones for the purposes of our collaboration hours.
Spotify is looking for a Staff Data Engineer to join the team. You will engineer solutions that bring music and media experiences to hundreds of millions of users and creators by matching fans with creators in a personal and relevant way. You will seek sophisticated data problems using some of the most diverse datasets — user behaviors, acoustical analysis, revenue streams, cultural and contextual data, and other signals across a range of platforms. Above all, your work will change the way the world experiences art!

Who You Are

• You are the experienced leader that team members go to for help leveling-up their skills in data engineering and more.
• You have worked with large-scale and high-volume heterogeneous data using distributed systems.
• You have used high-level JVM-based processing frameworks such as Apache Beam, Dataflow, Crunch, Scalding, Storm, Spark, or similar - but not just Pig/Hive/BigQuery SQL-like abstractions.
• You have used message broker services (pub-sub pattern) such as Kafka, ActiveMQ, AWS SQS, Google PubSub or similar.
• You understand data modeling, data access, and data storage, caching, replication, and optimization techniques.
• You have worked in a cloud-native development (GCP preferred).You have worked in a CI/CD environment.
• You have experience with agile software processes, data development, reliability, and responsible experimentation.
• You are comfortable with distributed teams and asynchronous communication.

What You'll Do

• Influence, coach and mentor other Data Engineers. Be a leader, making your team a continuously better version of itself.
• Architect large-scale batch and real-time data pipelines with data processing frameworks like Scio, Dataflow and the Google Cloud Platform.
• Deliver scalable, testable, maintainable, and high-quality code.Create testing and tooling to improve data quality.
• Work in an agile engineering team to continuously experiment, iterate and deliver.
• Share knowledge, promote standards, collaborate with engineers and product managers.
• Assist with the setting of technology strategy and influence work across teams and product areas.

Where You'll Be

• We are a distributed workforce enabling our band members to find a work mode that is best for them.
• Where in the world? For this role, it can be within the Americas region in which we have a work location and is within working hours.
• You will be working with a team that is largely based in Boston and New York. We collaborate within the Eastern Standard time zone and ask that you be comfortable with that.
• Prefer an office to work from home instead? Not a problem! We have plenty of options for your working preferences. Find more information about our Work From Anywhere options here.

Spotify is an equal opportunity employer. You are welcome at Spotify for who you are, no matter where you come from, what you look like, or what’s playing in your headphones. Our platform is for everyone, and so is our workplace. The more voices we have represented and amplified in our business, the more we will all thrive, contribute, and be forward-thinking! So bring us your personal experience, your perspectives, and your background. It’s in our differences that we will find the power to keep revolutionizing the way the world listens.
Spotify transformed music listening forever when we launched in 2008. Our mission is to unlock the potential of human creativity by giving a million creative artists the opportunity to live off their art and billions of fans the chance to enjoy and be passionate about these creators. Everything we do is driven by our love for music and podcasting. Today, we are the world’s most popular audio streaming subscription service with a community of more than 381 million users.
Global COVID and Vaccination DisclosureSpotify is committed to safety and well-being of our employees, vendors and clients. We are following regional guidelines mandating vaccination and testing requirements, including those requiring vaccinations and testing for in-person roles and event attendance. For the US, we have mandated that all employees and contractors be fully vaccinated in order to work in our offices and externally with any third-parties. For all other locations, we strongly encourage our employees to get vaccinated and also follow local COVID and safety protocols.