Data Engineer

New York, NY

Spotify logo
Apply now Apply later

Posted 1 month ago

Spotify is looking for a Data Engineer to join our engineering organization. You will be a part of enabling our current and future premium offerings to optimally drive revenue growth for Spotify. You will build solutions to bring music and digital media experiences to our 200 million active users and millions of artists either by working directly on product features or by improving the quality of our data tools and infrastructure. You will also tackle complex data-related problems using some of the most diverse datasets available — user behavior, content, cultural and contextual data, and other signals across our broad range of mobile and connected platforms. Above all, your work will influence the way people experience music.

What you will do:

  • Ingest and aggregate data from both internal and external data sources to build our extraordinary datasets
  • Build large-scale batch and real-time data pipelines with data processing frameworks like Scio, Storm, or Spark on the Google Cloud Platform
  • Demonstrate standard methodologies in continuous integration and delivery
  • Help drive optimization, testing, and tooling to improve data quality
  • Collaborate with other engineers, ML specialists, and partners, taking learning and leadership opportunities that will arise every day
  • Work in cross functional agile teams to continuously experiment, iterate, and deliver on new product objectives.
  • Work from our offices in New York, with some travel to other Spotify office locations

Who you are:

  • You know how to work with high volume heterogeneous data, preferably with distributed systems such as Hadoop, BigTable, and Cassandra
  • You have experience with one or more higher-level JVM-based data processing frameworks such as Beam, Dataflow, Crunch, Scalding, Storm, Spark, or something we didn’t list- but not just Pig/Hive/BigQuery/other SQL-like abstractions
  • You are knowledgeable about data modeling, data access, and data storage techniques
  • You understand the value of teamwork within teams, are excellent communicators, and can build relationships with a diverse set of partners
  • Machine Learning experience is a plus
  • Experience with data ingestion via API and/or web scraping/crawling (e.g. Selenium, BeautifulSoup) at scale preferred
  • Experience with Google Cloud Platform
You are welcome at Spotify for who you are, no matter where you come from, what you look like, or what’s playing in your headphones. Our platform is for everyone, and so is our workplace. The more voices we have represented and amplified in our business, the more we will all thrive, contribute, and be forward-thinking! So bring us your personal experience, your perspectives, and your background. It’s in our differences that we will find the power to keep revolutionizing the way the world listens.
Spotify transformed music listening forever when we launched in 2008. Our mission is to unlock the potential of human creativity by giving a million creative artists the opportunity to live off their art and billions of fans the chance to enjoy and be passionate about these creators. Everything we do is driven by our love for music and podcasting. Today, we are the world’s most popular audio streaming subscription service with a community of more than 320 million users.
Job tags: BigQuery Cassandra Distributed Systems Engineering Hadoop Machine Learning ML Spark SQL Travel
Job region(s): North America
Share this job: