Data Engineer - Remote

Nielsen Media would not function without our Technology teams! We are catalysts for delivery quality, on-time, reliable measurements to clients, and we are cultivators, growing our employees through education, skill building and experiences. Around the globe, our Technology teams are relentless in our pursuit of superior analytics, technology, process and support.
Nielsen‘s mission is to help marketers and media companies measure and improve advertising performance by accurately reporting on what consumers watch, see, or hear. In the Identity Platform Team, we are processing, in batch, billions of rows for the purpose of measuring our audience and calibrating against panelists. We have implemented this data pipeline with the following technologies:
Apache Spark (SQL) with GraphframesTrino (Presto)Apache AirflowAWS EMR, S3, and RDSScala, Python and Spark/Trino SQL.
So if you get excited by clustering in graphs, predicate pushdown in query execution, using typeclasses in scala and finding ways to make software less error-prone, then we have a job for you.

Requirements

• Fluency in Scala as a functional programming language.
• 5+ years of hands-on experience in server-side development using Java or Python
• 2+ years of hands-on experience making data pipelines with Apache Spark.
• Degree in Engineering or Computer Science or in a quantitative field

Nice to Have

• Understanding of graph algorithms
• Strong understanding of distributed systems design
• Contributes to Open Source Software