Sr. Data Engineer

Technology is where the brightest minds in data and engineering connect, providing the essential measurement that helps fuel media businesses. The work this team does today will change the entertainment of tomorrow–the way we watch and listen to what we love.
Nielsen‘s mission is to help marketers and media companies measure and improve advertising performance by accurately reporting on what consumers watch, see, or hear. In the Identity Platform Team, we are processing, in batch, billions of rows for the purpose of measuring our audience and calibrating against panelists. We have implemented this data pipeline with the following technologies:
Apache Spark (SQL) with GraphframesTrino (Presto)Apache AirflowAWS EMR, S3, and RDSScala, Python and Spark/Trino SQL
So if you get excited by clustering in graphs, predicate pushdown in query execution, using typeclasses in scala and finding ways to make software less error-prone, then we have a job for you.

Requirements

• Fluency in Scala as a functional programming language
• 5+ years of hands-on experience in server-side development using Java or Python
• 2+ years of hands-on experience making data pipelines with Apache Spark
• Degree in Engineering or Computer Science or in a quantitative field

Nice to have

• Understanding of graph algorithms
• Strong understanding of distributed systems design
• Contributes to Open Source Software

ABOUT NIELSENNielsen: Enabling your best to power a better media future. Our comprehensive benefits package (including health & wellness plans, 401(k) retirement coupled with a Nielsen match, a generous paid time off policy, and if eligible, a discretionary incentive/bonus) is designed to be inclusive for all employees and families, and we take pride in ensuring that employees are rewarded holistically for the role they are doing and their performance. A reasonable estimate of salary range for a new employee to be offered this role would be between $50,000 - $185,000, which would be adjusted based on each employee's geographic location.  The position of each employee within a compensation range at Nielsen is dependent on several individual circumstances, such as experience, training, certifications and other business requirements/needs.   Nielsen is committed to hiring and retaining a diverse workforce. We are proud to be an Equal Opportunity/Affirmative Action-Employer, making decisions without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability status, age, marital status, protected veteran status or any other protected class.
#LI-Remote#LI-BH1