Data Engineer II - Reliability Ops

USA - NY - 1211 Avenue of the Americas

The Walt Disney Company

The mission of The Walt Disney Company is to be one of the world's leading producers and providers of entertainment and information.

View all jobs at The Walt Disney Company

Apply now Apply later

Job Posting Title:

Data Engineer II - Reliability Ops

Req ID:

10092621

Job Description:

Disney Entertainment & ESPN Technology

On any given day at Disney Entertainment & ESPN Technology, we’re reimagining ways to create magical viewing experiences for the world’s most beloved stories while also transforming Disney’s media business for the future. Whether that’s evolving our streaming and digital products in new and immersive ways, powering worldwide advertising and distribution to maximize flexibility and efficiency, or delivering Disney’s unmatched entertainment and sports content, every day is a moment to make a difference to partners and to hundreds of millions of people around the world.

A few reasons why we think you’d love working for Disney Entertainment & ESPN Technology

  • Building the future of Disney’s media business: DE&E Technologists are designing and building the infrastructure that will power Disney’s media, advertising, and distribution businesses for years to come.

  • Reach & Scale: The products and platforms this group builds and operates delight millions of consumers every minute of every day – from Disney+ and Hulu, to ABC News and Entertainment, to ESPN and ESPN+, and much more.

  • Innovation: We develop and execute groundbreaking products and techniques that shape industry norms and enhance how audiences experience sports, entertainment & news.

The Product & Data Engineering team is responsible for end to end development for Disney’s world-class consumer-facing products, including streaming platforms Disney+, Hulu, and ESPN+, and digital products & experiences across ESPN, Marvel, Disney Studios, NatGeo, and ABC News. The team drives innovation at scale for millions of consumers around the world across Apple, Android, Smart TVs, game consoles, and the web, with our platforms powering core experiences like personalization, search, messaging and data.

The Data Reliability Engineering team for Disney’s Product and Data Engineering team is responsible for maintaining and improving the reliability of Disney Entertainment’s big data platform, which processes hundreds of terabytes of data and billions of events daily.

Job Summary:

The Data Engineer II will help us in the ongoing mission of delivering outstanding services to our users allowing Disney Entertainment to be more data-driven. You will work closely with the senior members of our team to monitor and drive improvements for reliability and observability of critical data pipelines and deliverables. This is a high-impact role where your work informs decisions affecting millions of consumers, with a direct tie to The Walt Disney Company’s revenue. You will be making an outsized impact in an organization that values data as its top priority. We are a tight and driven team with big goals, so we seek people who are passionate about solving the toughest challenges and working at scale, using, supporting, and building distributed systems in a fast-paced collaborative team environment. We also support a healthy work-life-balance.

Responsibilities

  • You will assist with on-call rotations as a Live-Ops Incident Commander to help categorize and track real time data incidents, loop in engineering resources as needed to ensure a timely resolution to data issues.

  • You will help drive our problem management process to ensure root cause of data incidents are analyzed and understood, and follow-up work is prioritized with our partner teams.

  • You will play a key role in our long-term Incident and Problem Management strategy by contributing to the development of a Data Reliability Observability Platform that will assist in programmatically quantifying incident impacts and send targeted communications to both data owners and consumers.

  • You will partner with our external support and data quality teams, defining success KPI’s, ensuring observability and automation coverage of our platform and help create dashboards and visualizations for teams to monitor the health of our data pipelines and platform.

Basic Qualifications

  • Bachelor’s Degree in computer science, information systems, or related field or equivalent work experience.

  • 3+ years of relevant data engineering experience.

  • Good understanding of data modeling principles including Dimensional modeling, data normalization principles.

  • Experience with process engineering and continuous improvement.

  • Detailed problem-solving approach, coupled with a strong sense of drive and ownership.

  • Strong communication skills – written and verbal presentations.

  • Comfortable working in a fast-paced and highly collaborative environment.

  • Familiarity with Agile Scrum principles and ceremonies

Preferred Qualifications

  • 2+ years of work experience implementing and reporting on business key performance indicators in data warehousing environments, exposure to reliability engineering best practices a plus.

  • 2+ years of experience using analytic SQL, working with traditional relational databases and/or distributed systems (Snowflake or Redshift), required.

  • 1+ years of experience programming languages (e.g. Python, Pyspark), preferred.

  • Experience with Snowflake, Databricks/EMR/Spark, and/or Airflow.

The hiring range for this position in New York, NY or Seattle, WA is between $107,400 to $143,900, Los Angeles, CA is $102,500 to $137,500 year and in San Francisco is $112,300 to $150,500. The base pay actually offered will take into account internal equity and also may vary depending on the candidate’s geographic region, job-related knowledge, skills, and experience among other factors. A bonus and/or long-term incentive units may be provided as part of the compensation package, in addition to the full range of medical, financial, and/or other benefits, dependent on the level and position offered.

Job Posting Segment:

Product & Data Engineering

Job Posting Primary Business:

PDE - Data Platform Engineering

Primary Job Posting Category:

Data Engineering

Employment Type:

Full time

Primary City, State, Region, Postal Code:

New York, NY, USA

Alternate City, State, Region, Postal Code:

USA - CA - 2450 Broadway, USA - CA - Market St, USA - WA - 925 4th Ave

Date Posted:

2024-06-13
Apply now Apply later
  • Share this job via
  • or
Job stats:  1  0  0

Tags: Agile Airflow Big Data Computer Science Databricks Data pipelines Data quality Data Warehousing Distributed Systems Engineering KPIs Pipelines PySpark Python RDBMS Redshift Scrum Snowflake Spark SQL Streaming

Perks/benefits: Equity / stock options Health care Salary bonus Team events

Regions: North America South America
Country: United States

More jobs like this

Explore more AI, ML, Data Science career opportunities

Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.