Data Engineer II - Reliability Ops
USA - NY - 1211 Avenue of the Americas
Full Time Mid-level / Intermediate USD 102K - 150K
The Walt Disney Company
The mission of The Walt Disney Company is to be one of the world's leading producers and providers of entertainment and information.Job Posting Title:
Data Engineer II - Reliability OpsReq ID:
10092621Job Description:
Disney Entertainment & ESPN Technology
On any given day at Disney Entertainment & ESPN Technology, we’re reimagining ways to create magical viewing experiences for the world’s most beloved stories while also transforming Disney’s media business for the future. Whether that’s evolving our streaming and digital products in new and immersive ways, powering worldwide advertising and distribution to maximize flexibility and efficiency, or delivering Disney’s unmatched entertainment and sports content, every day is a moment to make a difference to partners and to hundreds of millions of people around the world.
A few reasons why we think you’d love working for Disney Entertainment & ESPN Technology
Building the future of Disney’s media business: DE&E Technologists are designing and building the infrastructure that will power Disney’s media, advertising, and distribution businesses for years to come.
Reach & Scale: The products and platforms this group builds and operates delight millions of consumers every minute of every day – from Disney+ and Hulu, to ABC News and Entertainment, to ESPN and ESPN+, and much more.
Innovation: We develop and execute groundbreaking products and techniques that shape industry norms and enhance how audiences experience sports, entertainment & news.
The Product & Data Engineering team is responsible for end to end development for Disney’s world-class consumer-facing products, including streaming platforms Disney+, Hulu, and ESPN+, and digital products & experiences across ESPN, Marvel, Disney Studios, NatGeo, and ABC News. The team drives innovation at scale for millions of consumers around the world across Apple, Android, Smart TVs, game consoles, and the web, with our platforms powering core experiences like personalization, search, messaging and data.
The Data Reliability Engineering team for Disney’s Product and Data Engineering team is responsible for maintaining and improving the reliability of Disney Entertainment’s big data platform, which processes hundreds of terabytes of data and billions of events daily.
Job Summary:
The Data Engineer II will help us in the ongoing mission of delivering outstanding services to our users allowing Disney Entertainment to be more data-driven. You will work closely with the senior members of our team to monitor and drive improvements for reliability and observability of critical data pipelines and deliverables. This is a high-impact role where your work informs decisions affecting millions of consumers, with a direct tie to The Walt Disney Company’s revenue. You will be making an outsized impact in an organization that values data as its top priority. We are a tight and driven team with big goals, so we seek people who are passionate about solving the toughest challenges and working at scale, using, supporting, and building distributed systems in a fast-paced collaborative team environment. We also support a healthy work-life-balance.
Responsibilities
You will assist with on-call rotations as a Live-Ops Incident Commander to help categorize and track real time data incidents, loop in engineering resources as needed to ensure a timely resolution to data issues.
You will help drive our problem management process to ensure root cause of data incidents are analyzed and understood, and follow-up work is prioritized with our partner teams.
You will play a key role in our long-term Incident and Problem Management strategy by contributing to the development of a Data Reliability Observability Platform that will assist in programmatically quantifying incident impacts and send targeted communications to both data owners and consumers.
You will partner with our external support and data quality teams, defining success KPI’s, ensuring observability and automation coverage of our platform and help create dashboards and visualizations for teams to monitor the health of our data pipelines and platform.
Basic Qualifications
Bachelor’s Degree in computer science, information systems, or related field or equivalent work experience.
3+ years of relevant data engineering experience.
Good understanding of data modeling principles including Dimensional modeling, data normalization principles.
Experience with process engineering and continuous improvement.
Detailed problem-solving approach, coupled with a strong sense of drive and ownership.
Strong communication skills – written and verbal presentations.
Comfortable working in a fast-paced and highly collaborative environment.
Familiarity with Agile Scrum principles and ceremonies
Preferred Qualifications
2+ years of work experience implementing and reporting on business key performance indicators in data warehousing environments, exposure to reliability engineering best practices a plus.
2+ years of experience using analytic SQL, working with traditional relational databases and/or distributed systems (Snowflake or Redshift), required.
1+ years of experience programming languages (e.g. Python, Pyspark), preferred.
Experience with Snowflake, Databricks/EMR/Spark, and/or Airflow.
Job Posting Segment:
Product & Data EngineeringJob Posting Primary Business:
PDE - Data Platform EngineeringPrimary Job Posting Category:
Data EngineeringEmployment Type:
Full timePrimary City, State, Region, Postal Code:
New York, NY, USAAlternate City, State, Region, Postal Code:
USA - CA - 2450 Broadway, USA - CA - Market St, USA - WA - 925 4th AveDate Posted:
2024-06-13Tags: Agile Airflow Big Data Computer Science Databricks Data pipelines Data quality Data Warehousing Distributed Systems Engineering KPIs Pipelines PySpark Python RDBMS Redshift Scrum Snowflake Spark SQL Streaming
Perks/benefits: Equity / stock options Health care Salary bonus Team events
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Research Scientist jobs
- Open Data Science Manager jobs
- Open Data Engineer II jobs
- Open Principal Data Scientist jobs
- Open Business Data Analyst jobs
- Open BI Analyst jobs
- Open Sr Data Engineer jobs
- Open Data Scientist II jobs
- Open Business Intelligence Engineer jobs
- Open Data Science Intern jobs
- Open Sr. Data Scientist jobs
- Open Senior Business Intelligence Analyst jobs
- Open Software Engineer, Machine Learning jobs
- Open Lead Data Analyst jobs
- Open Azure Data Engineer jobs
- Open Junior Data Scientist jobs
- Open MLOps Engineer jobs
- Open Data Analytics Engineer jobs
- Open Manager, Data Engineering jobs
- Open Marketing Data Analyst jobs
- Open Data Engineer III jobs
- Open Junior Data Engineer jobs
- Open Data Engineering Manager jobs
- Open Data Analyst II jobs
- Open ETL Developer jobs
- Open Data quality-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Excel-related jobs
- Open ML models-related jobs
- Open Data pipelines-related jobs
- Open APIs-related jobs
- Open PhD-related jobs
- Open PyTorch-related jobs
- Open LLMs-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open Consulting-related jobs
- Open TensorFlow-related jobs
- Open Deep Learning-related jobs
- Open Business Intelligence-related jobs
- Open Generative AI-related jobs
- Open CI/CD-related jobs
- Open NLP-related jobs
- Open Data governance-related jobs
- Open DevOps-related jobs
- Open Kubernetes-related jobs
- Open Git-related jobs
- Open Hadoop-related jobs
- Open Docker-related jobs