Head of Data Infrastructure - Video/Amazon IVS
Salt Lake City, UT
Twitch
Twitch is an interactive livestreaming service for content spanning gaming, entertainment, sports, music, and more. There’s something for everyone on Twitch.About Us
Twitch is the world’s biggest live streaming service, with global communities built around gaming, entertainment, music, sports, cooking, and more. It’s where millions of people come together to chat, interact, and make their own entertainment.
We’re about community, inside and out. You’ll find coworkers who are eager to team up, collaborate, and smash (or elegantly solve) problems together. We’re on a quest to empower live communities, so if this sounds good to you, see what we’re up to on LinkedIn and Twitter, get interviewing tips on Instagram, and discover projects we’re solving on our Blog.
About the Role
Amazon Interactive Video Service (IVS) is a managed live video service, within Amazon Web Services (AWS), built on top of Twitch Video. It has one of the world's largest live video networks. IVS powers the many developers and companies that are using live video to uniquely engage and build communities, just as it does for Twitch, where more than a billion hours are streamed live each month.
You will report into the Video/IVS team and lead the software and data engineering team that will design, develop, and run the data infrastructure to meet the ever growing needs of our business. This team builds and operates the technology that powers the event ingestion system handling trillions of weekly video events, a multi-petabyte data lake, and complex applications on top, which supply our customers with uninterrupted access to clean data and insights. Your team enables outcomes for all data producers and consumers across engineering, product, and business. This includes powering inputs for data scientists generating insights for product managers and business leaders, and for applied scientists building machine learning based product enhancements. You will craft the data vision for a fast-growing enterprise service, including creating the foundation to offer our video data as a product for our enterprise customers.
If you are experienced in distributed systems and cloud data infrastructure at consumer web scale, bring your passion and leadership to grow our enterprise cloud service. You will work in our San Francisco office, but we will also consider other locations including Seattle (WA), Salt Lake City (UT), Vancouver (BC), or US-Virtual.
You Will:
- Develop the data infrastructure vision for the business
- Work with Video/IVS/Twitch teams to enhance/extend a tech framework that ingests high volume of video event data to support data science and machine learning
- Manage a highly scalable Big Data architecture, and enhance advanced data models and analytic frameworks
- Establish and own data governance, and implement tools to provide governance (data catalog and lineage)
- Create applications with the ability to do searches, real-time alerts, and high throughput APIs on large datasets
- Grow your team to build an outstanding data stack, and advocate for your team and technologies
You Have:
- Experience in software and data engineering
- Knowledge of pioneering data technologies and architecture design to achieve performance at scale
- 10+ years of hands-on experience building petabyte scale data platforms and Big Data architecture using AWS and open source services in the cloud like Kinesis/Kafka, Spark, ElasticSearch
- 2+ years of leading teams in data engineering, infrastructure or platforms
- Real-life production experience creating architectural frameworks and tools for Data and Applied Science teams to build, train, and scale machine learning models
- Experience building CI/CD framework for data teams using tools like Airflow, Luigi, and DBT
- Experience in one or more programming languages like Go, Python
Bonus Points
- Bachelors/Masters in computer science, engineering, mathematics, or a related technical discipline
- Experience with real-time video streaming event data, and in architecting data lakes for enterprise cloud services
Perks
- Medical, Dental, Vision & Disability Insurance
- 401(k), Maternity & Parental Leave
- Flexible PTO
- Commuter Benefits
- Amazon Employee Discount
- Monthly Contribution & Discounts for Wellness Related Activities & Programs (e.g., gym memberships, off-site massages, etc.),
- Breakfast, Lunch & Dinner Served Daily
- Free Snacks & Beverages
Pursuant to the Los Angeles Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
We are an equal opportunity employer and value diversity at Twitch. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.
The pay range for this position in Colorado and Connecticut is $163,200 - $240,200 yr; however, base pay offered may vary depending on job-related knowledge, skills, and experience. A sign-on bonus and restricted stock units may be provided as part of the compensation package, in addition to a full range of medical, financial, and/or other benefits, dependent on the position offered. This information is provided per the Colorado Equal Pay Act and CT House Bill Number 6380. Base pay information is based on market location. Applicants should apply via Twitch's internal or external careers site.
Workers in New York City who perform in-person work or interact with the public in the course of business must show proof they have been fully vaccinated against COVID or request and receive approval for a reasonable accommodation, including medical or religious accommodation.
Job ID: TW6967
Tags: Airflow APIs AWS Big Data CI/CD Computer Science Distributed Systems Elasticsearch Engineering Kafka Kinesis Machine Learning Mathematics ML models Open Source Python Spark Streaming
Perks/benefits: Career development Fitness / gym Flex hours Flex vacation Health care Insurance Lunch / meals Medical leave Parental leave Salary bonus Signing bonus Snacks / Drinks Team events Wellness
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open MLOps Engineer jobs
- Open Data Science Manager jobs
- Open Lead Data Analyst jobs
- Open Data Manager jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Engineer II jobs
- Open Power BI Developer jobs
- Open Sr Data Engineer jobs
- Open Principal Data Engineer jobs
- Open Business Intelligence Developer jobs
- Open Data Analytics Engineer jobs
- Open Junior Data Scientist jobs
- Open Product Data Analyst jobs
- Open Data Scientist II jobs
- Open Sr. Data Scientist jobs
- Open Senior Data Architect jobs
- Open Business Data Analyst jobs
- Open Data Analyst Intern jobs
- Open Big Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Data Product Manager jobs
- Open Junior Data Engineer jobs
- Open Data Quality Analyst jobs
- Open Azure Data Engineer jobs
- Open Principal Data Scientist jobs
- Open GCP-related jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open Java-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Data visualization-related jobs
- Open Finance-related jobs
- Open Deep Learning-related jobs
- Open PhD-related jobs
- Open APIs-related jobs
- Open TensorFlow-related jobs
- Open PyTorch-related jobs
- Open NLP-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open CI/CD-related jobs
- Open LLMs-related jobs
- Open Kubernetes-related jobs
- Open Generative AI-related jobs
- Open Data governance-related jobs
- Open Hadoop-related jobs
- Open Airflow-related jobs
- Open Docker-related jobs