Senior Data Engineer
Seattle, Washington, USA
Amazon.com
Free shipping on millions of items. Get the best of Shopping and Entertainment with Prime. Enjoy low prices and great deals on the largest selection of everyday essentials and other products, including fashion, home, beauty, electronics, Alexa...
Prime Video is changing the way millions of customers interact with video content. Our team delivers high-quality video to Amazon customers through subscriptions (Amazon Prime) as well as purchases and rentals. Amazon believes so deeply in the mission of Video that we've launched our own studio to create original and exclusive content. Every day we face the challenges of a fast-paced market and expanding technology set. You will have the freedom and encouragement to explore your own ideas and the reward of seeing your contributions benefit millions of Amazon.com customers worldwide.
A day in the life
As a data engineer in this team, you will take a leadership role in the data platform and you will solve big data warehousing problems on a massive scale. You will apply cloud-based AWS services to solve challenging problems around: big data processing, data warehouse design, and BI self-service. You will be part of a data engineering team that focuses on automation and optimization for all areas of DW/ETL maintenance and deployment. You will work closely with the business and technical teams in analysis on many non-standard and unique business problems and use creative problem solving to deliver actionable output. The role of data engineer in Amazon requires excellent technical skills in order to develop systems and tools to process data as well as, but not limited to, the ability to analyze data and develop reports. Your work will have a direct impact on the day-to-day decision making in the Prime Video team.
About the hiring group
Prime Videos is looking for a Data Engineer to join its core Data Engineering team. There are millions of videos watched each day by customers. The Data Engineering team presents exciting opportunities to work on very large data sets in one of the world's largest and most complex data lake and data warehouse environments. Our data warehouse is built on AWS cloud technology like EMR, S3 and Redshift for performing ETL processing on over 100+ TB of relational data in a matter of hours. Our team is serious about great design and redefining best practices with a cloud-based approach to scalability and automation.
Job responsibilities
· Develop and automate large scale, high-performance data processing systems (batch and/or streaming) using cloud based technologies
· Build scalable data pipelines leveraging S3, Lambda, Kinesis, AWS Glue
· Design data models for optimal storage and retrieval. Work closely with the business and technical teams in analysis on many non-standard and unique business problems and use creative problem solving to deliver actionable output
· Contribute to shared Data Engineering tooling & standards to improve the productivity and quality of output for Data Engineers across org
· Improve data quality by using & improving internal tools to automatically detect issues
Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit https://www.amazon.jobs/en/disability/us.
· 5+ years of experience as a Data Engineer or in a similar role
· Experience with data modeling, data warehousing, and building ETL pipelines
· Experience in SQL
· Experience with hardware provisioning, forecasting hardware usage, and managing to a budget
· Strong interpersonal skills and the ability to communicate complex technology solutions to senior leadership, gain alignment, and drive progress
A day in the life
As a data engineer in this team, you will take a leadership role in the data platform and you will solve big data warehousing problems on a massive scale. You will apply cloud-based AWS services to solve challenging problems around: big data processing, data warehouse design, and BI self-service. You will be part of a data engineering team that focuses on automation and optimization for all areas of DW/ETL maintenance and deployment. You will work closely with the business and technical teams in analysis on many non-standard and unique business problems and use creative problem solving to deliver actionable output. The role of data engineer in Amazon requires excellent technical skills in order to develop systems and tools to process data as well as, but not limited to, the ability to analyze data and develop reports. Your work will have a direct impact on the day-to-day decision making in the Prime Video team.
About the hiring group
Prime Videos is looking for a Data Engineer to join its core Data Engineering team. There are millions of videos watched each day by customers. The Data Engineering team presents exciting opportunities to work on very large data sets in one of the world's largest and most complex data lake and data warehouse environments. Our data warehouse is built on AWS cloud technology like EMR, S3 and Redshift for performing ETL processing on over 100+ TB of relational data in a matter of hours. Our team is serious about great design and redefining best practices with a cloud-based approach to scalability and automation.
Job responsibilities
· Develop and automate large scale, high-performance data processing systems (batch and/or streaming) using cloud based technologies
· Build scalable data pipelines leveraging S3, Lambda, Kinesis, AWS Glue
· Design data models for optimal storage and retrieval. Work closely with the business and technical teams in analysis on many non-standard and unique business problems and use creative problem solving to deliver actionable output
· Contribute to shared Data Engineering tooling & standards to improve the productivity and quality of output for Data Engineers across org
· Improve data quality by using & improving internal tools to automatically detect issues
Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit https://www.amazon.jobs/en/disability/us.
Basic Qualifications
· 5+ years of experience as a Data Engineer or in a similar role
· Experience with data modeling, data warehousing, and building ETL pipelines
· Experience in SQL
Preferred Qualifications
· 7+ years of industry experience as a Data Engineer or related specialty (e.g., Software Engineer, Business Intelligence Engineer, Data Scientist) with a track record of manipulating, processing, and extracting value from large datasets.· Experience with hardware provisioning, forecasting hardware usage, and managing to a budget
· Strong interpersonal skills and the ability to communicate complex technology solutions to senior leadership, gain alignment, and drive progress
Tags: AWS Big Data Business Intelligence Data pipelines Data Warehousing Engineering ETL Kinesis Lambda Pipelines Redshift SQL Streaming
Region:
North America
Country:
United States
Job stats:
3
0
0
Category:
Engineering Jobs
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open MLOps Engineer jobs
- Open Data Science Manager jobs
- Open Lead Data Analyst jobs
- Open Data Manager jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Engineer II jobs
- Open Power BI Developer jobs
- Open Sr Data Engineer jobs
- Open Principal Data Engineer jobs
- Open Business Intelligence Developer jobs
- Open Junior Data Scientist jobs
- Open Data Analytics Engineer jobs
- Open Product Data Analyst jobs
- Open Data Scientist II jobs
- Open Sr. Data Scientist jobs
- Open Senior Data Architect jobs
- Open Business Data Analyst jobs
- Open Data Analyst Intern jobs
- Open Big Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Azure Data Engineer jobs
- Open Junior Data Engineer jobs
- Open Data Product Manager jobs
- Open Data Quality Analyst jobs
- Open Principal Data Scientist jobs
- Open GCP-related jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open Java-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open PhD-related jobs
- Open APIs-related jobs
- Open TensorFlow-related jobs
- Open PyTorch-related jobs
- Open NLP-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open CI/CD-related jobs
- Open LLMs-related jobs
- Open Kubernetes-related jobs
- Open Generative AI-related jobs
- Open Data governance-related jobs
- Open Hadoop-related jobs
- Open Airflow-related jobs
- Open Docker-related jobs