Data Engineer, SCOT IPC Simulation Platform and Analytics
US, WA, Virtual Location - Washington
Amazon.com
Free shipping on millions of items. Get the best of Shopping and Entertainment with Prime. Enjoy low prices and great deals on the largest selection of everyday essentials and other products, including fashion, home, beauty, electronics, Alexa...Are you looking for a challenge? Imagine being part of a team that owns one of the largest supply chain simulation systems in the world to predict inventory flows for the millions of items available on Amazon.com worldwide. Inventory planning involves many algorithms to buy inventory in the right quantities, at the right frequencies, from the right vendors, and assigning to the best warehouse to fulfill customer demand to optimize long term free cash flow for Amazon. Our system lives at the heart of these algorithms, keeping up with the rapid pace of optimization improvements and simulating how they interact with each other. We simulate what these systems will do for months into the future, predicting inventory flows and key operational and financial metrics across the network. This experimentation platform is critical in understanding labor needs, managing our network capacity, and allowing continued optimizations to the many algorithms we simulate. Imagine enabling Amazon's supply chain systems to make data driven decisions based on simulations of trillions of inventory events per day.
Every time an Amazon customer makes a purchase, a number of systems are involved: these systems help optimize inventory acquisition, enable a number of purchase options, ensure great pricing, store products so they are available for fast delivery, and minimize package frustration. The Supply Chain Optimization Technology (SCOT) Group develops and manages these systems. We are central to Amazon customers' ability to find what they want and get it when they want it. Within SCOT, the SimEx (Simulation and Experimentation) team is responsible for designing and executing the simulations and experiments that measure the impact of SCOT initiatives, as well as predicting inventory flows for labor planning.
The SimEx team is looking for an experienced, self-driven, analytical, and thoughtful Data Engineer. You will design and support systems that generate multi-billion dollar predictions of the highest level of visibility and importance to the highest business leaders in SCOT. In this role, you will be working in one of the world's largest and most complex data warehouse environments. You should be passionate about working with large, complex datasets and be someone who loves to bring data together in a scalable manner to answer business questions and extract meaningful business insights through collaboration with Business Intelligence Engineers (BIEs), Software Development Engineers (SDEs), and Data Scientists. You will have ownership of end-to-end development of data engineering solutions to complex questions and you’ll play an integral role in strategic decision-making.
As a Data Engineer in the SimEx team, you will work with AWS technologies such as Redshift, EC2, S3, EMR, Hive, Kinesis, SNS/SQS, and you will enable the team to leverage dashboarding tools for self-service analytics and science platforms for data science.
Basic Qualifications
- 2+ years of experience analyzing and interpreting data and experience with Redshift, Oracle, NoSQL etc.
- Experience with data modeling, data warehousing, and building ETL pipelines
- Bachelor's degree in a quantitative/technical discipline such as Computer Science, Engineering, Statistics
- 1+ years of experience as a Data Engineer or in a similar role
- Knowledge of distributed systems as it pertains to data storage and computing
- Degree in Computer Science, Engineering, Mathematics, or a related field or 3+ years industry experience.
- 3+ years of experience with demonstrated strength in ETL/ELT, data modeling, data warehouse technical architecture.
- Expert-level skills in writing and optimizing SQL.
- 3+ years of hands-on experience in writing complex, highly-optimized SQL queries across large data sets.
- 2+ years of experience in scripting languages like etc.
- Experience with Big Data technologies such as Hive/Spark, AWS EMR, AWS Glue, AWS Lambda , Kinesis, Redshift.
- Experience leading and influencing the data strategy of your team or organization
Preferred Qualifications
- Master’s or Bachelor degree in Computer Science, Engineering, or related field
- Industry experience as a Data Engineer or related speciality (e.g., Software Engineer, Business Intelligence Engineer, Data Scientist) with a track record of manipulating, processing, and extracting value from large datasets.
- Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets
- Experience building data products incrementally and integrating and managing datasets from multiple sources
- Experience leading large-scale data warehousing and analytics projects, including using AWS technologies – Redshift, S3, EC2, etc.
- Knowledge of Engineering and Operational Excellence using standard methodologies.
- Ability to work on a diverse team or with a diverse range of coworkers
Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit https://www.amazon.jobs/en/disability/us.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: AWS Big Data Business Intelligence Computer Science Data strategy Data Warehousing Distributed Systems EC2 ELT Engineering ETL Kinesis Lambda Mathematics NoSQL Oracle Pipelines Redshift Spark SQL Statistics
Perks/benefits: Team events
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Marketing Data Analyst jobs
- Open MLOps Engineer jobs
- Open AI Engineer jobs
- Open Data Engineer II jobs
- Open Junior Data Scientist jobs
- Open Senior Data Architect jobs
- Open Sr Data Engineer jobs
- Open Data Analytics Engineer jobs
- Open Power BI Developer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Manager, Data Engineering jobs
- Open Principal Data Engineer jobs
- Open Product Data Analyst jobs
- Open Business Data Analyst jobs
- Open Data Manager jobs
- Open Data Quality Analyst jobs
- Open Sr. Data Scientist jobs
- Open Data Scientist II jobs
- Open Big Data Engineer jobs
- Open Business Intelligence Developer jobs
- Open Data Analyst Intern jobs
- Open Principal Data Scientist jobs
- Open ETL Developer jobs
- Open Azure Data Engineer jobs
- Open Data Product Manager jobs
- Open Business Intelligence-related jobs
- Open Data quality-related jobs
- Open Privacy-related jobs
- Open Data management-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open ML models-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open APIs-related jobs
- Open PyTorch-related jobs
- Open PhD-related jobs
- Open TensorFlow-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open NLP-related jobs
- Open Data governance-related jobs
- Open Data warehouse-related jobs
- Open Airflow-related jobs
- Open Databricks-related jobs
- Open Hadoop-related jobs
- Open LLMs-related jobs
- Open DevOps-related jobs
- Open Kubernetes-related jobs