Data Engineer - Consumables Category Productivity
Bengaluru, Karnataka, IND
Amazon.com
Free shipping on millions of items. Get the best of Shopping and Entertainment with Prime. Enjoy low prices and great deals on the largest selection of everyday essentials and other products, including fashion, home, beauty, electronics, Alexa...Amazon Retail Consumables Analytics & Data Engineering (CADE) team is looking for an experienced and technically skilled Data Engineer.
This role will be supporting the data engineering initiatives of Retail Consumables Category Productivity (CCP) ) divisions of consumables business as the primary business stakeholder. Consumables is one of the pillars of amazon core retail and fastest growing business. As a DE in this team, you will be responsible for developing the data architecture components and big data solutions that scale for the ever-evolving data needs. You will be instrumental in applying AWS data engineering service and tools offerings to solve challenging problems in big data processing, data warehouse design, and enabling self-service.
As a Data Engineer on the team you will focus on automation and optimization for all areas of DW/ETL maintenance and deployment. You will work closely with the the data analytics and science teams, other business stakeholders and software engineering teams across the business to align the Data Engineering roadmaps and to solve many unique business problems. You will use creative problem solving to deliver actionable output in data gathering, transformation, ingestion and storage. As a senior engineer, you will mentor junior data engineers, identify and solve issues with the current design, scaling and storage solutions and continuously look around corners to raise the bar on data capabilities to meet the current and future data needs of the business. You will be a key contributor in the design and development of scalable architectural components and solve challenging data problems by applying both in-house and AWS services and tools.
A qualified candidate must have demonstrated ability to manage large-scale data modeling projects, identify requirements and tools, and build scalable data warehousing solution and manage AWS resources. If you love solving challenging problems and like to move fast in a growing and changing environment, this role is right fit for you. We use data to guide our decisions and we always push the technology and process boundaries of what is feasible on behalf of our customers. The most successful members of our team are obsessed with helping our customers in creative ways, bring clarity to ambiguity through data driven experimentation, drive process improvements by automations, learn and adopt new technologies and think big to build solutions extensible enough to handle existing and upcoming use cases.
Key job responsibilities
Key job responsibilities
· Collaborate with Data Science and Analytics teams in the org in identifying the business requirements
· Design and develop the data architecture and influence the Data Engineering roadmap of the supporting businesses
· Design and development of data models and data pipelines according to the business needs
· Establish and drive data engineering best practices and set standards.
· Evaluate end-to-end data designs for strengths and weaknesses of the data systems (data quality, scalability, latency, security, performance, data integrity, etc.)
· Establish and clearly communicate organizational vision, goals and success measures to business stakeholders
· Develop and mentor a team of high-performance junior data engineers
· Report on status of development, quality, operations, and system performance to leadership and business stakeholders
Basic Qualifications
· Design, implement and operate large-scale, multi-tiered ,high-volume, high-performance data solutions supporting Analytics, reporting and Machine Learning
· Gather business and functional requirements and translate them to robust, scalable, and flexible data solutions
· Implement data ingestion routines from a wide variety of data sources using best practices in data modeling, ETL/ELT processes by leveraging SQL and AWS technologies and big data tools.
· Develop data pipelines to support data analytics, machine learning model training and other offline, batch workflows.
· Help continually improve existing DW architecture, reporting and analysis processes, automate or simplify self-service modeling and production support for customers.
· Perform code and design reviews of the work of other data and BI Engineers, including feedback on architecture and design issues, as well as integration, performance and scalability
Preferred Qualifications
· Experience working with AWS big data technologies like Redshift, EMR, Athena, glue· Knowledge of software engineering best practices across the development lifecycle, including agile methodologies, coding standards, code reviews, source management, build processes, testing, and operations
· Experience providing technical leadership and mentoring other engineers for best practices on data engineering
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Athena AWS Big Data Data Analytics Data pipelines Data Warehousing ELT Engineering ETL Machine Learning Model training Pipelines Redshift Security SQL Testing
Perks/benefits: Flex hours
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Lead Data Analyst jobs
- Open MLOps Engineer jobs
- Open Data Science Manager jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Manager jobs
- Open Data Engineer II jobs
- Open Power BI Developer jobs
- Open Principal Data Engineer jobs
- Open Sr Data Engineer jobs
- Open Data Analytics Engineer jobs
- Open Business Intelligence Developer jobs
- Open Junior Data Scientist jobs
- Open Data Scientist II jobs
- Open Product Data Analyst jobs
- Open Senior Data Architect jobs
- Open Sr. Data Scientist jobs
- Open Business Data Analyst jobs
- Open Big Data Engineer jobs
- Open Data Analyst Intern jobs
- Open Manager, Data Engineering jobs
- Open Azure Data Engineer jobs
- Open Data Product Manager jobs
- Open Data Quality Analyst jobs
- Open Junior Data Engineer jobs
- Open Principal Data Scientist jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open GCP-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open Java-related jobs
- Open Privacy-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open APIs-related jobs
- Open Deep Learning-related jobs
- Open PyTorch-related jobs
- Open TensorFlow-related jobs
- Open PhD-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open NLP-related jobs
- Open CI/CD-related jobs
- Open Kubernetes-related jobs
- Open Data governance-related jobs
- Open Airflow-related jobs
- Open Hadoop-related jobs
- Open LLMs-related jobs
- Open Generative AI-related jobs
- Open Databricks-related jobs