Data Engineer - II

Bengaluru, Karnataka, IND

Full Time logo
Apply now Apply later

Posted 1 week ago

As a data engineer are you looking for opportunity to be among software developers, machine learning scientists to build a data platform that not only caters to BI and reporting but also extends to machine learning applications?
As a data engineer in AEE, you will:
· Design, implement and support an analytical data infrastructure serving both business intelligence and machine learning applications
· Managing AWS resources including EC2,Redshift,EMR-Spark etc
· Collaborate with applied scientist to integrate and build data pipeline as necessary for building and training machine learning models in AEE
· Collaborate with Product Managers, Financial and Business analysts to recognize and help adopt best practices in reporting and analysis: data integrity, test design, analysis, validation, and documentation
· Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using SQL and AWS big data technologies
· Explore and learn the latest AWS technologies to provide new capabilities and increase efficiency
· Collaborate with other tech teams to implement advanced analytics algorithms that exploit our rich datasets for statistical analysis, prediction, clustering and machine learning
· Help continually improve ongoing reporting and analysis processes, automating or simplifying self-service support for customers

Basic Qualifications

· 3+ years of experience as a Data Engineer or in a similar role
· Experience with data modeling, data warehousing, and building ETL pipelines
· Experience in SQL
· Bachelor's degree in computer science, engineering, mathematics, or a related technical discipline
· 4+ years of industry experience in software development, data engineering, business intelligence, data science, or related field with a track record of manipulating, processing, and extracting value from large datasets
· Demonstrated strength in data modeling, ETL development, and data warehousing
· Proven experience using big data technologies (Hadoop, Hive, Hbase, Spark etc.)
· Proven experience using business intelligence reporting tools (Tableau, Business Objects, Cognos etc.)
· Knowledge of data management fundamentals and data storage principles
· Knowledge of distributed systems as it pertains to data storage and computing

Preferred Qualifications

· Proven success in communicating with users, other technical teams, and senior management to collect requirements, describe data modeling decisions and data engineering strategy
· Familiarity with statistical models and data mining algorithms
· Knowledge of software engineering best practices across the development lifecycle, including agile methodologies, coding standards, code reviews, source management, build processes, testing, and operations

Amazon is an Equal Opportunity-Affirmative Action Employer – Minority / Female / Disability / Veteran / Gender Identity / Sexual Orientation

Job tags: AWS Big Data Business Intelligence Data Mining Data Warehousing Distributed Systems Engineering ETL Hadoop Machine Learning Redshift Spark SQL Tableau