Data Engineer II, AIR BI, Amazon AIR

Seattle, Washington, USA

Applications have closed
Amazon.com logo
Amazon.com

Posted 1 month ago

Do you want to join one of the most exciting teams at the world's most customer-centric company? Then come soar with Amazon Air! AIR BI's vision is to offer the data infrastructure, and data applications/ processes/ practices to enable the AIR business to achieve its goal to leverage its capacity, speed, quality of service, and organic infrastructure to delight Amazon customers worldwide.


As a Data Engineer II on AIR BI team, you will design, develop, implement, test, and operate large-scale, high-volume, high-performance data structures for analytics and deep learning. Implement data ingestion routines both real time and batch using best practices in data modeling, ETL/ELT processes leveraging AWS technologies and Big data tools. Gather business and functional requirements and translate these requirements into robust, scalable, operable solutions that work well within the overall data architecture. Analyze source data systems and drive best practices in source teams. Participate in the full development life cycle, end-to-end, from design, implementation and testing, to documentation, delivery, support, and maintenance. Produce comprehensive, usable dataset documentation and metadata. Evaluate and make decisions around dataset implementations designed and proposed by peer data engineers. Evaluate and make decisions around the use of new or existing software products and tools. Mentor junior data engineers.

You will be working in one of the world's largest cloud-based data lakes. You should be skilled in the architecture of data warehouse solutions for the Enterprise using multiple platforms (EMR, RDBMS, Columnar, Cloud). You should have extensive experience in the design, creation, management, and business use of large datasets. You should have excellent business and communication skills to be able to work with business owners to develop and define key business questions, and to build data sets that answer those questions. Above all you should be passionate about working with huge data sets and someone who loves to bring datasets together to answer business questions and drive change.

Basic Qualifications


· A desire to work in a collaborative, innovative, and supportive environment.
· Degree in Computer Science, Engineering, Mathematics, or a related field from an accredited university and 5+ years industry experience.
· Must have 3+ years of experience as a Data engineer.
· Developing and operating large-scale data structures for business intelligence using: ETL/ELT processes. OLAP technologies; data modeling; SQL.
· Experience with at least one relational database technology such as Redshift, Oracle, MySQL or MS SQL.
· Experience with at least one massively parallel processing data technology such as Redshift, Teradata, Netezza, Spark or Hadoop based big data solutions.




Preferred Qualifications


· 8+ years of industry experience as a Data Engineer or related specialty (e.g., Software Engineer, Business Intelligence Engineer, Data Scientist) with a track record of manipulating, processing, and extracting value from large datasets.
· Coding proficiency in at least one modern programming language (Python, Ruby, Java, etc).
· Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets.
· Experience building data products incrementally and integrating and managing datasets from multiple sources.
· Query performance tuning skills using Unix profiling tools and SQL.
· Experience leading large-scale data warehousing and analytics projects, including using AWS technologies – Redshift, S3, EC2, Data-pipeline and other big data technologies.
· Experience providing technical leadership and mentor other engineers for the best practices on the data engineering space.
· Linux/UNIX including to process large data sets.
· Experience handling real time data streams.
· Experience with AWS.
· Able to work in a diverse team.

Amazon is an Equal Opportunity-Affirmative Action Employer – Minority / Female / Disability / Veteran / Gender Identity / Sexual Orientation.

We believe passionately that employing a diverse workforce is central to our success and we make recruiting decisions based on your experience and skills. We welcome applications from all members of society irrespective of age, gender, disability, sexual orientation, race, religion or belief.

#AmazonAir


Job tags: AWS Big Data Business Intelligence Data Warehousing Deep Learning Distributed Systems Engineering ETL Hadoop Java Linux MySQL Oracle Python Redshift Ruby Spark SQL