Sr. Software Development Engineer - Big Data Technologies, Big Data Technologies

Sunnyvale, California, USA

Applications have closed

Amazon.com

Free shipping on millions of items. Get the best of Shopping and Entertainment with Prime. Enjoy low prices and great deals on the largest selection of everyday essentials and other products, including fashion, home, beauty, electronics, Alexa...

View company page

Job summary
Amazon is big and very data driven. Interested in building the next generation analytics platform to make this easy at an Amazon scale?
Amazon's BDT organization built a new data lake marketplace allowing for data producers and consumers to easily and securely share large volumes of data, run massively parallel analytics and share the gained insights.
As part of the BDT organization, we own the core services of the data lake that includes cataloging, storage, access, compliance and quality.
For the next 3 - 5 years we are working towards federating our data Lake with Native AWS for consumers and producers, allowing them to use AWS analytical tools like Athena, Quicksight, Spectrum, Redshift, etc. natively with our Datalake; and regionalizing our service stack on the way. We’re looking for skilled engineers to build the federation points, and regionalization layers from the ground up.
This is a hands-on position where you will be scoping the problem spaces, identifying areas of opportunity, creating the architecture, designing and building highly scalable components and cutting-edge features, mentor other engineers and work with our business partners, data engineers and analysts to help them get the best results. You will have support of principle and senior principle engineers when you need. You need to not only be a top software developer with excellent programming skills with a stellar record of delivery but also show bias for customer obsession. You need to have a real passion for very large scale databases and massively parallel computing. You will work with the latest AWS technologies in the big data space such as S3, EMR, Glue, Redshift and Athena to build new applications that leverage these technologies and open source frameworks like Apache Spark, Hive, Presto and Flink.
Your responsibilities will include:
  • Keeping your finger on the pulse of the constantly evolving and growing big data field
  • Working backwards from the customer translation complex functional and technical requirements into detailed architecture and design.
  • Delivering systems and features with high quality, on time
  • Stay current on technical knowledge to keep pace with rapidly changing technology, and work with the team in bringing new technologies on board
  • Mentor of junior engineers
  • Work across teams to drive overall technical strategy
To get a better idea on the work we have done read the following use case stories:
https://aws.amazon.com/solutions/case-studies/amazon-migration-analytics/
https://aws.amazon.com/solutions/case-studies/amazon-database-migration/
Come help us build for the future of data analytics!
We are an equal opportunity employer and value diversity at our company.
We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

Key job responsibilities



A day in the life
* Identifying areas of opportunity and contributing to org Strategy on 3-5 year vision.
* Scope out problem space and disambiguate technical goals.
* Design for Cross cutting solutions and influence partner team's technical direction
* Implement critical path that aligns with partner software in the same space.
* Mentor and lead junior engineers imparting best practices and successful deliveries

Basic Qualifications


  • 4+ years of professional software development experience
  • 3+ years of programming experience with at least one software programming language
  • 2+ years of experience contributing to the system design or architecture (architecture, design patterns, reliability and scaling) of new and current systems
  • Experience as a mentor, tech lead OR leading an engineering team

  • Java or C++, Linux/Unix, Perl and UNIX tools
  • Strong customer focus
  • Deep understanding of software development in a team, and a track record of shipping great software on time in a fast paced environment.
  • Experience defining mathematical models to address optimization using a fitness based approach focused on delivering solutions.
  • Track record of delivering solutions that optimize against available resources to save money.

Preferred Qualifications

  • Master's in Computer Science, Electrical Engineering or related field
  • Experience taking a lead role in architecture, designing, and building complex software systems
  • Experience in communicating with customers, technical, business teams and management to collect requirements, describe product features, and technical designs.
  • Experience working with AWS technologies like Dynamo DB, Redshift, S3, Cloudwatch, APIG, Fargate.
  • Experience working with big data tools such as Apache Beam, Apache Flink, or Apache Spark, Hive/Presto
  • Experience with ETL (Extract Transform Load), Data Warehousing systems, and Big Data technologies
  • Experience with Linux, UNIX, UNIX tools
  • Experience with large scale systems
  • Ability to excel in a fast-paced, startup-like environment
  • Experience mentoring Junior Engineers.
  • Strong verbal and written communication skills



Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit https://www.amazon.jobs/en/disability/us.

Tags: Architecture Athena AWS Big Data Computer Science Data Analytics Data Warehousing Engineering ETL Excel Flink Linux Open Source Perl QuickSight Redshift Spark

Perks/benefits: Startup environment

Region: North America
Country: United States
Job stats:  2  0  0

More jobs like this

Explore more AI, ML, Data Science career opportunities

Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.