Software Development Engineer – Big Data, AWS EMR

Want to change the world with Big Data and Analytics? Come join us on the Amazon EMR Performance team in Amazon Web Services and help us build the fastest Big Data processing platform!

Amazon EMR is a web service which enables customers to run massive clusters with open-source data processing frameworks like Apache Spark, Hive, Presto, Hadoop, HBase and more, with the ability to effortlessly scale up and down as needed. We run a large number of customer clusters, enabling a variety of customer use cases including analytics and web-scale machine learning. The AWS DBS EMR organization is doing innovative work on these open source data processing frameworks with the goal of making EMR the best place to run big data workloads. A critical part of this goal is delivering top speed for EMR's big data frameworks.

The AWS EMR Performance team is looking for top engineers to help in our mission to provide the world’s fastest cloud Big Data processing platform. As an engineer on the EMR Performance team, you will work backwards from the requirements of the savviest customers in the business, including investigation of specific customer job performance profiles to propose experimental improvements. Working from these requirements, you will propose, design, and implement cutting-edge performance improvements to large scale systems impacting all EMR customers. You will have the chance to work directly with the open source community and make code changes directly to open-source codebases such as Spark and Presto.

To be successful, you need to not only be a top software developer with excellent programming skills, an understanding of distributed systems and parallel data processing, and a stellar record of delivery but also excel at leadership and customer obsession and have a real passion for massive-scale computing. If you want to truly test your mettle against the hardest challenges in distributed systems to build solutions for large scale problems in a wide variety of domains, come join our group.

Your responsibilities will include:
· Designing and building the next-generation technologies ensuring that EMR is the best environment for running large-scale data processing workloads.
· Working on complex problems in distributed systems and query engines.
· Translation of complex functional and technical requirements into detailed architecture and design.
· Deliver systems and features with top-notch quality, on time.
· Own the software development process end-to-end, including: working with engineers and product managers to develop requirements; designing, architecting, planning, implementing, and testing new systems and features; deploying, and operating the production EMR systems.

By joining our team, you will get to collaborate with some of the best and brightest minds in the industry and work on cutting-edge software and systems. You'll enjoy a competitive salary, great benefits, a creative and agile work environment, and the exciting opportunity to be part of a fast-paced and growing team and one of the most innovative technology companies - but most of all, you will get the satisfaction of making products that millions use everyday to great effect!


Inclusive Team Culture
Here at AWS, we embrace our differences. We are committed to furthering our culture of inclusion. We have ten employee-led affinity groups, reaching 40,000 employees in over 190 chapters globally. We have innovative benefit offerings, and we host annual and ongoing learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences. Amazon’s culture of inclusion is reinforced within our 14 Leadership Principles, which remind team members to seek diverse perspectives, learn and be curious, and earn trust.

Work/Life Balance
Our team puts a high value on work-life balance. It isn’t about how many hours you spend at home or at work; it’s about the flow you establish that brings energy to both parts of your life. We believe striking the right balance between your personal and professional life is critical to life-long happiness and fulfillment. We offer flexibility in working hours and encourage you to find your own balance between your work and personal lives.


Mentorship & Career Growth
Our team is dedicated to supporting new members. We have a broad mix of experience levels and tenures, and we’re building an environment that celebrates knowledge sharing and mentorship. Our senior members enjoy one-on-one mentoring and thorough, but kind, code reviews. We care about your career growth and strive to assign projects based on what will help each team member develop into a better-rounded engineer and enable them to take on more complex tasks in the future.

To learn more about EMR:

· AWS EMR: https://aws.amazon.com/emr/
· AWS Big Data Blog: https://aws.amazon.com/blogs/big-data/

EMR is growing big for solving world's Big Data problems. Please contact skoonce@amazon.com to set up an informational! If you know another great engineer who would fit perfectly, please put in a referral, or drop me a line with their contact info.

SB-SDE
AWS EMR

Basic Qualifications

· 2+ years of non-internship professional software development experience
· Programming experience with at least one modern language such as Java, C++, or C# including object-oriented design
· 1+ years of experience contributing to the architecture and design (architecture, design patterns, reliability and scaling) of new and current systems.
· Bachelor’s Degree in Computer Science or related field or equivalent work experience
· Strong knowledge of Computer Science fundamentals in object-oriented design, data structures, algorithm design, and problem solving
· Solid communication skills and ability to work well in a team

Preferred Qualifications

· 4+ years of non-internship professional software development experience
· 2+ years of experience contributing to the architecture and design (architecture, design patterns, reliability and scaling) of new and current systems
· Masters Degree in Computer Science. Preferably with emphasis on distributed systems and Big Data architectures
· Experience designing and building highly-scaled distributed systems and web services
· Experience in query processing, query engines, and/or query optimization
· Thorough understanding of parallel algorithms, concurrency, asynchronous architectures
· Experience working in an agile software development organization
· Experience building with SOA using Java on Linux
· Proficiency in high-performance, multi-threaded programming
· Knowledge of and contribution to Hadoop ecosystem
· Experience with distributed systems architecture


Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities
who would like to request an accommodation, please visit https://www.amazon.jobs/en/disability/us.