Sr. Software Development Engineer - Big Data Technologies, Big Data Technologies
Sunnyvale, California, USA
Amazon.com
Free shipping on millions of items. Get the best of Shopping and Entertainment with Prime. Enjoy low prices and great deals on the largest selection of everyday essentials and other products, including fashion, home, beauty, electronics, Alexa...
Job summary
Amazon is big and very data driven. Interested in building the next generation analytics platform to make this easy at an Amazon scale?
Amazon's BDT organization built a new data lake marketplace allowing for data producers and consumers to easily and securely share large volumes of data, run massively parallel analytics and share the gained insights.
As part of the BDT organization, we own the core services of the data lake that includes cataloging, storage, access, compliance and quality.
For the next 3 - 5 years we are working towards federating our data Lake with Native AWS for consumers and producers, allowing them to use AWS analytical tools like Athena, Quicksight, Spectrum, Redshift, etc. natively with our Datalake; and regionalizing our service stack on the way. We’re looking for skilled engineers to build the federation points, and regionalization layers from the ground up.
This is a hands-on position where you will be scoping the problem spaces, identifying areas of opportunity, creating the architecture, designing and building highly scalable components and cutting-edge features, mentor other engineers and work with our business partners, data engineers and analysts to help them get the best results. You will have support of principle and senior principle engineers when you need. You need to not only be a top software developer with excellent programming skills with a stellar record of delivery but also show bias for customer obsession. You need to have a real passion for very large scale databases and massively parallel computing. You will work with the latest AWS technologies in the big data space such as S3, EMR, Glue, Redshift and Athena to build new applications that leverage these technologies and open source frameworks like Apache Spark, Hive, Presto and Flink.
Your responsibilities will include:
https://aws.amazon.com/solutions/case-studies/amazon-migration-analytics/
https://aws.amazon.com/solutions/case-studies/amazon-database-migration/
Come help us build for the future of data analytics!
We are an equal opportunity employer and value diversity at our company.
We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.
Key job responsibilities
A day in the life
* Identifying areas of opportunity and contributing to org Strategy on 3-5 year vision.
* Scope out problem space and disambiguate technical goals.
* Design for Cross cutting solutions and influence partner team's technical direction
* Implement critical path that aligns with partner software in the same space.
* Mentor and lead junior engineers imparting best practices and successful deliveries
Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit https://www.amazon.jobs/en/disability/us.
Amazon is big and very data driven. Interested in building the next generation analytics platform to make this easy at an Amazon scale?
Amazon's BDT organization built a new data lake marketplace allowing for data producers and consumers to easily and securely share large volumes of data, run massively parallel analytics and share the gained insights.
As part of the BDT organization, we own the core services of the data lake that includes cataloging, storage, access, compliance and quality.
For the next 3 - 5 years we are working towards federating our data Lake with Native AWS for consumers and producers, allowing them to use AWS analytical tools like Athena, Quicksight, Spectrum, Redshift, etc. natively with our Datalake; and regionalizing our service stack on the way. We’re looking for skilled engineers to build the federation points, and regionalization layers from the ground up.
This is a hands-on position where you will be scoping the problem spaces, identifying areas of opportunity, creating the architecture, designing and building highly scalable components and cutting-edge features, mentor other engineers and work with our business partners, data engineers and analysts to help them get the best results. You will have support of principle and senior principle engineers when you need. You need to not only be a top software developer with excellent programming skills with a stellar record of delivery but also show bias for customer obsession. You need to have a real passion for very large scale databases and massively parallel computing. You will work with the latest AWS technologies in the big data space such as S3, EMR, Glue, Redshift and Athena to build new applications that leverage these technologies and open source frameworks like Apache Spark, Hive, Presto and Flink.
Your responsibilities will include:
- Keeping your finger on the pulse of the constantly evolving and growing big data field
- Working backwards from the customer translation complex functional and technical requirements into detailed architecture and design.
- Delivering systems and features with high quality, on time
- Stay current on technical knowledge to keep pace with rapidly changing technology, and work with the team in bringing new technologies on board
- Mentor of junior engineers
- Work across teams to drive overall technical strategy
https://aws.amazon.com/solutions/case-studies/amazon-migration-analytics/
https://aws.amazon.com/solutions/case-studies/amazon-database-migration/
Come help us build for the future of data analytics!
We are an equal opportunity employer and value diversity at our company.
We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.
Key job responsibilities
A day in the life
* Identifying areas of opportunity and contributing to org Strategy on 3-5 year vision.
* Scope out problem space and disambiguate technical goals.
* Design for Cross cutting solutions and influence partner team's technical direction
* Implement critical path that aligns with partner software in the same space.
* Mentor and lead junior engineers imparting best practices and successful deliveries
Basic Qualifications
- 4+ years of professional software development experience
- 3+ years of programming experience with at least one software programming language
- 2+ years of experience contributing to the system design or architecture (architecture, design patterns, reliability and scaling) of new and current systems
- Experience as a mentor, tech lead OR leading an engineering team
- Java or C++, Linux/Unix, Perl and UNIX tools
- Strong customer focus
- Deep understanding of software development in a team, and a track record of shipping great software on time in a fast paced environment.
- Experience defining mathematical models to address optimization using a fitness based approach focused on delivering solutions.
- Track record of delivering solutions that optimize against available resources to save money.
Preferred Qualifications
- Master's in Computer Science, Electrical Engineering or related field
- Experience taking a lead role in architecture, designing, and building complex software systems
- Experience in communicating with customers, technical, business teams and management to collect requirements, describe product features, and technical designs.
- Experience working with AWS technologies like Dynamo DB, Redshift, S3, Cloudwatch, APIG, Fargate.
- Experience working with big data tools such as Apache Beam, Apache Flink, or Apache Spark, Hive/Presto
- Experience with ETL (Extract Transform Load), Data Warehousing systems, and Big Data technologies
- Experience with Linux, UNIX, UNIX tools
- Experience with large scale systems
- Ability to excel in a fast-paced, startup-like environment
- Experience mentoring Junior Engineers.
- Strong verbal and written communication skills
Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit https://www.amazon.jobs/en/disability/us.
Tags: Architecture Athena AWS Big Data Computer Science Data Analytics Data Warehousing Engineering ETL Excel Flink Linux Open Source Perl QuickSight Redshift Spark
Perks/benefits: Startup environment
Region:
North America
Country:
United States
Job stats:
2
0
0
Categories:
Big Data Jobs
Engineering Jobs
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Marketing Data Analyst jobs
- Open MLOps Engineer jobs
- Open Junior Data Scientist jobs
- Open AI Engineer jobs
- Open Data Engineer II jobs
- Open Senior Data Architect jobs
- Open Power BI Developer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Analytics Engineer jobs
- Open Sr Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Principal Data Engineer jobs
- Open Business Data Analyst jobs
- Open Product Data Analyst jobs
- Open Data Quality Analyst jobs
- Open Data Manager jobs
- Open Sr. Data Scientist jobs
- Open Big Data Engineer jobs
- Open Data Scientist II jobs
- Open Business Intelligence Developer jobs
- Open Data Analyst Intern jobs
- Open ETL Developer jobs
- Open Principal Data Scientist jobs
- Open Azure Data Engineer jobs
- Open Data Product Manager jobs
- Open Business Intelligence-related jobs
- Open Data quality-related jobs
- Open Privacy-related jobs
- Open Data management-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open ML models-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open APIs-related jobs
- Open PyTorch-related jobs
- Open PhD-related jobs
- Open Consulting-related jobs
- Open TensorFlow-related jobs
- Open Snowflake-related jobs
- Open NLP-related jobs
- Open Data governance-related jobs
- Open Data warehouse-related jobs
- Open Airflow-related jobs
- Open Hadoop-related jobs
- Open Databricks-related jobs
- Open LLMs-related jobs
- Open DevOps-related jobs
- Open CI/CD-related jobs