Senior Big Data Engineer
Remote (Anywhere US)
Applications have closed
Mission
Mission Cloud provides companies that rely on AWS with a comprehensive suite of managed cloud services, consulting, and software that simplify the adoption and management of their AWS workloads.This position is 100% remote.
Responsibilities
- Under the supervision of Big Data Consultants and Architects, work with multiple clients simultaneously to implement enterprise-wide scalable operations on AWS
- Validate technical plans and time estimates for customers with Big Data Consultants and architects
- Complete assigned roadmap tasks and quality check work done by Big Data Engineers
- Build ETL code following defined requirements and mapping documents
- Build SQL queries using MongoDB, Oracle, SQL Server, MariaDB, MySQL, Redshift, Athena
- Develop code using Python, Scala, PySpark
- Work with technologies such as Spark, Hadoop, Kafka, etc.
- Implement assigned roadmap activities; record time spent and work completed accurately in Jira and Mavenlink
- Update Jira with detailed descriptions of work performed and participate in daily scrum meetings
- Collaborate with other data engineers for interchange of technical ideas
- Establish credibility and build impactful relationships with our customers to enable them to be cloud advocates
- Comply with AWS Industry best practices and Mission Cloud Services standards
- Configure AWS services to support ETL, data warehousing and potentially machine learning
- Write infrastructure as code scripts in CDK or Terraform to help make service deployment more efficient and consistent
- Create data visualizations and reports from the data that has been extracted, transformed and loaded with tool such as Amazon Quicksight
- Lead small teams to implement parts of customer projects
- Demonstrate expertise within one of the big data expertise like ETL techniques, database infrastructure, or visualizations
- Configure AWS services to support ETL, data warehousing and potentially machine learning
- Write infrastructure as code scripts in CDK or Terraform to help make service deployment more efficient and consistent
Requirements
- 4+ years design & implementation experience with distributed applications
- 4+ years of experience in database architectures and data pipeline development
- 2+ years working with Loading, extracting data from Glue, SQL, DDL, DML commands
- Experience handling unstructured, semi-structured data, working in a data lake environment
- Data streaming and developing data pipelines driven by events/queues a plus
- Experience with software development tools and methodologies
- Experience working in an Agile environment
- Presentation skills with a high degree of comfort speaking with IT management, and developers
- AWS Data Analytics Specialty Certification (required within 6 months of hire)
Perks & Benefits
- Medical, dental, and vision insurance for employees and their dependents with options for 100% company paid premiums
- 401(k) plan with company matching
- Profit sharing bonuses based on performance
- Flexible Spending Accounts (Health and Dependent Care)
- Life insurance paid by Mission
- Paid time off (Unlimited FlexPTO, parental leave, volunteering time off)
- Inclusive work environment with several Employee Resource Groups
- Fully distributed team with flexible work hours
- Home office furniture & equipment expenses
- Flex stipend for use on cell phone, home internet, wellness, etc. It’s up to you!
- An internal department dedicated to helping team members on their career path
We are committed to diversity and inclusion. We value every individual’s unique story, experience, and perspective. We aim to amplify the voices of our team members and our community to create a safe, empathetic, and inclusive environment where everyone can contribute one’s authentic self.
Mission is an Equal Opportunity Employer and participant in the U.S. Federal E-Verify program. Mission will consider qualified applicants with criminal histories in a manner consistent with The Los Angeles Fair Chance Initiative for Hiring Ordinance.
About Mission Cloud Services
Mission is an Amazon Web Services (AWS) Premier Consulting Partner and MSP. Clients depend on us to expertly and securely architect, migrate, manage, and optimize their cloud environments.
Mission’s team of AWS Certified Solutions Architects and DevOps Engineers are ready to help you harness the full power of the AWS cloud to transform your business and operations.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Architecture Athena AWS Big Data Consulting Data Analytics Data pipelines Data Warehousing DDL DevOps ETL Hadoop Jira Kafka Machine Learning MariaDB MLOps MongoDB MySQL Oracle Pipelines PySpark Python QuickSight Redshift Scala Scrum Spark SQL Streaming Terraform
Perks/benefits: Career development Cell phone stipend Flex hours Flex vacation Health care Home office stipend Medical leave Parental leave Salary bonus Team events Unlimited paid time off Wellness
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Marketing Data Analyst jobs
- Open MLOps Engineer jobs
- Open AI Engineer jobs
- Open Senior Data Architect jobs
- Open Junior Data Scientist jobs
- Open Data Engineer II jobs
- Open Sr Data Engineer jobs
- Open Data Analytics Engineer jobs
- Open Power BI Developer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Principal Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Product Data Analyst jobs
- Open Business Data Analyst jobs
- Open Data Manager jobs
- Open Data Quality Analyst jobs
- Open Sr. Data Scientist jobs
- Open Data Scientist II jobs
- Open Big Data Engineer jobs
- Open Business Intelligence Developer jobs
- Open Data Analyst Intern jobs
- Open Principal Data Scientist jobs
- Open ETL Developer jobs
- Open Azure Data Engineer jobs
- Open Data Product Manager jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open Privacy-related jobs
- Open Data management-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open ML models-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open APIs-related jobs
- Open PyTorch-related jobs
- Open PhD-related jobs
- Open TensorFlow-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open NLP-related jobs
- Open Data governance-related jobs
- Open Data warehouse-related jobs
- Open Airflow-related jobs
- Open Databricks-related jobs
- Open Hadoop-related jobs
- Open LLMs-related jobs
- Open DevOps-related jobs
- Open Kubernetes-related jobs