DevOps Engineer (Big Data Platform), Enterprise Systems
Sunnyvale, California, United States
Apple
We’re a diverse collective of thinkers and doers, continually reimagining what’s possible to help us all do what we love in new ways.Summary
Posted: Apr 25, 2024Role Number:200515456
Apple’s Applied Machine Learning team has built platforms for a number of large-scale data science applications. We work on many high-impact projects that serve various Apple lines of business. We use the latest in open source technology and as committers on some of these projects, we are pushing the envelope. Working with multiple lines of business, we manage many streams of Apple-scale data. We bring it all together and extract the value. We do all this with an exceptional group of software engineers, data scientists, SRE/DevOps engineers, and managers. We are looking for a talented and dedicated senior engineer to join our team to bring passion for infrastructure and distributed systems to build world-class data platforms/products at a very large scale across cloud environments.
Key Qualifications
- Experience architecting, building, monitoring, and operating large-scale complex data processing systems in Java/Scala like Spark, Flink, and Kafka in public clouds like AWS and GCP.
- In-depth knowledge and experience in one or more large-scale distributed technologies including but not limited to: Hadoop ecosystem, Beam, Kafka, Samza, Flink, Storm, Flume, HBase, Cassandra, Redshift, Vertica, and Spark.
- Experience in big data storage platforms and query engines with knowledge of cutting-edge technologies like Trino, Hive, Iceberg, Delta Lake, and Hudi.
- Experience with containers and container orchestration platforms such as Docker and Kubernetes.
- Strong proficiency with Helm and Kustomize for managing Kubernetes applications and configurations.
- Passionate about operational excellence through proper automation and engineering processes using programming languages Go, Python, Java, or other JVM languages
- Proficient in working with Linux or other POSIX operating systems, shell scripting, and networking technologies.
- Proficient in best practices and enforcement for data security and data governance
- Should be highly proactive with a keen focus on improving the uptime availability of our mission-critical services
- Excellent verbal and written communication skills, able to collaborate cross-functionally with program managers and engineering partners
- Comfortable working in a fast-paced environment while continuously evaluating new technologies
Description
You like to automate anything which you do and you document it for the benefit of others. You are an independent problem-solver who is self-directed and capable of exhibiting deftness to handle multiple simultaneous competing priorities and deliver solutions in a timely manner. Provide incident resolution for all technical production issues. Create and maintain accurate, up-to-date documentation reflecting configuration, and responsible for writing justifications, training users in complex topics, writing status reports, documenting procedures, and interacting with other Apple staff and management. Provide guidance to improve the stability, security, efficiency, and scalability of systems. Determine future needs for capacity and investigate new products and/or features. Strong troubleshooting ability will be used daily; will take steps on their own to isolate issues and resolve root causes through investigative analysis in environments where the candidate has little knowledge/experience/documentation. Administer and ensure the proper execution of the backup systems. Provide 24x7 on-call support to handle urgent critical issues. We are dedicated to the goal of building a culturally diverse and pluralistic team that reflects the multicultural variety of our customers.
Education & Experience
BS in computer science with 7-10 years or MS plus 5-7 years experience or related experience.
Additional Requirements
- Experience using data storage technologies such as Apache Parquet or Avro Experience in machine learning algorithms is a plus.
- Validated software engineering experience and field in design, testing, source code management, and CI/CD practices.
- Position yourself as a go-to consultative resource and solution expert for Data Engineers and analysts.
- Adaptable to prioritizing multiple issues in a high-pressure environment
- Bonus: Experience with technologies Redis, Solr
- Bonus: Design, implementation, and benchmarking of ML/deep learning algorithms
Pay & Benefits
- At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $170,700.00 and $300,200.00, and your base pay will depend on your skills, qualifications, experience, and location.
Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits.
Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.
Apple is an equal opportunity employer that is committed to inclusion and diversity. We take affirmative action to ensure equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics.
Tags: Avro AWS Big Data Cassandra CI/CD Computer Science Data governance Deep Learning DevOps Distributed Systems Docker Engineering Flink GCP Hadoop HBase Helm Java Kafka Kubernetes Linux Machine Learning Open Source Parquet Python Redshift Scala Security Shell scripting Spark Testing
Perks/benefits: Career development Health care Relocation support Salary bonus
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Lead Data Analyst jobs
- Open Data Engineer II jobs
- Open Data Science Manager jobs
- Open Marketing Data Analyst jobs
- Open Senior Business Intelligence Analyst jobs
- Open MLOps Engineer jobs
- Open Principal Data Engineer jobs
- Open Power BI Developer jobs
- Open Data Scientist II jobs
- Open Data Analytics Engineer jobs
- Open Business Intelligence Developer jobs
- Open Junior Data Scientist jobs
- Open Business Data Analyst jobs
- Open Sr Data Engineer jobs
- Open Product Data Analyst jobs
- Open Data Analyst Intern jobs
- Open Senior Data Architect jobs
- Open Sr. Data Scientist jobs
- Open Research Scientist jobs
- Open Big Data Engineer jobs
- Open Data Quality Analyst jobs
- Open Azure Data Engineer jobs
- Open Principal Data Scientist jobs
- Open Manager, Data Engineering jobs
- Open Data Product Manager jobs
- Open Data quality-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open ML models-related jobs
- Open Business Intelligence-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Deep Learning-related jobs
- Open PhD-related jobs
- Open Data visualization-related jobs
- Open Finance-related jobs
- Open PyTorch-related jobs
- Open NLP-related jobs
- Open TensorFlow-related jobs
- Open APIs-related jobs
- Open Consulting-related jobs
- Open LLMs-related jobs
- Open CI/CD-related jobs
- Open Generative AI-related jobs
- Open Snowflake-related jobs
- Open Kubernetes-related jobs
- Open Hadoop-related jobs
- Open Data governance-related jobs
- Open Airflow-related jobs
- Open Databricks-related jobs