Software Engineer (Technical Leadership)
Bellevue, WA | Menlo Park, CA
The Co-design team work includes direct contributions to LLama, DLRM, and other open-source projects such as PyTorch FSDP and PyTorch2 compiler as well as the recently announced MTIA accelerator platform.
The team is seeking full-time research scientists and software engineers in Computer Science, specifically with experience in architecture, HPC, and AI/ML systems such as:
GPU/ASIC architecture
GPU/ASIC-based ML kernel development and optimization (e.g. CUDA, ROCm)
CPU-based threading models for x86 and ARM (e.g., OpenMP, Pthreads)
HPC communication libraries (e.g., NCCL, RCCL, UCC, MPI)
Numerics libraries (e.g., low precision arithmetic, quantizations, mixed precision ops)
High performance computing (HPC)
Distributed systems for hyperscale large language model (LLM) training and serving
ML compiler and ML distributed technologiesSoftware Engineer (Technical Leadership) Responsibilities
- Drive the organization’s goal towards relevant machine learning techniques to build & optimize our intelligent systems that improve Meta’s products and experiences
- Effectively communicate complex features and systems in detail while advocating for higher product quality and engineering efficiency
- Assist in goal setting related to project impact, AI system design, and ML excellence
- Develop custom/novel architectures, define use cases, and develop methodology & benchmarks to evaluate different approaches
- Apply in depth knowledge of how the machine learning system interacts with the other systems around it
- Understand industry and Meta wide technology trends in computing technology to help assess & develop new technologies within the ML Systems roadmap
- Drive the team's goals and technical direction to pursue opportunities that make your larger organization more efficient
- Partner & collaborate with organizational leaders to help improve the level of performance of the team & organization
- Vast experience communicating and working across functions to drive solutions
- Experience in driving large cross-functional/industry-wide engineering efforts
- Proven track record of planning multi-year roadmap in which shorter-term projects ladder to the long term-vision
- Experience leading projects with industry-wide impact
- Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
- Significant experience in mentoring/influencing senior engineers across organizations
- Specialized experience in one or more of the following machine learning/deep learning domains: ML systems: AI infrastructure, machine learning accelerators, high performance computing, machine learning compilers, GPU architecture, machine learning frameworks, on-device optimization
- Experience developing AI algorithms or AI-System infrastructure in C/C++ or Python
- Experience with distributed systems or on-device algorithm development
Individual compensation is determined by skills, qualifications, experience, and location. Compensation details listed in this posting reflect the base hourly rate, monthly rate, or annual salary only, and do not include bonus, equity or sales incentives, if applicable. In addition to base compensation, Meta offers benefits. Learn more about benefits at Meta.
Tags: Architecture Computer Science CUDA Deep Learning Distributed Systems Engineering FSDP GPU HPC LLaMA LLMs Machine Learning ML infrastructure OpenMP Open Source Physics pthreads Python PyTorch Research VR
Perks/benefits: Career development Equity / stock options Health care Salary bonus
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Data Science Manager jobs
- Open Research Scientist jobs
- Open Data Engineer II jobs
- Open Principal Data Scientist jobs
- Open Business Data Analyst jobs
- Open BI Analyst jobs
- Open Data Scientist II jobs
- Open Sr Data Engineer jobs
- Open Business Intelligence Engineer jobs
- Open Lead Data Analyst jobs
- Open Sr. Data Scientist jobs
- Open Data Science Intern jobs
- Open Senior Business Intelligence Analyst jobs
- Open Software Engineer, Machine Learning jobs
- Open Junior Data Scientist jobs
- Open Azure Data Engineer jobs
- Open MLOps Engineer jobs
- Open Manager, Data Engineering jobs
- Open Data Analytics Engineer jobs
- Open Marketing Data Analyst jobs
- Open Data Engineer III jobs
- Open Junior Data Engineer jobs
- Open Data Analyst II jobs
- Open Data Engineering Manager jobs
- Open ETL Developer jobs
- Open Data quality-related jobs
- Open Tableau-related jobs
- Open Privacy-related jobs
- Open Excel-related jobs
- Open ML models-related jobs
- Open Data pipelines-related jobs
- Open APIs-related jobs
- Open PhD-related jobs
- Open PyTorch-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open LLMs-related jobs
- Open Consulting-related jobs
- Open TensorFlow-related jobs
- Open Deep Learning-related jobs
- Open Business Intelligence-related jobs
- Open Generative AI-related jobs
- Open CI/CD-related jobs
- Open NLP-related jobs
- Open Data governance-related jobs
- Open DevOps-related jobs
- Open Kubernetes-related jobs
- Open Git-related jobs
- Open Hadoop-related jobs
- Open Docker-related jobs