Research Engineer - Systems ML (Compiler), Live Telepresence with Codec Avatars
Pittsburgh, PA
You will be working on designing runtime libraries for state-of-the-art CV/ML/DL algorithms and large foundation models against different compute hardware with high energy efficiency and throughput, standardizing accelerated operators/modules into edge compiler and runtime engine, and creating a unified compilation flow to accelerate telepresence deployment on the current & next generation of ARVR hardware platforms. You will work closely with AI and telepresence researchers to analyze algorithms (which are mixed operators of computer vision, deep learning models, and graphic rendering processing) and apply codesign methodologies from the early phase for low latency and high efficiency. You will also partner with software engineering teams (e.g. Pytorch Edge) to land acceleration solutions on ARVR hardware which may also have inhouse CV/ML accelerators. You will apply software development best practices to feature design and performance tuning. You will gain valuable experience in developing product driven and industrial scale compilers and will help in driving next generation hardware software codesign for AI domain problems.Research Engineer - Systems ML (Compiler), Live Telepresence with Codec Avatars Responsibilities
- Research and implementation of parallel computing algorithms for achieving high energy efficiency on VRAR computing platforms.
- Development of native toolchain for end2end mobile telepresence pipeline to accelerate compilation and deployment on the next generation of ARVR platforms.
- Collaborate with other research teams to analyze ML and DL algorithms and co-design/customize operators and modules to maximize mobile energy efficiency.
- Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
- 3+ years practical experience on building compilers or runtime libraries for CV/ML applications on resource constrained hardwares.
- Proven C++ and Python programming skills.
- Familiar with frameworks like OpenCV, PyTorch, TensorFlow Lite, and ONNX.
- Familiar with Neon SIMD optimization and OpenCL general parallel computing.
- Solid knowledge of ARM CPU, embedded DSP, and high efficient AI accelerator architectures with proven understanding of system performance evaluations from such as end2end latency, memory bandwidth, I/O access, compute utilization analysis with necessary tooling development.
- Experience on optimizing image processing and computer vision applications for edge devices with optimizations such as vectorization, parallelization, and hardware specific SIMD and deep learning algorithms with techniques such as low bits quantization and sparse computation.
- Familiar with embedded systems, Linux OS and driver development, and basic knowledge on Android application development.
- Experience with custom compiler design that’s similar to MLIR and TVM.
- Experience with acceleration on Variational Auto-Encoder, Transformers, Graph CNN, and stable diffusion models.
- Experience with algorithms optimization for Qualcomm SoCs is a plus.
- Experience on GPU general computing with OpenGL/Vulkan is a plus.
Individual pay is determined by skills, qualifications, experience, and location. Compensation details listed in this posting reflect the base salary only, and do not include bonus, equity or sales incentives, if applicable. In addition to base salary, Meta offers benefits. Learn more about benefits at Meta.
Tags: Architecture Computer Science Computer Vision Deep Learning Diffusion models Engineering GPU Industrial Linux Machine Learning ONNX OpenCV Physics Prototyping Python PyTorch Research SIMD Stable Diffusion TensorFlow Transformers VR Vulkan
Perks/benefits: Career development Equity Flex vacation Health care Salary bonus
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Business Intelligence Engineer jobs
- Open Data Engineer II jobs
- Open Lead Data Analyst jobs
- Open Power BI Developer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Marketing Data Analyst jobs
- Open Data Science Manager jobs
- Open Junior Data Scientist jobs
- Open MLOps Engineer jobs
- Open Business Data Analyst jobs
- Open Data Scientist II jobs
- Open Product Data Analyst jobs
- Open Data Analytics Engineer jobs
- Open Business Intelligence Developer jobs
- Open Sr Data Engineer jobs
- Open Data Analyst Intern jobs
- Open Senior Data Architect jobs
- Open Principal Data Scientist jobs
- Open Sr. Data Scientist jobs
- Open Junior Data Engineer jobs
- Open Big Data Engineer jobs
- Open Data Quality Analyst jobs
- Open Manager, Data Engineering jobs
- Open Research Scientist jobs
- Open Azure Data Engineer jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open Data quality-related jobs
- Open ML models-related jobs
- Open Business Intelligence-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open PhD-related jobs
- Open Deep Learning-related jobs
- Open Data visualization-related jobs
- Open NLP-related jobs
- Open Finance-related jobs
- Open PyTorch-related jobs
- Open TensorFlow-related jobs
- Open APIs-related jobs
- Open LLMs-related jobs
- Open Generative AI-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open CI/CD-related jobs
- Open Kubernetes-related jobs
- Open Hadoop-related jobs
- Open Data governance-related jobs
- Open Databricks-related jobs
- Open Data warehouse-related jobs