Research Scientist, 3D Computer Vision & Machine Learning (PhD)

The Meta Reality Labs Research Team brings together a world-class team of researchers, developers, and engineers to create the future of AR and VR. The Surreal Vision group at FRL Research is seeking exceptional Research Scientists to research and help build the egocentric machine perception functionalities for VR and contextual-AI-enabled AR devices. We do this by developing - and leveraging - Project Aria. This role focuses on researching and formulating a new generation of end-to-end, real-time, egocentric methods and models for identifying objects the wearer interacts with and why, as well as building 3D maps of relevant objects around them; using 3D computer vision and state of the art ML and genAI methods .Research Scientist, 3D Computer Vision & Machine Learning (PhD) Responsibilities

• Lead, collaborate, and execute on research that pushes forward the state of the art in 3D computer vision, multimodal reasoning and generative approaches.
• Directly contribute to experiments, including designing experimental details, writing reusable code, running evaluations, and organizing results.
• Work with the team to help design, setup, and run practical experiments and prototype systems related to large-scale, long-duration sensing and machine reasoning.
• Contribute to publications and open-sourcing efforts.
• Help identify long-term ambitious research goals as well as intermediate milestones.
• Mentor other team members. Play a significant role in healthy cross-functional collaboration.

Minimum Qualifications

• Experience communicating research for public audiences of peers.
• Experience with real world system building and data collection, including design, coding (C++) and evaluation (C++/Python), including experience with modern ML methods and algorithms.
• Hands-on experience implementing 3D computer vision algorithms and training/evaluating ML and AI models.
• Currently has or is in the process of obtaining a PhD in the field of Computer Vision, Computer Science, Mathematics, a related field, or equivalent practical experience. Degree must be completed prior to joining Meta.
• Must obtain work authorization in the country of employment at the time of hire, and maintain ongoing work authorization during employment.
• Experience in developing and debugging in C/C++, Python, or C#.
• Research experience in 3D ML and AI research, specifically around Object Tracking / Detection / Segmentation, 3D semantic scene understanding, or generative 3D scene modeling.

Preferred Qualifications

• Experience working in a Unix environment.
• Demonstrated research and software engineering experience via an internship, work experience, coding competitions, or widely used contributions in open source repositories (e.g. GitHub).
• Experience solving complex problems and comparing alternative solutions, tradeoffs, and diverse points of view to determine a path forward.
• Experience working and communicating cross functionally in a team environment.
• Proven track record of achieving significant results as demonstrated by grants, fellowships, patents, as well as publications at leading workshops, journals or conferences such as CVPR, NeurIPS, ECCV, ICCV, IROS, ICRA, or similar.

LocationsAbout Meta Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today—beyond the constraints of screens, the limits of distance, and even the rules of physics. Meta is committed to providing reasonable support (called accommodations) in our recruiting processes for candidates with disabilities, long term conditions, mental health conditions or sincerely held religious beliefs, or who are neurodivergent or require pregnancy-related support. If you need support, please reach out to accommodations-ext@fb.com.