Research Scientist, Generalist Embodied Agent Research - New College Grad 2024
US, CA, Santa Clara
NVIDIA
NVIDIA erfindet den Grafikprozessor und fördert Fortschritte in den Bereichen KI, HPC, Gaming, kreatives Design, autonome Fahrzeuge und Robotik.NVIDIA is searching for an outstanding research scientist to build humanoid robot foundation models and systems in the Generalist Embodied Agent Research (GEAR) group. Everything that moves will eventually be autonomous. Our mission is to build general-purpose embodied agents that learn to explore and master complex skills across the virtual and the physical world.
You will work with an amazing and collaborative research team that consistently produces influential works on multimodal foundation models, large-scale robot learning, game AI, and physical simulation. Our past projects include Eureka, VIMA, Voyager, MineDojo, MimicPlay, Prismer, and more. One of our team’s most recent milestones includes Project GR00T, a foundation model for humanoid robots. Your contributions will have a significant impact on our moonshot research projects and product roadmaps.
What you'll be doing:
Design and implement novel AI algorithms and models for general-purpose humanoid robots and embodied agents;
Develop large-scale AI training and inference methods for foundation models;
Optimize and deploy AI models in physical simulation and on robot hardware;
Collaborate with research and engineering teams across all of NVIDIA to transfer research to products and services.
What we need to see:
Ph.D. in Computer Science/Engineering, Electrical Engineering, etc., or equivalent research experience.
Outstanding engineering skills in rapid prototyping and model training frameworks (PyTorch, Jax, Tensorflow, etc.). Python or C++ is required; CUDA or ROS proficiencies are a plus;
Excellent knowledge and hands-on experience for training LLMs, multimodal foundation models, or large generative models.
Experience in foundation and diffusion models, reinforcement learning, agent learning, and applied robotics
Experience across one or both of these fields:
Multimodal Foundation Models
Hands-on training experience and publications in at least one of the following topics: LLMs; Large vision-language models; Video generative models and diffusion algorithms; Action-based transformers.
Excellent skills in working with large-scale machine learning/AI systems and compute infrastructure.
Robotics
Hands-on training experience and publications in robot learning, such as reinforcement learning, imitation learning, classical control methods, etc.
Deep understanding of robot kinematics, dynamics, and sensors;
Ability to safely operate robot hardware, lab equipment, and tools;
Knowledge of control methods, including PID, model predictive control, and whole-body control;
Familiarity with physics simulation frameworks such as MuJoCo and Isaac Sim;
Robot hardware design and hands-on building experience.
NVIDIA is widely considered to be one of the technology world's most desirable employers. We have some of the most forward-thinking and productive people in the world. Please join us and be part of the forefront of developing general-purpose robots and embodied agents!
The base salary range is 160,000 USD - 253,000 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.
NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.Tags: Computer Science CUDA Diffusion models Engineering Generative modeling JAX LLMs Machine Learning Model training Physics Prototyping Python PyTorch Reinforcement Learning Research Robotics TensorFlow Transformers
Perks/benefits: Career development Equity / stock options
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Research Scientist jobs
- Open Data Engineer II jobs
- Open BI Analyst jobs
- Open Data Science Manager jobs
- Open Data Scientist II jobs
- Open Principal Data Scientist jobs
- Open Business Data Analyst jobs
- Open Senior Business Intelligence Analyst jobs
- Open Business Intelligence Engineer jobs
- Open Sr Data Engineer jobs
- Open Data Science Intern jobs
- Open Lead Data Analyst jobs
- Open Sr. Data Scientist jobs
- Open Junior Data Scientist jobs
- Open Data Engineer III jobs
- Open MLOps Engineer jobs
- Open Manager, Data Engineering jobs
- Open Azure Data Engineer jobs
- Open Software Engineer, Machine Learning jobs
- Open Marketing Data Analyst jobs
- Open Data Analytics Engineer jobs
- Open Data Analyst II jobs
- Open Product Data Analyst jobs
- Open ETL Developer jobs
- Open Data Quality Analyst jobs
- Open Data quality-related jobs
- Open Data management-related jobs
- Open GCP-related jobs
- Open Privacy-related jobs
- Open Data pipelines-related jobs
- Open ML models-related jobs
- Open PhD-related jobs
- Open Business Intelligence-related jobs
- Open APIs-related jobs
- Open Data visualization-related jobs
- Open PyTorch-related jobs
- Open Finance-related jobs
- Open LLMs-related jobs
- Open TensorFlow-related jobs
- Open Consulting-related jobs
- Open Deep Learning-related jobs
- Open Generative AI-related jobs
- Open Data governance-related jobs
- Open NLP-related jobs
- Open CI/CD-related jobs
- Open DevOps-related jobs
- Open Kubernetes-related jobs
- Open Snowflake-related jobs
- Open Hadoop-related jobs
- Open Git-related jobs