Member of Technical Staff: Research Scientist, Pre-Training
San Francisco
Essential AI’s mission is to deepen the partnership between humans and computers, unlocking collaborative capabilities that far exceed what could be achieved today. We believe that building delightful end-user experiences requires innovating across the stack - from the UX all the way down to models that achieve the best user value per FLOP.
We believe that a small, focused team of motivated individuals can create outsized breakthroughs. We are building a world-class multi-disciplinary team who are excited to solve hard real-world AI problems. We are well-capitalized and supported by March Capital and Thrive Capital, with participation from AMD, Franklin Venture Partners, Google, KB Investment, NVIDIA.
The RoleThe Research Scientist, Pre-Training will play a pivotal role in advancing our foundation models to advance the science at large and the unique challenges and requirements of our customers. You will be responsible for frontier algorithms and conducting research experiments to improve the pre-training process, with the goal of creating more capable, robust, and efficient models. You will also explore ways to scale up pre-training to larger datasets and model sizes, while maintaining efficiency and performance.
What you’ll be working onYou will lead or be a core contributor to our research bets that advance the the real-world capabilities of our models.
You will collaborate closely with our data and product teams to close the loop between research and product, identify capability gaps and evaluate progress.
Lead long-term research initiatives focused on pre-training models for enterprises. Work closely with research engineers to prototype, understand, implement and deploy novel techniques to improve the capabilities of our models.
Develop novel algorithms and methodologies for pre-training models ensuring scalability, efficiency, and effectiveness.
Design, develop, and optimize machine learning models and prototypes, ensuring high performance, scalability, and robustness.
Stay abreast of the latest advancements in pre-training techniques incorporating relevant findings into research projects and product development efforts
Research experience with a focus on pre-training and building large language models using frameworks such as Megatron, DeepSpeed, MaxText, etc.
You have strong ML fundamentals and first principles thinking that guides your approach to research.
You have experience of coming up with new methods or improving existing techniques in ML or related fields
Experience with data engineering and preprocessing, in particular, optimization of data pipelines.
Proficiency in programming languages commonly used in machine learning research such as Python
Strong problem solving, analytical, communication, and collaboration skills.
You enjoy building things from the ground up in a fast-paced, collaborative environment.
We encourage you to apply for this position even if you don’t check all of the above requirements but want to spend time pushing on these techniques.
We are based in-person in SF. We offer relocation assistance to new employees.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Data pipelines Engineering LLMs Machine Learning ML models Pipelines Python Research UX
Perks/benefits: Relocation support
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Data Science Intern jobs
- Open Data Engineer II jobs
- Open Business Intelligence Engineer jobs
- Open Lead Data Analyst jobs
- Open Data Science Manager jobs
- Open Senior Business Intelligence Analyst jobs
- Open Marketing Data Analyst jobs
- Open Junior Data Scientist jobs
- Open MLOps Engineer jobs
- Open Business Intelligence Developer jobs
- Open Data Scientist II jobs
- Open Business Data Analyst jobs
- Open Product Data Analyst jobs
- Open Data Analytics Engineer jobs
- Open Sr Data Engineer jobs
- Open Data Analyst Intern jobs
- Open Research Scientist jobs
- Open Principal Data Scientist jobs
- Open Big Data Engineer jobs
- Open Sr. Data Scientist jobs
- Open Senior Data Architect jobs
- Open Data Engineering Manager jobs
- Open Junior Data Engineer jobs
- Open Data Quality Analyst jobs
- Open Azure Data Engineer jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open Data quality-related jobs
- Open ML models-related jobs
- Open Business Intelligence-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open PhD-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open Finance-related jobs
- Open NLP-related jobs
- Open PyTorch-related jobs
- Open TensorFlow-related jobs
- Open APIs-related jobs
- Open LLMs-related jobs
- Open CI/CD-related jobs
- Open Generative AI-related jobs
- Open Snowflake-related jobs
- Open Consulting-related jobs
- Open Hadoop-related jobs
- Open Kubernetes-related jobs
- Open Data governance-related jobs
- Open Airflow-related jobs
- Open Databricks-related jobs