Machine Learning Engineer
New York City, NY
Kensho
Kensho develops cutting-edge products and technologies that transform businesses. We are the AI Innovation Hub for S&P Global.The Catalyst team at Kensho Technologies is at the forefront of designing and applying cutting-edge machine learning in the domains of natural language and speech. We are continuously expanding our portfolio of projects and are looking for passionate researcher-engineers to help us build and deploy state-of-the-art ML systems!
Recently RAG-based systems that integrate structured and unstructured data are at the core of our team's projects. These solutions are integrated into the S&P Global platforms, providing users with the ability to find and analyze complex financial data efficiently.
The Catalyst team works closely with the Data, Product, Design, Backend & Frontend teams, and has the full support of our ML ops and Infrastructure teams.
We are seeking a mid-level ML Engineer to help accelerate and improve our ML development cycle, continually raising standards of prototyping, building, and maintaining SOTA ML solutions.
Kensho states that the anticipated base salary range for the position is 150k - 200k. In addition, this role is eligible for an annual incentive bonus and equity plans. At Kensho, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case.
What You’ll Do:
- Work closely with Data, Product, Design, and Engineering teams to design and develop Large Language Model (LLM)-based systems that integrate structured and unstructured data, ensuring the delivery of innovative ML solutions that meet customer needs
- Solve unique challenges around LLM-orchestration, such as data access patterns, memory and context management, and conducting thorough evaluations
- Actively participate in all stages of the ML lifecycle, from problem framing and data exploration to model experimentation, deployment, and monitoring in production, ensuring the continuous improvement and optimization of our ML solutions
- Work with unique proprietary unstructured data and structured datasets, applying advanced NLP techniques to extract insights and build solutions that drive business value
- Work closely with Product and Design teams to build ML-based solutions that enhance user experiences and meet business objectives
- Collaborate closely with the ML Operations team to create automated solutions for managing the entire ML systems lifecycle, from initial technical design to seamless implementation
What You'll Need:
- Bachelor's degree or higher in Computer Science, Engineering, or a related field
- 3+ years of significant, hands-on industry experience with machine learning, natural language processing (NLP), and information retrieval systems, including designing, shipping, and maintaining production systems
- Strong proficiency in Python
- Experience working with machine learning libraries/frameworks for Large Language Model (LLM) orchestration, such as Langchain, Semantic Kernel, LLamaIndex, etc.
- Proven experience building ML pipelines for data processing, training, inference, maintenance, evaluation, versioning, and experimentation
- Demonstrated effective coding, documentation, collaboration, and communication habits
- Strong problem-solving skills and a proactive approach to addressing challenges
- Ability to adapt to a fast-paced and dynamic work environment
Technology You'll Encounter:
- ML: PyTorch, Transformers, HuggingFace, LangChain
- Tools/Toolkits: DVC, MosaicML, NVIDIA NeMo, LabelBox, Weights & Biases
- Techniques: RAG, Prompt Engineering, Information Retrieval, Data Embedding
- Deployment: Airflow, Docker, Kubernetes, Jenkins, AWS
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow ASR AWS Classification Computer Science Docker Engineering HuggingFace Kubernetes LangChain LLMs Machine Learning MosaicML NLP Pipelines Prompt engineering Prototyping Python PyTorch Transformers Unstructured data Weights & Biases
Perks/benefits: Career development Conferences Equity Health care Medical leave Parental leave Pet friendly Salary bonus Startup environment Team events Unlimited paid time off
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open MLOps Engineer jobs
- Open Data Science Manager jobs
- Open Lead Data Analyst jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Manager jobs
- Open Data Engineer II jobs
- Open Power BI Developer jobs
- Open Sr Data Engineer jobs
- Open Principal Data Engineer jobs
- Open Business Intelligence Developer jobs
- Open Junior Data Scientist jobs
- Open Data Analytics Engineer jobs
- Open Product Data Analyst jobs
- Open Data Scientist II jobs
- Open Sr. Data Scientist jobs
- Open Business Data Analyst jobs
- Open Senior Data Architect jobs
- Open Data Analyst Intern jobs
- Open Big Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Data Product Manager jobs
- Open Junior Data Engineer jobs
- Open Data Quality Analyst jobs
- Open Principal Data Scientist jobs
- Open Azure Data Engineer jobs
- Open GCP-related jobs
- Open Data quality-related jobs
- Open Business Intelligence-related jobs
- Open Java-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open Data visualization-related jobs
- Open Finance-related jobs
- Open Deep Learning-related jobs
- Open PhD-related jobs
- Open APIs-related jobs
- Open TensorFlow-related jobs
- Open PyTorch-related jobs
- Open NLP-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open CI/CD-related jobs
- Open LLMs-related jobs
- Open Kubernetes-related jobs
- Open Generative AI-related jobs
- Open Data governance-related jobs
- Open Hadoop-related jobs
- Open Airflow-related jobs
- Open Docker-related jobs