Databricks Platform Engineer (MLOps)
Toronto, Ontario, Canada
Guidepoint
Overview:
Guidepoint’s Technology team thrives on problem-solving and creating happier users. As Guidepoint works to achieve its mission of making individuals, businesses, and the world smarter through personalized knowledge-sharing solutions, the engineering team is taking on challenges to improve our internal application architecture and create new AI-enabled products to optimize the seamless delivery of our services.
Guidepoint seeks an experienced Databricks Platform Engineer (MLOps) to join the Toronto-based Data/AI team. The Toronto Technology Hub will serve as the base of our new Data/AI team, dedicated to building a modern data infrastructure for advanced analytics and the development of responsible AI. This strategic investment is integral to Guidepoint’s vision for the future, aiming to develop cutting-edge Generative AI and analytical capabilities that will underpin Guidepoint’s Next-Gen research enablement platform and data products.
What You’ll Do:
- Design and implement cloud solutions, build MLOps on cloud (Azure and Databricks)
- Build CI/CD pipelines orchestration using tools such as Azure DevOps
- Proficiently use MLFlow and handle model serving and monitoring on Databricks
- Test, validate, and automate tests for ML models
- Tune Databricks for spark cluster performance and utilization optimization
- Provide infrastructure guidance on Databricks capabilities to accommodate business/technical use cases
- Automate and manage provisioning needs, including Databricks Cluster Policies, Unity Catalog, Secrets Management, Role-Based Access Control model, and permissions
- Monitor and manage data and processes to control costs and optimize compute spend
- Configure and manage monitoring/alerting around latency performance on the Databricks platform, including Delta Live Tables and Databricks Workflows and machine learning model performance
- Coordinate and collaborate with dependent infrastructure teams and Azure services to integrate Databricks securely.
- Provide technical expertise and troubleshooting as well as support for change management, governance, compliance, internal audits, and remediations
- Communicate with a team of data scientists, ML engineers, data engineers, and architects, and document the processes
What You Have:
- Bachelor’s Degree
- 2+ years of relevant experience on Databricks, including performance tuning, infrastructure guidance, workflow automation and cost optimization strategies
- Experience in cloud solutions, preferably on Azure
- Skills in MLFlow, containerization, and deployment practices (Preferred)
- Excellent communication and documentation skills to collaborate effectively with cross-functional teams
What We Offer:
- Paid Time Off
- Comprehensive benefits plan
- Company RRSP Match
- Development opportunities through the LinkedIn Learning platform
About Guidepoint:
Guidepoint is a leading research enablement platform designed to advance understanding and empower our clients’ decision-making process. Powered by innovative technology, real-time data, and hard-to-source expertise, we help our clients to turn answers into action.
Backed by a network of nearly 1.5 million experts and Guidepoint’s 1,300 employees worldwide, we inform leading organizations’ research by delivering on-demand intelligence and research on request. With Guidepoint, companies and investors can better navigate the abundance of information available today, making it both more useful and more powerful.
At Guidepoint, our success relies on the diversity of our employees, advisors, and client base, which allows us to create connections that offer a wealth of perspectives. We are committed to upholding policies that contribute to an equitable and welcoming environment for our community, regardless of background, identity, or experience.
#LI-TA1
#LI-HYRBID
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Architecture Azure CI/CD Databricks DevOps Engineering Generative AI Machine Learning MLFlow ML models MLOps Pipelines Research Responsible AI Spark
Perks/benefits: Career development
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Data Science Manager jobs
- Open Research Scientist jobs
- Open Data Engineer II jobs
- Open Principal Data Scientist jobs
- Open Business Data Analyst jobs
- Open BI Analyst jobs
- Open Data Scientist II jobs
- Open Sr Data Engineer jobs
- Open Business Intelligence Engineer jobs
- Open Lead Data Analyst jobs
- Open Sr. Data Scientist jobs
- Open Data Science Intern jobs
- Open Senior Business Intelligence Analyst jobs
- Open Software Engineer, Machine Learning jobs
- Open Junior Data Scientist jobs
- Open Azure Data Engineer jobs
- Open MLOps Engineer jobs
- Open Manager, Data Engineering jobs
- Open Data Analytics Engineer jobs
- Open Marketing Data Analyst jobs
- Open Data Engineer III jobs
- Open Junior Data Engineer jobs
- Open Data Analyst II jobs
- Open Data Engineering Manager jobs
- Open ETL Developer jobs
- Open Data quality-related jobs
- Open Tableau-related jobs
- Open Privacy-related jobs
- Open Excel-related jobs
- Open ML models-related jobs
- Open Data pipelines-related jobs
- Open APIs-related jobs
- Open PhD-related jobs
- Open PyTorch-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open LLMs-related jobs
- Open Consulting-related jobs
- Open TensorFlow-related jobs
- Open Deep Learning-related jobs
- Open Business Intelligence-related jobs
- Open Generative AI-related jobs
- Open CI/CD-related jobs
- Open NLP-related jobs
- Open Data governance-related jobs
- Open DevOps-related jobs
- Open Kubernetes-related jobs
- Open Git-related jobs
- Open Hadoop-related jobs
- Open Docker-related jobs