McKesson

Sr. Machine Learning Ops Engineer

McKesson$99K — $132K *
Healthcare
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 7+ years of relevant experience in MLOps and deployment of ML models
  • Hands-on expertise with CI/CD pipelines and monitoring
  • Experience with GenAI frameworks like LangChain or Semantic Kernel
  • Knowledge in model observability and operational support techniques
  • Proficiency in cloud platforms such as AWS, Azure, or GCP
  • Strong collaboration skills with cross-functional teams
  • Demonstrated ability to drive standardization and automation in ML systems

Responsibilities

  • Lead the deployment and operationalization of ML models and agentic AI solutions
  • Partner with Data Scientists to automate model use cases and build CI/CD pipelines
  • Define standardized deployment patterns and enforce runbooks
  • Manage KTLO (keep-the-lights-on) operations for ML and GenAI systems
  • Design pipelines for batch and real-time inference
  • Establish observability frameworks for monitoring and alerting
  • Conduct research into emerging tools to improve deployment practices

Benefits

  • Flexible work schedule with onsite requirements 2x per week
  • Collaborative environment within a growing AI/ML team
  • Opportunities for continued professional development
  • Access to cutting-edge tools and technologies in AI and ML
  • Focus on cost and performance optimization practices
Full Job Description
Job Title

Senior MLOps Engineer

This position follows our Flex & Connect model of 2x per week onsite in Mississauga, ON.

Summary

Join McKesson’s growing AI/ML team and play a critical role in operationalizing machine learning and Generative AI solutions at scale. This role focuses on deploying, standardizing, and maintaining production-ready ML and agentic AI systems—enabling consistent, reliable, and optimized delivery of data science innovations that support McKesson’s AIM28 strategic initiatives.

What You’ll Do
  • Lead deployment and operationalization of ML models and GenAI/agentic solutions, ensuring scalability, reliability, and performance
  • Partner with Data Scientists to identify and automate high-impact model use cases, building end-to-end pipelines (CI/CD, monitoring, alerting)
  • Define and enforce standardized deployment patterns and runbooks across teams
  • Own KTLO (keep-the-lights-on) operations for ML and GenAI systems including health monitoring, logging, and performance tracking
  • Design and implement pipelines for batch, real-time, and event-driven inference
  • Establish observability frameworks (monitoring, logging, lineage, alerting)
  • Enable deployment of agentic AI solutions using tools such as LangChain, LangGraph, Semantic Kernel, and Databricks tools
  • Ensure secure deployment of applications with proper access controls (e.g., Okta integration)
  • Drive cost and performance optimization across ML and GenAI workloads
  • Partner with architecture, compliance, governance, and legal teams to meet enterprise standards
  • Conduct ongoing research into emerging tools and technologies to improve deployment practices
  • Guide and influence architectural decisions while maintaining clear separation between platform and deployment ownership
What You Bring
  • Strong experience deploying ML models into production environments
  • Hands-on expertise with CI/CD pipelines, monitoring, and production ML systems
  • Experience with GenAI or agentic AI frameworks (LangChain, Semantic Kernel, etc.)
  • Knowledge of model observability, drift detection, and operational support
  • Experience working in scaling or early-stage ML environments
  • Proficiency with cloud platforms (AWS, Azure, or GCP)
  • Strong cross-functional collaboration skills (Data Science, Product, Architecture)
  • Ability to drive standardization, automation, and platform maturity
  • Focus on reliability, scalability, and optimization
Minimum Requirements
  • Degree or equivalent and typically requires 7+ years of relevant experience.
Preferable Skills & Experience
  • Experience with Databricks ecosystem (e.g., Databricks Genie)
  • Familiarity with LangChain, LangGraph, or Microsoft Semantic Kernel
  • Exposure to GenAI cost optimization / FinOps practices
  • Experience implementing secure enterprise applications (e.g., Okta)
  • Experience in healthcare or regulated environments
  • Experience scaling ML/AI capabilities from experimentation to production maturity

We are proud to offer a competitive compensation package at McKesson as part of our Total Rewards. This is determined by several factors, including performance, experience and skills, equity, regular job market evaluations, and geographical markets. The pay range shown below is aligned with McKesson's pay philosophy, and pay will always be compliant with any applicable regulations. In addition to base pay, other compensation, such as an annual bonus or long-term incentive opportunities may be offered. For more information regarding benefits at McKesson, please

Our Base Pay Range for this position

$99,100 - $132,100

About McKesson

McKesson Corporation provides medicines, pharmaceutical supplies, information and care management products and services across the healthcare industry. The Company operates in two segments. The McKesson Distribution Solutions segment delivers ethical drugs, medical-surgical supplies and equipment and health and beauty care products throughout North America. This segment also provides specialty pharmaceutical solutions for biotech and pharmaceutical manufacturers, sells financial, operational and clinical solutions for pharmacies (retail, hospital, long-term care) and provides consulting, outsourcing and other services. The McKesson Technology Solutions segment delivers enterprise-wide clinical, patient care, financial, supply chain, strategic management and software solutions. In July 2011, the Company acquired Portico Systems from Safeguard Scientifics, Inc. On March 25, 2012, it acquired the independent banner and franchise businesses of Katz Group Canada Inc. McKesson Distribution Solutions delivers pharmaceuticals to retail pharmacies and institutional providers like hospitals and health systems. They operate pharmaceutical distribution centers across the country, serving customers in all 50 states. They also deliver a comprehensive offering of health care products, technology, equipment and related services to the alternate site market, including physician offices, surgery centers, long-term care facilities and home care businesses across the country. McKesson is currently the largest pharmaceutical distributor in North America. McKesson also operates McKesson Canada and has an equity holding in Nadro, a leading distributor in Mexico.

McKesson Careers

Join McKesson, a leading global healthcare company, and be part of a team that is redefining the future of healthcare. With a variety of job opportunities available, McKesson is the perfect place to advance your career, whether you're a seasoned professional or just starting out. Work You’ll Do At McKesson, we are committed to improving care in every setting—one product, one partner, one patient at a time. We’re seeking talented professionals to join our team and contribute to a culture of innovation, diversity, and leadership. Our employees are driven by a deep sense of purpose and a desire for continuous growth and improvement. Empower Your Future in Healthcare With positions ranging from internships to leadership roles, McKesson offers unparalleled employment opportunities to develop your skills and advance your career. Our commitment to diversity training ensures that all team members have the opportunity to thrive. Join a team where your skills will be honed, your professional growth will be supported, and where you can genuinely see the difference you make in the lives of patients around the world. Innovative Work Environment McKesson is at the forefront of healthcare innovation. Our team is constantly exploring new ways to improve patient outcomes and streamline care processes. This commitment to innovation is what sets us apart and what makes McKesson an exciting place to work. Career Development and Benefits McKesson believes in nurturing the potential of its employees through robust career development programs and comprehensive benefits designed to support your life and well-being. From leadership training to health and wellness benefits, we ensure our team members are equipped to meet their professional and personal goals. Explore Job Opportunities Whether you’re looking for an internship to kickstart your career, or a senior position to utilize your extensive experience, McKesson offers a range of opportunities. Explore our open positions and find where you can make a difference at McKesson. Stay Connected Join Our Team Search for open positions that match your skills and interests. We are looking for passionate, curious, and solution-driven team players who are ready to take the next step in their careers. Keep Up to Date Stay ahead with career tips, insider perspectives, and industry-leading insights you can put to use today—all from the people who work here. Networking and Professional Growth At McKesson, networking and professional growth are part of our everyday environment. We encourage our employees to connect, share, and learn from each other to foster personal and professional development. Job Alert Emails Personalize your subscription to receive job alerts, latest news, and insider tips tailored to your preferences. Discover the exciting and rewarding career opportunities that await you at McKesson. Join McKesson today and be part of a team that is dedicated to shaping the future of healthcare.
Learn more about McKesson
Size
58,000 employees
Market Cap
$53.7 billion
Industry
Net Income
-$4.1 billion
Founded
1833
5 Year Trend
+5.9%
Revenue
$237.6 billion
NASDAQ

Similar Jobs

More Jobs at McKesson

More Healthcare Jobs

Find similar Sr. Machine Learning Ops Engineer jobs: