Garner Health

Staff Machine Learning Operations Engineer

Garner Health$298K — $351K *
Healthcare
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 7+ years of software engineering experience, notably with production ML or data-intensive systems.
  • Deep knowledge of the modern ML production stack including model serving and CI/CD for ML.
  • Proficient in infrastructure and platform engineering: Kubernetes, cloud (AWS preferred), and Terraform.
  • Experience designing major components of ML platforms, with strategic judgment on building versus buying.
  • Strong collaboration skills with cross-functional teams, especially in ML and data engineering.
  • Background in healthcare or high-stakes ML systems is advantageous but not mandatory.
  • Motivation to work in a mission-driven team with a strong commitment to accountability.

Responsibilities

  • Own reliability, performance, and cost-efficiency of production ML systems.
  • Architect the ML platform, including essential data infrastructure and service patterns.
  • Implement automated CI/CD pipelines for ML models with data quality checks.
  • Drive costs and performance improvements through architecture and model optimization.
  • Establish workflows and standards for a future MLOps team to enable rapid onboarding.
  • Design and implement automated monitoring for data and concept drift in models.

Benefits

  • Opportunity to work on impactful problems in the healthcare sector.
  • Real ownership and autonomy in projects.
  • Challenging environment fostering personal growth and feedback.
  • Flexible Paid Time Off (PTO) and a comprehensive medical plan.
  • 401(k) retirement savings plan and equity incentives.
Full Job Description
About the role:

We are seeking an exceptional Staff Machine Learning Operations Engineer to join our PlatformEngineering team. This role will report to the VP of Platform Engineering. As Garner's foundational dedicated MLOps Engineer, you will assume responsibility for the reliability, performance, and cost-efficiency of our production machine learning systems. You will lead the development of a robust platform designed to facilitate the secure and consistent deployment of models by our machine learning and data science teams. Given that these models directly influence health outcomes and cost-effectiveness for millions of patients, maintaining the highest standards of production quality is imperative.
Where you will work:

This role will be based in our New York City office (in the Financial District). You must be willing to work in the office 3 days per week on Tuesday, Wednesday and Thursday.
What you will do:
  • Own the reliability, performance, functionality, and cost-efficiency of Garner's production ML systems, including establishing SLOs, observability, and on-call responsibilities.
  • Architect Garner's ML platform including required data infrastructure (including feature store, model registry and CI/CD for models), and standardized service patterns.
  • Implement ML-specific CI/CD pipelines: Transition our deployment process from manual notebook hand-offs to automated, PR-driven CI/CD workflows that include automated data quality checks and statistical model validation prior to deployment.
  • Drive down cost and latency through improved architecture, hardware choices, and model optimization as appropriate.
  • Lay the foundation for a future Garner MLOps team, including workflows, standards, and KPIs that enables rapid teammate onboarding and helps stakeholders and teammates quickly identify the health of the team's products, allowing engineers to focus on areas where issues reside
  • Establish Drift Monitoring: Design and implement automated data drift and concept drift monitoring systems that alert the team when models degrade, laying the groundwork for future Continuous Training (CT) architectures
The ideal candidate has:
  • 7+ years of software engineering experience, with significant time spent operating ML or data-intensive systems in production at scale.
  • Deep experience with the modern ML production stack: model serving (e.g., Sagemaker, Triton, or equivalent), feature stores, model registries, and CI/CD for ML.
  • Strong infrastructure and platform engineering fundamentals: Kubernetes, containerization, cloud (AWS preferred), Terraform/IaC, observability, and incident response.
  • Experience designing ML platforms or significant components of one (not strictly consuming SaaS) and the judgment to know when to build vs. buy.
  • Strong collaboration with ML, data, platform engineers, data scientists, and product engineering teams, with the ability to set technical direction as the most senior MLOps voice in the org.
  • Healthcare, regulated-data, or other high-stakes production ML experience is a plus but not required.
  • A desire to be a part of a high-performing, mission-driven team that operates with intense urgency, a strong sense of individual accountability, and a commitment to authentic feedback
What you'll get here:

You'll work on problems that matter, at a company working to change healthcare at scale. You'll work at the intersection of AI and systemic healthcare reform, where the problems we solve are as interesting and compelling as the mission.

At Garner, you'll take on real, ambitious problems with real ownership and autonomy, alongside exceptional, principles-based people who genuinely want you to win. It's demanding by design. You'll be challenged to stretch beyond what you thought possible and receive consistent coaching to help you grow and do the best work of your career. This isn't the right fit for everyone, and that's intentional. The people here are driven by what's at stake for real people, and that's what gives our intensity its purpose.
Technologies we use:
  • Python, Kubernetes, AWS, Sagemaker, Terraform, S3, Snowflake, Airflow, Datadog

This is a unique opportunity to join a fast-growing company in a transformative role, helping shape the future of healthcare.

Please note: we are unable to sponsor or take over sponsorship of an employment visa at this time.
Compensation Transparency:

The target salary range for this position is $298,000 - $351,000. Individual compensation for this role will depend on various factors, including qualifications, skills, and applicable laws. In addition to base compensation, this role is eligible to participate in our equity incentive and competitive benefits plans, including but not limited to: flexible PTO, Medical/Dental/Vision plan options, 401(k), Teladoc Health and more.

Fraud and Security Notice:

Please be aware of recent job scam attempts. Our recruiters use getgarner.com and garnerhealth.com email domains exclusively. If you have been contacted by someone claiming to be a Garner recruiter or a hiring manager from a different domain about a potential job, please report it to law enforcement here and to [email protected].

Similar Jobs

More Jobs at Garner Health

More Healthcare Jobs

Find similar Staff Machine Learning Operations Engineer jobs: