Cotiviti

Senior Principal Machine Learning Engineer

Cotiviti$250K — $280K *
US-AnywhereRemote in United States
Healthcare
11 - 15 years of experience
Job Overview by Ladders

Qualifications

  • PhD in a quantitative discipline: Computer Science, Statistics, Engineering, or Operations Research.
  • 12+ years of experience in building large-scale production ML systems.
  • Deep expertise in LLM evaluation, retrieval-augmented generation, and ranking.
  • Proven leadership in end-to-end ML project execution.
  • Strong discipline in experimentation: A/B testing and metric design.
  • Proficient in Python, SQL, and distributed pipeline tools like Airflow.
  • Demonstrated skill in cross-functional team collaboration.

Responsibilities

  • Define the system architecture for end-to-end AI/LLM-powered products.
  • Build and own evaluation frameworks to ensure accuracy and auditability.
  • Drive the data flywheel to enhance model precision with quality labeled data.
  • Explore the creation of patient-level digital twins from clinical data.
  • Lead systems to rank and prioritize claims and audits for review.
  • Establish reusable platform patterns that provide value across products.
  • Mentor senior engineers and elevate ML craftsmanship standards.

Benefits

  • Comprehensive medical, dental, and vision insurance coverage.
  • 401(k) savings plan with company contributions.
  • Generous Paid Time Off (PTO) ranging from 17 to 27 days annually.
  • Paid family leave and 9 public holidays.
  • Disability and life insurance benefits.
Full Job Description
Overview

We are looking for a Senior Principal Machine Learning Engineer to lead the design and delivery of end-to-end ML/AI systems that turn vast volumes of claims, clinical, and member data into measurable performance and reduced waste. You will define technical strategy, drive cross-functional alignment, and own systems that directly shape payment accuracy, risk adjustment, and quality outcomes for the payers we serve. This role sits at the intersection of applied research and production engineering, translating ambiguous, high-stakes problems into scalable, auditable ML solutions.

The ideal candidate has operated at large scope across multiple teams and product surfaces 6 not just shipped models, but defined the problem, built the evaluation infrastructure, created the data flywheel, and drove measurable business outcomes. They think in systems, write crisp design docs, bring intellectual honesty to experimentation, and treat auditability and precision as first-class requirements rather than afterthoughts. They raise the level of the engineers around them.

Responsibilities
  • Define system architecturefor AI/LLM-powered products end to end over claims, medical records, and clinical documentation.
  • Build and own evaluation frameworks(LLM-as-a-Judge, offline metrics, online experiments) aligned to accuracy, auditability, and clinical and regulatory risk 6 because outputs inform payment and compliance decisions.
  • Drive the data flywheel: convert expert clinician and auditor review decisions into high-quality labeleddata, andclose the loop with fine-tuning of models to lift detection precision.
  • Explore building patient-level digital twinsfromclinical charts for unified processing layer and data presentation across payment, risk and quality.
  • Lead ranking and prioritization systemsthat surface the highest-value claims, audits, and care gaps for human review, improving both reviewer efficiency and financial impact.
  • Establish reusable platform patterns 6 shared context stores, evaluation harnesses, feature pipelines 6 that compound value across product surfaces and lines of business.
  • Partneracross engineering, product, clinical, and analytics teamsto align on success criteria, roadmap priorities, and production rollout.
  • Mentor senior engineersand elevate organization-wide standards in ML craftsmanship, experimentation rigor, and system design.
  • Setscompany-wide standards.
  • Acts as a thought leaderbeyond Cotiviti to elevate the reputation and visibility of Cotiviti in the industry.
  • Influencesthe enterprise AI/ML strategy at an executive level.
  • Complete all responsibilities as outlined in the annual performance review and/or goal setting.
  • Complete all special projects and other duties as assigned.
  • Must be able to perform duties with or without reasonable accommodation.

This job description is intended to describe the general nature and level of work being performed and is not to be construed as an exhaustive list of responsibilities, duties and skills required. This job description does not constitute an employment agreement and is subject to change as the needs of Cotiviti and requirements of the job change.

Qualifications

Required

  • PhD in a quantitativediscipline such as Computer Science/Engineering, Statistics, Operations Research covering Advanced Statistics, Machinelearningand AI.
  • 12+ years of industry experience building production ML systems at scale.
  • Deep expertise in two or more of: LLM evaluation, retrieval-augmented generation (RAG), ranking, or large-scale classification.
  • Proven track record leading end-to-end ML projects, from problem framing through production impact.
  • Strong experimentation discipline: A/B testing, causal inference, metric design, and opportunity mining.
  • Proficiency in Python (PyTorch), SQL at scale (Presto / Trino / Spark), and distributed pipeline tooling (Airflow).
  • Demonstrated ability to drive cross-functional alignment across engineering, product, and analytics.

Highly valued

  • Experience building LLM-as-a-Judge evaluation pipelines aligned to quality, risk, and accuracy criteria.
  • Hands-on supervised fine-tuning of embedding or reranking models with measurable production gains.
  • Experience with healthcare data (claims, electronic health records, or clinical coding such as ICD, CPT, or HCC).
  • Background designing ML systems in regulated, auditable, or high-stakes domains (healthcare, finance, or fraud, waste, and abuse detection).
  • Familiarity with building systems that handle sensitive data under frameworks such as HIPAA.
  • Background building canonical data services or platform-level ML infrastructure adopted organization-wide.
  • Applied mathematics, statistics, or quantitative PhD background.
  • LLM ecosystem: RAG pipelines, LLM-as-a-Judge evaluation, prompt engineering, supervised fine-tuning.

Cognitive/Mental Requirements:

  • Communicating with others to exchange information.
  • Problem-solving and thinking critically.
  • Completing tasks independently.
  • Interpreting data.
  • Making timely decisions in the context of a workflow.

Working Conditions and Physical Requirements:

  • Must be able to provide a dedicated, secure work area.
  • Must be able to provide high-speed internet access / connectivity and office setup and maintenance.

Pay Transparency:

Base compensation ranges from $250,000 to $280,000 per year. Specific offers are determined by various factors, such as experience, education, skills, certifications, and other business needs. This role is eligible for discretionary bonus consideration.

Cotiviti offers team members a competitive benefits package to address a wide range of personal and family needs, including medical, dental, vision, disability, and life insurance coverage, 401(k) savings plans, paid family leave, 9 paid holidays per year, and 17-27 days of Paid Time Off (PTO) per year, depending on specific level and length of service with Cotiviti. For information about our benefits package, please refer to our Careers page.

Since this job will be based remotely, all interviews will be conducted virtually.

Date of posting: 7/6/2026

Applications are assessed on a rolling basis. We anticipate that the application window will close on 10/6/2026, but the application window may change depending on the volume of applications received or close immediately if a qualified candidate is selected.

#LI-LL1

#LI-remote

#senior

#director

About Cotiviti

Cotiviti is a healthcare technology company that provides analytics-driven payment accuracy solutions mainly to the healthcare and retail sectors. The company's solutions help clients improve their financial performance and reduce healthcare costs. Cotiviti's solutions include prospective and retrospective claims accuracy solutions, payment integrity, risk adjustment, quality improvement, and advisory services. The company was founded in 1979 and is headquartered in Atlanta, Georgia.
Learn more about Cotiviti
Size
4,400 employees
Industry
Founded
1979

Similar Jobs

More Jobs at Cotiviti

More Healthcare Jobs

Find similar Senior Principal Machine Learning Engineer jobs: