Senior Applied AI Engineer

Roger Healthcare

$130K — $180K *
Consumer Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 7+ years of professional software engineering experience with a focus on AI/ML.
  • Experience with training, fine-tuning, or evaluating LLMs and open source models.
  • Demonstrated ability to ship real AI software for actual users.
  • Strong insights into evaluation, observability, and user feedback processes.
  • Experience creating agentic systems and managing workflows between different AI outputs.
  • Proficient in building scalable, reliable, and cost-efficient infrastructure.
  • Startup experience shipping features in fast-paced environments.

Responsibilities

  • Train and fine-tune open source models using proprietary datasets for improved accuracy.
  • Develop evaluation datasets and pipelines for continuous model accuracy measurement.
  • Design metrics and feedback loops to correlate real clinical outcomes with model improvements.
  • Create scalable, cost-effective inference infrastructure with monitoring capabilities.
  • Build integrated systems to enhance clinician interaction with AI tools.
  • Stay updated with the latest AI research and integrate new findings into production.
  • Rapidly prototype solutions and transition them into secure, reliable production systems.

Benefits

  • Platinum health, dental, and vision insurance.
  • Flexible PTO policy.
  • Opportunity to work at the cutting edge of LLM innovation in healthcare.
  • Founded by AI researchers from notable institutions.
  • Ability to make a meaningful impact on clinician and patient experiences.
  • Engagement in a mission-driven environment supported by top-tier investors.
Full Job Description
About the Role

The administrative work behind home health is messy, unstructured, and high-stakes. From clinical documentation to the operational busywork that organizations serving these vulnerable populations face every day, turning dense, nuanced information into accurate records requires LLM systems that extract structure from unstructured data, validate their own outputs, learn from a vast and growing dataset, and continuously improve in accuracy.

We are now looking for a Senior Applied AI Engineer to build the intelligence layer at the core of Roger: training and fine-tuning models on our data, building the eval and monitoring infrastructure that keeps them accurate, and shipping LLM-powered workflows that clinicians rely on every day. There is a wide gap between a demo of an AI product and one that actually works for real clinicians caring for real patients, and we are hiring engineers who build on the right side of that gap.

What You'll Do
  • Train and fine-tune open source models, leveraging our vast proprietary dataset to push accuracy beyond what off-the-shelf models can do.
  • Build eval datasets and pipelines that let us measure model accuracy rigorously and improve it continuously.
  • Design how we measure accuracy in the first place: the metrics, harnesses, and feedback loops that turn real clinical outcomes into measurable model improvements.
  • Build scalable, cost-efficient inference infrastructure with great monitoring and observability.
  • Build better agentic infrastructure and partner on the interfaces that turn model capability into a great clinician experience.
  • Stay at the frontier: keep up with the latest research, frontier model capabilities, and open source frameworks, and bring the best of it into production.
  • Prototype quickly, then harden into scalable, secure, and reliable production systems.
You Might Be a Good Fit If You Have
  • 7+ years of professional software engineering experience, with meaningful depth in AI/ML.
  • Experience training, fine-tuning, or evaluating LLMs and open source models, with real opinions about what works and what does not.
  • Shipped real AI software to real users. You can describe something you built, what broke, and how you fixed it.
  • Strong instincts for evals, observability, and the feedback loops that turn user feedback into measurable improvement.
  • Experience building agentic systems: tool use, generator and critic loops, planners and executors, and orchestration where one agent's output drives another's work.
  • Comfort building infrastructure that is fast, reliable, and cost-efficient at scale.
  • Startup experience shipping real features in high-growth environments.
  • A product mindset, comfort across the stack, and the ability to operate in ambiguity without a clean spec.
  • High standards for reliability and accuracy when real clinicians and patients depend on your work.

Why Join Us?

Platinum health, dental, and vision insurance

Flexible PTO

Be at the forefront of LLM innovation in healthcare

Founded by AI Researchers from Cornell and Amazon Alexa

Make a tangible difference in the lives of clinicians and patients

Work on a mission that matters, backed by AI innovation and top-tier investors

Make a Real Difference: Hear from our Users

"If I had to give Roger a rating out of 10, I'd give it an 11! You guys changed my life!!"

- G.M. from San Francisco, Registered Nurse

"Roger AI saves me hours per day. I can easily focus on my patients now too."

- J.L. from Tucson, Registered Nurse

"Being a single mom is tough, but with Roger I can take the time to go to my daughter's soccer game and also pursue further education."

- T.M. from Dallas, Licensed Vocational Nurse

If you're interested in joining a fast-growing healthcare AI startup, we'd love to hear from you TODAY!

In person and remote opportunities available.

Similar Jobs

More Jobs at Roger Healthcare

  • Senior Software Engineer, Full-Stack
    $130K — $180K *
    San Francisco, CA 94112 (San Francisco County)
    Information Technology
    In-Person
  • Senior Product Designer
    $120K — $150K *
    San Francisco, CA 94112 (San Francisco County)
    Healthcare
    In-Person
  • Chief of Staff
    $120K — $180K *
    San Francisco, CA 94112 (San Francisco County)
    Business Services
    In-Person
  • Founding Recruiter
    $120K — $150K *
    San Francisco, CA 94112 (San Francisco County)
    Healthcare
    In-Person
  • Customer Support Lead
    $90K — $120K *
    San Francisco, CA 94112 (San Francisco County)
    Business Services
    In-Person

More Consumer Technology Jobs

Find similar Senior Applied AI Engineer jobs: