Staff Software Engineer, AI Engineer

Midi Health

• $210K — $250K *
Healthcare
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • 10+ years of software engineering experience, particularly in AI/LLM systems
  • Hands-on Python coder, actively writing production code
  • Expert in designing scalable AI systems with a focus on retrieval and evaluation
  • Recognized authority in AI engineering, influencing teams and leaders
  • Experience in mentoring engineers and enhancing AI skills across teams
  • Strong communication skills with a focus on risk and safety in AI contexts
  • Low-ego, curious, and humble demeanor in collaborative settings

Responsibilities

  • Lead the technical strategy for AI/LLM initiatives across product lines
  • Architect systems for retrieval, orchestration, and evaluation to ensure operational reliability
  • Establish AI safety standards and evaluation practices within a healthcare environment
  • Collaborate with leadership to develop and refine the AI roadmap
  • Mentor engineers, enhancing their capabilities in AI development
  • Research and implement advanced AI models and tools for team integration

Benefits

  • Eligibility for equity in the company
  • Access to a wide range of employee benefits
  • Commitment to pay transparency and equity
  • Focus on fair and competitive compensation practices
  • Supportive work environment that promotes inclusion and equity
Full Job Description
Location: Hybrid- San Francisco OR Palo Alto Office, Tuesday/Thursday

The Difference You Will Make

You'll set the direction for how Midi builds with AI - across clinical workflows, patient experience, and operational intelligence. You'll own the architecture of our AI systems, the evaluation practices that keep them safe, and the standards that let every engineer at Midi ship AI features confidently. This is the role for someone who wants to define what AI engineering looks like in a modern healthcare company.
What You Will Do
  • Lead technical strategy for AI/LLM systems across Midi's product surfaces
  • Architect retrieval, orchestration, agentic, and evaluation systems that run reliably in production
  • Set the standards for AI safety, evaluation, observability, and responsible rollout in a healthcare context
  • Partner with clinical, product, and executive leadership to shape the AI roadmap
  • Mentor senior and mid-level engineers into strong AI engineers; raise the AI literacy of the whole org
  • Lead the frontier: evaluate new models, techniques, and tools, and bring the right ones into the team
About You
  • 10+ years of software engineering experience, with deep recent time leading production AI/LLM systems
  • Seasoned hands-on coder; still writes production Python regularly
  • Seasoned system designer for AI systems at scale - retrieval, agents, evaluation, latency, and cost
  • Authority in AI engineering: teams and leaders defer to your judgment, and you can defend it rigorously
  • Leader at the AI frontier: you set how the team uses AI tooling and how we build AI products
  • Seasoned mentor; you've grown engineers into strong AI builders
  • Strong communicator with product, clinical, and executive stakeholders; thoughtful about risk and safety tradeoffs
  • Low-ego, curious, humble
Nice to Have
  • Healthcare, clinical NLP, or regulated AI deployment experience
  • Track record of shipping agentic or large-scale RAG systems in production
Interview Process
  • Recruiter Screen (30 min)
  • Hiring Manager Screen (45 min)
  • Live Technical Assessment (3 sessions: 150 min)
  • On-Site Interview and Lunch (4 sessions: 150 min)

While you are waiting for us to review your resume, here is some fun content to check out.

Midi 2024 in Review

Women Leaders Invest in Midi

Patient Testimonials

At Midi Health, we are committed to pay transparency and equity. The estimated salary range for this role is $210,000-$250,000 per year, based on factors such as experience and skills. In addition to base salary, employees are eligible for a wide range of benefits and equity in the company,

We believe in fair and competitive compensation practices that align with our values of equity and inclusion. If you have any questions about how we determine pay, we're happy to discuss further in the hiring process.

#li-ps1

At this time, Midi is unable to provide visa sponsorship. All Candidates must be authorized to work in the United States without current or future sponsorship needs.

Please note that all official communication from Midi Health will come from an email address. We will never ask for payment of any kind during the application or hiring process. If you receive any suspicious communication claiming to be from Midi Health, please report it immediately by emailing us at [email protected].

Similar Jobs

More Jobs at Midi Health

More Healthcare Jobs

Find similar Staff Software Engineer, AI Engineer jobs: