Staff Engineer

LiteLLM AI Gateway

$130K — $180K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Experience at a startup (Seed to Series D) with a willingness to wear multiple hats
  • Built test or release infrastructure for systems with extensive external integrations
  • Strong debugging skills to discern root causes in unfamiliar codebases
  • Clear opinions on what constitutes a trustworthy test suite
  • Proven ability to enhance team quality without becoming a bottleneck
  • Open source contributions on platforms like GitHub

Responsibilities

  • Own product quality end to end and aim to reduce regressions toward zero
  • Develop a provider conformance test suite covering various integration aspects
  • Create fast, reliable CI and release tooling that prevents production issues
  • Implement canary and synthetic traffic detection to identify upstream issues promptly
  • Manage release channels for daily shipping in a dynamic environment
  • Conduct thorough root cause analyses to ensure that escaped defects are permanently addressed
  • Elevate engineering standards through code reviews rather than exhaustive process documentation

Benefits

  • Drive the quality agenda at a high-impact technical organization
  • Gain deep technical ownership, focusing more on coding than on meetings
  • Thrive in a fast-paced environment with substantial scaling opportunities
  • Access to a competitive salary and benefits package
Full Job Description
Staff Software Engineer, Product Quality

You will own LiteLLM's product quality across a surface area that spans 100+ provider integrations and a large volume of outside contributions. Your mandate is to make quality automatic at our scale, without slowing down how fast we ship. You'll build the conformance testing, CI, and release infrastructure that catches problems before they reach production, and you'll set the bar on the code paths that matter most.
Responsibilities
  • Own product quality end to end and drive regressions toward zero
  • Build a provider conformance test suite covering streaming, tool calling, structured output, error mapping, cost tracking, and auth modes
  • Own CI and release tooling that is fast, deterministic, and trusted enough that a red gate blocks a ship
  • Build canary and synthetic traffic detection to catch upstream provider drift before customers do
  • Own release channels so we ship daily at the edge while enterprise stays stable
  • Do real root cause analysis and turn every escaped defect into a permanent test
  • Raise the engineering bar through code and review, not through process documents
What We're Looking For
  • Experience at a startup (Seed to Series D) with a willingness to wear multiple hats
  • Built test or release infrastructure for a system with a large external integration surface, or maintained CI for an OSS project with heavy outside contribution
  • Strong debugging depth: can enter an unfamiliar codebase and find real root causes, not just symptoms
  • Opinions about what makes a test suite worth trusting
  • Track record of raising quality on a team without becoming the bottleneck
  • Open source contributions on GitHub or similar
Why Join LiteLLM?
  • Own the quality mandate at a high-impact technical company
  • Deep technical ownership, in the codebase, not in meetings
  • Fast-paced environment with real scale behind it
  • Competitive salary and benefits


Ready to own quality at LiteLLM? Apply now!

Similar Jobs

More Jobs at LiteLLM AI Gateway

  • Security Engineer
    $120K — $160K *
    San Francisco, CA 94112 (San Francisco County)
    Information Technology
    In-Person
  • Founding AI Product Engineer
    $120K — $160K *
    San Francisco, CA 94112 (San Francisco County)
    Information Technology
    In-Person
  • Support Engineer
    $90K — $120K *
    San Francisco, CA 94112 (San Francisco County)
    Technical Services
    In-Person
  • Rust Engineer
    $120K — $160K *
    San Francisco, CA 94112 (San Francisco County)
    Enterprise Technology
    In-Person
  • Engineering Manager
    $130K — $180K *
    San Francisco, CA 94112 (San Francisco County)
    Information Technology
    In-Person

More Information Technology Jobs

Find similar Staff Engineer jobs: