What you will be working onSkills: Python, LLM APIs, FastAPI
As the Backend LLM Engineer, you'll be responsible for ensuring LiteLLM unifies the format for calling LLM APIs in the broader OpenAI + Anthropic spec. This involves writing transformations to convert API requests from OpenAI/Anthropic spec to various LLM provider formats, building provider-agnostic unification functionality (e.g. session management across non-openai models for /v1/responses API, etc.). You'll work directly with the CEO and CTO on critical projects including:
- System design for supporting provider level features at the gateway level (skills, compaction, batches, etc.)
- Thinking about the developer experience - to support millions of users who leverage your work via LiteLLM's Python SDK
- Building across LLM's, MCP's, and Agents by maintaining an excellent LLM interoperability layer, supporting a wide range of MCP Auth flows and enabling various Agent use-cases
What is our tech stackThe tech stack includes Python, FastAPI, Redis, Postgres.
Who we are looking for- 1-2 years of backend/full-stack experience with production systems
- Passion for open source and user engagement
- Experience working with the OpenAI api (understand the difference between /chat/completions and /responses, and can speak to API-specific nuances)
- Strong work ethic and ability to thrive in small teams
- Eagerness to talk to users and help solve real problems
Why Join LiteLLM?- Work directly with the founders every day.
- Build products used by thousands of engineering teams around the world.
- Own meaningful product decisions-not just implementation.
- Move incredibly fast and see your work in production immediately.
- Help define the future of AI infrastructure and developer tooling.
- Competitive salary, equity, health, dental, and vision benefits.
