Founding AI Product Engineer

LiteLLM AI Gateway

$120K — $160K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's or Master's degree in Computer Science or a related field.
  • Strong software engineering fundamentals.
  • Experience building production software, preferably with Python.
  • Ability to work across the tech stack (backend, frontend, infrastructure, APIs).
  • Strong product intuition with customer usage insight.
  • Exceptional written and verbal communication skills.
  • Natural problem-solver with a high sense of ownership.
  • Comfortable making decisions amidst uncertainty.

Responsibilities

  • Build new product features from concept to production.
  • Work directly with customers to understand their pain points and validate solutions.
  • Ship quickly while ensuring high quality.
  • Prototype new ideas and iterate based on user feedback.
  • Own major product areas and implement continuous improvements.
  • Design backend APIs and services using Python and FastAPI.
  • Create intuitive developer experiences across the API, dashboard, and CLI.
  • Collaborate with founders on product direction and technical choices.
  • Contribute to the development of LiteLLM’s second major product.

Benefits

  • Work directly with the founders every day.
  • Build products used by thousands of engineering teams globally.
  • Own significant product decisions, not just implementation tasks.
  • Experience fast-paced production with immediate impact.
  • Shape the future of AI infrastructure and developer tools.
  • Competitive salary, equity, health, dental, and vision benefits.
Full Job Description
Product Engineer

We9re looking for a Product Engineer who wants to work directly with the founders to figure out what developers need, ship quickly, and build products that thousands of engineering teams use every day.
About the Role

This isn9t a traditional product management role, and it isn9t a traditional software engineering role.

You9ll spend your time talking to customers, understanding their problems, designing solutions, writing production code, and shipping features. One week you might build a new authentication flow, the next week you9re redesigning an onboarding experience, integrating with a new provider, or launching an entirely new product.

If you enjoy owning a problem end-to-end-from idea to production-you9ll thrive here.
Responsibilities
  • Build new product features from concept to production.
  • Work directly with customers to understand pain points and validate solutions.
  • Ship quickly while maintaining a high quality bar.
  • Prototype new ideas and iterate based on user feedback.
  • Own major product areas and continuously improve them over time.
  • Design backend APIs and services using Python and FastAPI.
  • Build intuitive developer experiences across our API, dashboard, and CLI.
  • Collaborate directly with the founders on product direction and technical decisions.
  • Help define and build LiteLLM9s second major product.
What We9re Looking For
  • Bachelor9s or Master9s degree in Computer Science or a related field.
  • Strong software engineering fundamentals.
  • Experience building production software, preferably with Python.
  • Comfortable moving across the stack when needed (backend, frontend, infrastructure, APIs).
  • Strong product intuition and curiosity about how customers use software.
  • Excellent written and verbal communication.
  • High ownership-you naturally identify problems and solve them without waiting to be asked.
  • Comfortable operating in ambiguity and making decisions with incomplete information.
  • Excited by shipping quickly and learning from real users.
Bonus Points
  • Experience at an early-stage startup.
  • Experience building developer tools or infrastructure products.
  • Open source contributions.
  • You9ve built and launched your own product.
  • Familiarity with AI infrastructure, LLMs, or developer platforms.
Why Join LiteLLM?
  • Work directly with the founders every day.
  • Build products used by thousands of engineering teams around the world.
  • Own meaningful product decisions-not just implementation.
  • Move incredibly fast and see your work in production immediately.
  • Help define the future of AI infrastructure and developer tooling.
  • Competitive salary, equity, health, dental, and vision benefits.

Similar Jobs

More Jobs at LiteLLM AI Gateway

  • Support Engineer
    $90K — $120K *
    San Francisco, CA 94112 (San Francisco County)
    Technical Services
    In-Person
  • Rust Engineer
    $120K — $160K *
    San Francisco, CA 94112 (San Francisco County)
    Enterprise Technology
    In-Person
  • Engineering Manager
    $130K — $180K *
    San Francisco, CA 94112 (San Francisco County)
    Information Technology
    In-Person
  • Head of Strategy and Operations
    $200K — $300K *
    San Francisco, CA 94112 (San Francisco County)
    Enterprise Technology
    In-Person
  • Backend Engineer
    $120K — $160K *
    San Francisco, CA 94112 (San Francisco County)
    Information Technology
    In-Person

More Information Technology Jobs

Find similar Founding AI Product Engineer jobs: