Engineering Manager, Model Library

Baseten

$130K — $180K *
Enterprise Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years of experience managing engineering teams focused on developer-facing products.
  • Strong product intuition and technical judgment.
  • Hands-on technical skills to review designs and debug.
  • Excellent written communication and cross-functional collaboration skills.
  • Interest in AI/ML and willingness to gain deep domain knowledge in models.
  • Experience building self-serve workflows.

Responsibilities

  • Lead and mentor a team of engineers, overseeing hiring and career development.
  • Own the Model Library product area from discovery phases to API implementation.
  • Collaborate with product and cross-functional teams to define project scopes and priorities.
  • Maintain technical quality through reviews and architectural guidance.
  • Ensure high product quality by defining success metrics and feedback loops.
  • Cultivate a culture of clear communication and effective teamwork.

Benefits

  • Competitive compensation with equity options.
  • 100% coverage for medical, dental, and vision insurance for employees and dependents.
  • Flexible PTO policy with a company-wide Winter Break.
  • Paid parental leave.
  • Fertility and family-building stipend through Carrot.
  • Company-facilitated 401(k) plan.
  • Opportunities to network with a variety of ML startups.
Full Job Description
THE ROLE:

You'll lead the Model Library team at Baseten - a small, high-ownership team focused on helping developers discover, evaluate, and select the right models for their specific use cases. This role is for a product-minded engineering manager who thrives in ambiguous, high-impact environments and can guide a team from early-stage product thinking through production-quality execution.

You'll stay technically grounded while driving the team's work across model discovery, evaluation frameworks, and the infrastructure that powers a best-in-class model library experience.

EXAMPLE INITIATIVES:
  • Model APIs for frontier models
  • Model training built for production inference
  • Introducing the Baseten Frontier Gateway


RESPONSIBILITIES:
  • Lead and grow a team of engineers, including hiring, mentorship, and career development.
  • Own the Model Library product area end-to-end - from discovery and evaluation experiences to the APIs and tooling developers use to integrate models.
  • Partner with product, ML, and cross-functional stakeholders to define scope, prioritize work, and communicate progress.
  • Maintain a high technical bar through design doc reviews, code reviews, and hands-on architectural guidance.
  • Drive product quality and reliability: define success metrics, establish feedback loops, and ensure a consistent, high-quality developer experience.
  • Foster a culture of strong written communication, clear design thinking, and effective collaboration.


REQUIREMENTS:
  • Experience managing engineers building developer-facing products: APIs, SDKs, or developer tooling.
  • Product intuition and technical judgment - able to balance speed, quality, and developer experience tradeoffs.
  • Technically hands-on enough to review designs, debug issues, and earn the trust of a strong IC team.
  • Strong written communication and cross-functional collaboration skills.
  • Interest in AI/ML and the evolving model landscape; willingness to develop deep domain knowledge (ML expertise not required).
  • Experience building or supporting self-serve workflows.


NICE TO HAVE:
  • Background as an IC in developer tooling, APIs, or ML infrastructure before moving into management.
  • Experience with model evaluation, benchmarking, or comparison frameworks.
  • Familiarity with inference platforms, LLM runtimes, or the model ecosystem (open-source and frontier).


BENEFITS
  • Competitive compensation, including meaningful equity.
  • 100% coverage of medical, dental, and vision insurance for employee and dependents
  • Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
  • Paid parental leave
  • Fertility and family-building stipend through Carrot
  • Company-facilitated 401(k)
  • Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.

Similar Jobs

More Jobs at Baseten

More Enterprise Technology Jobs

Find similar Engineering Manager, Model Library jobs: