Engineering Manager, Model Library

Baseten

$150K — $180K *
Enterprise Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5-7 years of experience managing engineers in developer-facing products like APIs or SDKs
  • Strong product intuition with the ability to balance speed, quality, and developer experience
  • Technical knowledge to conduct design reviews and debug issues
  • Excellent written communication and collaboration skills across teams
  • Keen interest in AI/ML with a willingness to deepen domain expertise
  • Experience in building self-serve workflows

Responsibilities

  • Lead and grow a team of engineers through hiring, mentorship, and career development
  • Own the end-to-end Model Library product area, focusing on discovery and evaluation experiences
  • Collaborate with product, ML, and cross-functional stakeholders to define scope and prioritize work
  • Maintain high technical standards through design and code reviews, along with architectural guidance
  • Ensure product quality and reliability by defining success metrics and feedback loops
  • Cultivate a culture of strong written communication and effective teamwork

Benefits

  • Competitive compensation with substantial equity options
  • Full medical, dental, and vision insurance coverage for employees and their dependents
  • Flexible PTO policy, including a company-wide Winter Break
  • Paid parental leave provisions
  • Support for fertility and family-building through Carrot
  • Facilitated 401(k) company contributions
  • Opportunities to engage with a diverse range of ML startups for learning and networking
Full Job Description
THE ROLE:

You'll lead the Model Library team at Baseten - a small, high-ownership team focused on helping developers discover, evaluate, and select the right models for their specific use cases. This role is for a product-minded engineering manager who thrives in ambiguous, high-impact environments and can guide a team from early-stage product thinking through production-quality execution.

You'll stay technically grounded while driving the team's work across model discovery, evaluation frameworks, and the infrastructure that powers a best-in-class model library experience.

EXAMPLE INITIATIVES:
  • Model APIs for frontier models
  • Model training built for production inference
  • Introducing the Baseten Frontier Gateway


RESPONSIBILITIES:
  • Lead and grow a team of engineers, including hiring, mentorship, and career development.
  • Own the Model Library product area end-to-end - from discovery and evaluation experiences to the APIs and tooling developers use to integrate models.
  • Partner with product, ML, and cross-functional stakeholders to define scope, prioritize work, and communicate progress.
  • Maintain a high technical bar through design doc reviews, code reviews, and hands-on architectural guidance.
  • Drive product quality and reliability: define success metrics, establish feedback loops, and ensure a consistent, high-quality developer experience.
  • Foster a culture of strong written communication, clear design thinking, and effective collaboration.


REQUIREMENTS:
  • Experience managing engineers building developer-facing products: APIs, SDKs, or developer tooling.
  • Product intuition and technical judgment - able to balance speed, quality, and developer experience tradeoffs.
  • Technically hands-on enough to review designs, debug issues, and earn the trust of a strong IC team.
  • Strong written communication and cross-functional collaboration skills.
  • Interest in AI/ML and the evolving model landscape; willingness to develop deep domain knowledge (ML expertise not required).
  • Experience building or supporting self-serve workflows.


NICE TO HAVE:
  • Background as an IC in developer tooling, APIs, or ML infrastructure before moving into management.
  • Experience with model evaluation, benchmarking, or comparison frameworks.
  • Familiarity with inference platforms, LLM runtimes, or the model ecosystem (open-source and frontier).


BENEFITS
  • Competitive compensation, including meaningful equity.
  • 100% coverage of medical, dental, and vision insurance for employee and dependents
  • Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
  • Paid parental leave
  • Fertility and family-building stipend through Carrot
  • Company-facilitated 401(k)
  • Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.

Similar Jobs

More Jobs at Baseten

More Enterprise Technology Jobs

Find similar Engineering Manager, Model Library jobs: