OpenAI

Engineering Manager, Model Flywheel

OpenAI$150K — $200K *
Consumer Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5-7 years experience in engineering leadership roles within complex environments.
  • Successful history of scaling production systems, particularly in AI or large backend services.
  • In-depth knowledge of model-driven product development and deployment processes.
  • Strong communication skills, effectively liaising with engineering, research, and product teams.
  • Experience with large language models or experimentation frameworks is favorable.

Responsibilities

  • Elevate and unify ChatGPT's harness and context management frameworks.
  • Drive enhancements for multi-tier model experiences.
  • Develop and scale self-service experiment capabilities with automated safeguards.
  • Lead automation efforts for model rollouts, capacity management, and system health monitoring.
  • Create and refine comprehensive measurement systems for model quality.

Benefits

  • Opportunity to shape the future of AI reliability and usability.
  • Collaborate with cross-functional teams and various experts in the field.
  • Engage with cutting-edge technology and model capabilities.
  • Potential for career growth within a pioneering organization.
  • Focus on innovation through rapid experimentation and continuous improvement.
Full Job Description
About the Team

The ChatGPT Model Capabilities and Deployment team unified goal is to transform model advancements into great ChatGPT user experiences through reliable serving, rapid experimentation, safe deployment, and continuous improvement.

Team Focus Areas
  • Model Experimentation:
    • Enable rapid, safe model validation for ChatGPT and Codex products through experiment automation and lifecycle management.
  • Model Deployment:
    • Ensure safe, scalable deployment of model capabilities with robust rollout and operational tooling.
    • Automate capacity management and incorporate platform-wide health monitors.
  • Model Measurement:
    • Build comprehensive evaluation and measurement systems for model quality, from user signals to launch scorecards.
    • Improve end-to-end feedback loops for continual model improvement.

Key Partnerships

Collaborate cross-functionally with teams including Model Measurement DS, Research, Codex, Fleet, Inference, and API.

In this role, you will:
  • Elevate and consolidate ChatGPT's harness, context management, and system prompt frameworks.
  • Drive expansion and improvement of multi-tier model experiences.
  • Support and scale self-serve experiment capabilities and automated guardrails.
  • Lead model rollout automation, capacity management, and health monitoring.
  • Shape end-to-end measurement systems (evals, grader signals, user feedback, etc.).

You might thrive in this role if you have:
  • Proven experience leading engineering teams in complex, cross-functional environments.
  • Demonstrated success shipping production systems at scale (ideally for AI or large backend services).
  • Deep understanding of model-driven product development, deployment lifecycle, and measurement tooling.
  • Excellent communication and collaboration skills-experience interfacing directly with engineering, research, and product stakeholders.
  • Prior involvement with large language models, distributed infrastructure, or experimentation platforms is a plus.

If you're passionate about advancing AI reliability, safety, and user impact at a global scale, we encourage you to apply!

About OpenAI

OpenAI is an artificial intelligence research laboratory consisting of the for-profit corporation OpenAI LP and its parent company, the non-profit OpenAI Inc. The company was founded in 2015 by a group of technology leaders, including Elon Musk, Sam Altman, Greg Brockman, Ilya Sutskever, and John Schulman. OpenAI's mission is to develop and promote friendly AI for the betterment of humanity. The company has developed a number of cutting-edge AI technologies, including GPT-3, a language processing system that can generate human-like text. OpenAI has received funding from a number of high-profile investors, including LinkedIn co-founder Reid Hoffman and venture capitalist Peter Thiel.
Learn more about OpenAI
Size
100 employees
Industry
Founded
2015

Similar Jobs

More Jobs at OpenAI

More Consumer Technology Jobs

Find similar Engineering Manager, Model Flywheel jobs: