OpenAI

Performance Modeling Lead

OpenAI • $130K — $180K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Experience owning or building performance modeling frameworks for system design decisions.
  • Deep knowledge of AI/ML workloads, including large-scale training and inference.
  • Understanding of system-level tradeoffs in distributed systems for compute, memory, and networking.
  • Comfortable operating across different abstraction layers from workload behavior to hardware.
  • Experience using modeling techniques for architectural decision-making.
  • Ability to structure analysis in ambiguous problem spaces.
  • Strong communication skills to influence teams and partners.

Responsibilities

  • Build and own a performance modeling framework/toolchain for AI systems evaluation.
  • Analyze architectural tradeoffs in compute, memory, networking, storage, and topology.
  • Develop performance models for scale-up vs. scale-out architectures and interconnect designs.
  • Translate modeling outputs into actionable recommendations for teams and vendors.
  • Influence reference designs and vendor strategies with data-driven insights.
  • Collaborate closely with machines learning, systems, and hardware teams to assess workload needs.
  • Lead and grow a small team of engineers, setting technical direction and standards.
  • Enhance modeling accuracy by validating against real system measurements.

Benefits

  • Hybrid work model of 3 days in the office per week.
  • Relocation assistance offered.
Full Job Description
About the Role

We are seeking a Performance Modeling Lead to build and lead a small, high-impact team responsible for answering forward-looking architectural questions across AI infrastructure systems.

You will develop modeling frameworks and methodologies to evaluate system-level tradeoffs and guide key design decisions. Your work will directly influence reference architectures, vendor designs, and long-term infrastructure strategy.

This role sits at the intersection of AI workloads, system architecture, and quantitative modeling, and requires strong technical judgment, ownership, and the ability to translate complex analysis into clear, actionable guidance.

This role is based in San Francisco, CA. We use a hybrid work model of 3 days in the office per week and offer relocation assistance.

Key Responsibilities
  • Build and own a performance modeling framework/toolchain to evaluate AI systems across multiple levels of abstraction.
  • Analyze and quantify architectural tradeoffs across compute, memory, networking, storage, and system topology.
  • Develop performance models to guide decisions on:
    • scale-up vs. scale-out architectures
    • interconnect and network design
    • memory hierarchy and system balance.
  • Translate modeling outputs into clear recommendations for internal teams and external hardware vendors.
  • Influence reference designs and vendor roadmaps through data-driven insights.
  • Partner closely with machine learning, systems, and hardware teams to understand workload characteristics and requirements.
  • Lead and grow a small team (2-3 engineers), setting technical direction and maintaining high standards for modeling rigor.
  • Continuously improve modeling fidelity by validating against real system behavior and measurements.


Qualifications
  • Have experience owning or building performance modeling frameworks used to drive real system design decisions.
  • Have deep knowledge of AI/ML workloads, including training and/or inference at scale.
  • Understand system-level tradeoffs across compute, memory, and networking in large-scale distributed systems.
  • Are comfortable working across abstraction layers-from workload behavior to hardware implementation.
  • Have experience using modeling (analytical or simulation) to inform architectural decisions.
  • Can operate in ambiguous problem spaces and turn open-ended questions into structured analysis.
  • Communicate clearly and influence both internal teams and external partners.


Preferred Skills
  • Experience working with hardware vendors (ODM/JDM, silicon, networking).
  • Background in data center infrastructure or hyperscale systems.
  • Familiarity with accelerators (GPUs/ASICs) and interconnects (e.g., NVLink, InfiniBand, Ethernet).
  • Experience influencing hardware roadmaps or reference architectures.
  • Prior experience leading or mentoring engineers.

About OpenAI

OpenAI is an artificial intelligence research laboratory consisting of the for-profit corporation OpenAI LP and its parent company, the non-profit OpenAI Inc. The company was founded in 2015 by a group of technology leaders, including Elon Musk, Sam Altman, Greg Brockman, Ilya Sutskever, and John Schulman. OpenAI's mission is to develop and promote friendly AI for the betterment of humanity. The company has developed a number of cutting-edge AI technologies, including GPT-3, a language processing system that can generate human-like text. OpenAI has received funding from a number of high-profile investors, including LinkedIn co-founder Reid Hoffman and venture capitalist Peter Thiel.
Learn more about OpenAI
Size
100 employees
Industry
Founded
2015

Similar Jobs

More Jobs at OpenAI

More Information Technology Jobs

Find similar Performance Modeling Lead jobs: