Google

Technical Program Manager, Gemini Evals, DeepMind

Google$217K — $237K *
Enterprise Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree in Computer Science, Engineering, Data Science, or equivalent experience.
  • 5 years of experience leading engineering projects across multiple geographies and time zones.
  • Experience in managing people.
  • Familiarity with Large Language Model (LLM) evaluations, model training, and model releases.
  • Ability to learn and understand complex technical systems and facilitate discussions about them.
  • Strong skills in managing stakeholder relationships.

Responsibilities

  • Collaborate with engineering to support infrastructure development and prioritize issues.
  • Work with data scientists to design model evaluations and perform loss analysis.
  • Manage compute capacity for the Gemini autorater platform and eval area.
  • Provide stakeholders with proactive project status updates and handle autorater issues effectively.
  • Drive strategic and tactical goals while identifying and addressing workflow optimization opportunities.

Benefits

  • 15% bonus target.
  • Equity benefits.
  • Comprehensive health and wellness programs.
  • Flexible work environment and support for work-life balance.
Full Job Description
Minimum qualifications:
  • Bachelor's degree in Computer Science, Engineering, Data Science, related technical field, or equivalent practical experience.
  • 5 years of experience leading engineering projects across multiple geographies and time zones.

Preferred qualifications:
  • Experience in people management.
  • Experience in Large Language Model (LLM) evals, model training, model releases, or data science.
  • Ability to quickly learn and deeply understand the technical aspects of the programs from interface to infrastructure, serving, and customer issues, and drive technical discussions.
  • Excellent skills in managing complex stakeholder relationships.


About the job

Google's projects, like our users, span the globe and require managers to keep the big picture in focus while being able to dive into the unique engineering challenges we face daily. As a Technical Program Manager at Google, you lead complex, multi-disciplinary engineering projects using your engineering expertise. You plan requirements with internal customers and usher projects through the entire project lifecycle. This includes managing project schedules, identifying risks and clearly communicating them to project stakeholders. You're equally at home explaining your team's analyses and recommendations to executives as you are discussing the technical trade-offs in product development with engineers.

Using your extensive technical and leadership expertise, you manage projects of various size and scope, identifying future opportunities, improving processes and driving the technical directions of your programs.

Individual pay is determined by factors including job-related skills, experience, and relevant education or training.

US: $217000 - $237000 (USD) 15% bonus target equity benefits

Learn more about benefits at Google .

Responsibilities
  • Collaborate closely with the engineering team to support infrastructure development, meticulously track priorities, issues, deeply understand evaluation and experimentation results; coordinate alignment and, assessment with model teams.
  • Collaborate with data scientists to design and integrate model evals, execute evals, and conduct loss analysis to inform model quality.
  • Manage Gemini autorater platform and Gemini eval area compute capacity planning. Provide proactive status updates to stakeholders, and effectively triage autorater issues back to the modeling team.
  • Drive strategic goals and tactical delivery. Lead with high agency. Proactively identify workflow gaps and implement scalable improvements to optimize efficiency and output quality.


About Google

Google is a multinational technology company that specializes in Internet-related services and products. These include online advertising technologies, search engine, cloud computing, software, and hardware. Google was founded in 1998 by Larry Page and Sergey Brin while they were Ph.D. students at Stanford University. The company has grown tremendously since then and has become one of the most valuable companies in the world. Google's mission is to organize the world's information and make it universally accessible and useful.
Learn more about Google
Size
156,500 employees
Market Cap
$1,115.4 billion
Industry
Net Income
$40.2 billion
Founded
1998
5 Year Trend
+23.3%
Revenue
$182.5 billion
NASDAQ

Similar Jobs

More Jobs at Google

More Enterprise Technology Jobs

Find similar Technical Program Manager, Gemini Evals, DeepMind jobs: