Google

Technical Program Manager III, AI/ML Evaluations, Search

Google$163K — $236K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree in a technical field or equivalent experience.
  • 5 years of experience in program management.
  • Expertise in AI/ML evaluation methodologies and data quality.
  • Experience with generative AI tools and LLM integration into workflows.
  • Preferred: 5 years managing cross-functional projects.
  • Preferred: Experience in Machine Learning.

Responsibilities

  • Collaborate with product, engineering, and research teams to identify evaluation needs.
  • Design and pilot new evaluation methodologies and tools.
  • Oversee the complete delivery of evaluations for various product areas.
  • Communicate evaluation quality and project progress to stakeholders.
  • Develop dashboards and reports to monitor key quality metrics.

Benefits

  • 15% bonus target
  • Equity opportunities
  • Comprehensive health coverage
  • Retirement savings plans
  • Paid time off and holidays
Full Job Description
Minimum qualifications:
  • Bachelor's degree in a technical field, or equivalent practical experience.
  • 5 years of experience in program management.
  • Experience in AI/ML evaluation methodologies, data quality, and process improvement.
  • Experience integrating generative AI tools or Large Language Model (LLM) interfaces into workflows.

Preferred qualifications:
  • 5 years of experience managing cross-functional or cross-team projects.
  • Experience in Machine Learning.


Responsibilities
  • Engage with product, engineering, and research teams to identify and understand new and future evaluation requirements.
  • Design, prototype, and pilot new evaluation methodologies, frameworks, and tooling to address unmet needs.
  • Manage the end-to-end delivery of evaluations for eval and emerging use cases and product areas (e.g., Multimodal, Personalization).
  • Communicate effectively with cross-functional stakeholders on evaluation quality, progress on emerging needs, and potential risks.
  • Develop and maintain dashboards and reports to track key metrics related to quality, throughput, and the impact of the team's work.


Individual pay is determined by factors including job-related skills, experience, and relevant education or training.

US: $163000 - $236000 (USD) 15% bonus target equity benefits

Learn more about benefits at Google .

About Google

Google is a multinational technology company that specializes in Internet-related services and products. These include online advertising technologies, search engine, cloud computing, software, and hardware. Google was founded in 1998 by Larry Page and Sergey Brin while they were Ph.D. students at Stanford University. The company has grown tremendously since then and has become one of the most valuable companies in the world. Google's mission is to organize the world's information and make it universally accessible and useful.
Learn more about Google
Size
156,500 employees
Market Cap
$1,115.4 billion
Industry
Net Income
$40.2 billion
Founded
1998
5 Year Trend
+23.3%
Revenue
$182.5 billion
NASDAQ

Similar Jobs

More Jobs at Google

More Information Technology Jobs

Find similar Technical Program Manager III, AI/ML Evaluations, Search jobs: