Minimum qualifications:

• Bachelor's degree or equivalent practical experience.
• 8 years of experience in software development.
• 5 years of experience testing, and launching software products, and 3 years of experience with software design and architecture.
• 5 years of experience leading ML design and optimizing ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).
• 2 years of experience with GenAI techniques (e.g., LLMs, Multi-Modal, Large Vision Models) or with GenAI-related concepts (e.g., language modeling, computer vision).

Preferred qualifications:

• Master's degree or PhD in Engineering, Computer Science, or a related technical field.
• 8 years of experience with data structures/algorithms.
• 8 years of experience with software development in Python or Kotlin.
• 3 years of experience in a technical leadership role leading project teams and setting technical direction.
• 3 years of experience working in a complex, matrixed organization involving cross-functional, or cross-business projects.

About the job

With your technical expertise you will manage project priorities, deadlines, and deliverables. You will design, develop, test, deploy, maintain, and enhance software solutions.

Labs is a group focused on incubating early-stage efforts in support of Google's mission to organize the world's information and make it universally accessible and useful. Our team exists to help discover and create new ways to advance our core products through exploration and the application of new technologies. We work to build new solutions that have the potential to transform how users interact with Google. Our goal is to drive innovation by developing new Google products and capabilities that deliver significant impact over longer timeframes.

The US base salary range for this full-time position is $207,000-$300,000 bonus equity benefits. Our salary ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about benefits at Google .

Responsibilities

• Design, write, run, and maintain robust evaluations specifically for NotebookLM Chat and Content Studio features.
• Iteratively improve our evaluation infrastructure, including monitoring, logging, alerting, and experimenting.
• Become an expert on the core Chat and Content Studio user experiences and their underlying model interactions.
• Collaborate with product and engineering teams to define quality metrics and launch new evaluation flows.
• Keep up-to-date on evaluation techniques for LLMs and generative content tools.