Minimum qualifications:- Bachelor's degree in Computer Science, Machine Learning, a related technical field, or equivalent practical experience.
- 3 years of experience with software development in Python or C .
- Experience with ML frameworks (e.g., PyTorch, TensorFlow, JAX), crafting model evaluations and hillclimbing model performance.
Preferred qualifications:- Advanced degree (Master's or PhD) in Machine Learning, Computer Science, or a related technical field.
- 2 years of experience designing benchmark suites and advancing model quality.
- Experience with Large Language Model (LLM) orchestration, routing, or multi-agent workflows.
- Strong cross-functional leadership and communication skills to effectively work across engineering, research, and product teams.
About the jobAt Google, research-focused Software Engineers are embedded throughout the company, allowing them to setup large-scale tests and deploy promising ideas quickly and broadly. Ideas may come from internal projects as well as from collaborations with research programs at partner universities and technical institutes all over the world.
From creating experiments and prototyping implementations to designing new architectures, engineers work on real-world problems including artificial intelligence, data mining, natural language processing, hardware and software performance analysis, improving compilers for mobile platforms, as well as core search and much more. But you stay connected to your research roots as an active contributor to the wider research community by partnering with universities and publishing papers.
We are a full-stack modeling team. In this role, you will develop rigorous evaluations to motivate directions for model improvements, hillclimb to improve the model itself, and collaborate with product teams to ensure an effective feedback loop as our solutions aim for efficiency at Google scale via techniques like routing, and are adaptable to standalone and multi-agent systems.
Individual pay is determined by factors including job-related skills, experience, and relevant education or training.
US: $174000 - $252000 (USD) 15% bonus target equity benefits
Learn more about benefits at Google .
Responsibilities- Build rigorous evaluations to systematically measure model performance across various workloads and drive continuous quality hillclimbing.
- Develop modular, adaptable solutions that enable seamless integration across multiple Google product areas.
- Collaborate cross-functionally with Eng, PM, and Data Science partners to translate product requirements and feedback into model quality improvements.
