Google

Staff Software Engineer, Generative AI, Core Machine Learning

Google$207K — $300K *
Information Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree or equivalent practical experience.
  • 8 years of experience in software development.
  • 5 years leading ML design and optimizing ML infrastructure.
  • 5 years with Speech/audio technology or reinforcement learning.
  • 5 years testing and launching software products.
  • 1 year building Generative AI or agentic applications.

Responsibilities

  • Generalize horizontal tools into reusable services for automated learning.
  • Apply design principles to convert prompts into efficient code-based workflows.
  • Conduct architectural reviews to eliminate inefficiencies in reasoning chains.
  • Extend automated prompt optimization to support multi-step workflows.
  • Implement code safety enforcements within the agent platform.

Benefits

  • Comprehensive health coverage.
  • Paid time off and holidays.
  • Retirement savings plan with company matching.
  • Professional development opportunities.
  • Wellness programs and resources.
Full Job Description
Minimum qualifications:
  • Bachelor's degree or equivalent practical experience.
  • 8 years of experience in software development.
  • 5 years of experience leading ML design and optimizing ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).
  • 5 years of experience with one or more of the following: Speech/audio (e.g., technology duplicating and responding to the human voice), reinforcement learning (e.g., sequential).
  • 5 years of experience testing, and launching software products.
  • 1 year of experience in building Generative AI or agentic applications.

Preferred qualifications:
  • Master's degree or PhD in Engineering, Computer Science, or a ML-related technical field.
  • 8 years of experience with data structures and algorithms.
  • 3 years of experience in a technical leadership role leading project teams and setting technical direction.
  • 3 years of experience working in a complex, matrixed organization involving cross-functional, or cross-business projects.
  • Production experience in applying ML related features to a scalable system.


With your technical expertise you will manage project priorities, deadlines, and deliverables. You will design, develop, test, deploy, maintain, and enhance software solutions.

In this role, you will transform the development of AI agents from an artisanal craft into an engineering discipline to achieve high-quality, reliability with multi-folds efficiency gains across Google. You will architect and productionize horizontal infrastructure, including generalized Knowledge Store libraries and self-reflection modules. You will apply core design principles, lead deep audits of high-impact agents to extract deterministic logic from monolithic prompts into efficient, code-based workflows. You will scale automated prompt optimization and trace scanning tools to systematically eliminate waste and solve the "GenAI engineering gap" for teams building production-ready agents. Your work will bridge the gap between experimental prototypes and scalable production infrastructure.

The US base salary range for this full-time position is $207,000-$300,000 bonus equity benefits. Our salary ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about benefits at Google .

Responsibilities
  • Generalize horizontal tools, including a plug-in Knowledge Store and a Self-Reflection module, into reusable services that any agent can adopt to enable automated learning and improvement.
  • Apply validated design principles to transition deterministic logic from monolithic prompts into efficient, code-based workflows that maximize reasoning value and ensure precise context control.
  • Execute deep architectural reviews and automated trace scanning for high-impact agents to eliminate structural inefficiencies and redundant tool calls in multi-turn reasoning chains.
  • Extend automated prompt optimization frameworks to support multi-step workflows, enabling systematic improvement of both efficiency and quality across the agent ecosystem.
  • Implement code-level safety enforcements and structured tool return patterns within the agent platform to ensure reliability and correctness on deterministic subtasks.


About Google

Google is a multinational technology company that specializes in Internet-related services and products. These include online advertising technologies, search engine, cloud computing, software, and hardware. Google was founded in 1998 by Larry Page and Sergey Brin while they were Ph.D. students at Stanford University. The company has grown tremendously since then and has become one of the most valuable companies in the world. Google's mission is to organize the world's information and make it universally accessible and useful.
Learn more about Google
Size
156,500 employees
Market Cap
$1,115.4 billion
Industry
Net Income
$40.2 billion
Founded
1998
5 Year Trend
+23.3%
Revenue
$182.5 billion
NASDAQ

Similar Jobs

More Jobs at Google

More Information Technology Jobs

Find similar Staff Software Engineer, Generative AI, Core Machine Learning jobs: