Google

Staff Software Engineer, Machine Learning, Google Chat

Google • $207K — $300K *
Sunnyvale, CA 94087In-Person
Information Technology
8 - 10 years of experience
2 weeks ago
Job Overview by Ladders

Qualifications

  • Bachelor's degree in Computer Science, AI, or equivalent experience.
  • 8 years of software engineering experience.
  • 5 years leading technical strategy in ML infrastructure and distributed systems.
  • Proficient in managing the full ML development life-cycle.
  • Experience building and deploying Generative AI systems focusing on latency and cost.
  • Skilled in designing scalable database solutions, particularly using Cloud Spanner.

Responsibilities

  • Lead the transition to an AI-scaled automated evaluation loop while architecting the pipeline.
  • Own and drive the technical roadmap for retrieval augmented generation to enhance Recall@100 and reduce hallucinations.
  • Automate manual processes to significantly decrease Time-to-Resolution for NLU bugs.
  • Optimize AI stack performance and efficiency, focusing on reducing inference costs and latency.
  • Serve as the primary liaison with Google DeepMind and other key stakeholders.

Benefits

  • Comprehensive health insurance coverage.
  • Flexible working hours and remote work options.
  • Professional development opportunities and training.
  • Collaborative and innovative workplace culture.
Full Job Description
Minimum qualifications:
  • Bachelor's degree in Computer Science, Artificial Intelligence, or equivalent practical experience.
  • 8 years of software engineering experience.
  • 5 years of experience leading technical strategy and architecting large-scale ML infrastructure and distributed systems.
  • Experience managing the full ML development life-cycle, from hypothesis and data collection to fine-tuning, evaluation, and post-production monitoring.
  • Experience building, optimizing, and deploying Generative AI systems in production (e.g., Large Language Model (LLMs), RAG, Agentic workflows) with a focus on latency and cost.
  • Experience designing scalable database solutions using Cloud Spanner or similar globally distributed databases.

Preferred qualifications:
  • Master's degree or PhD in Computer Science, Machine Learning, Computer Engineering, or a related highly technical field.
  • Experience optimizing Inference cost (TPU/GPU) and latency for real-time, user-facing applications (e.g., quantization, caching, speculative decoding).
  • Experience in Retrieval Augmented Generation (RAG) architectures, including vector search, embedding optimization, and semantic retrieval strategies.
  • Ability to influence technical roadmaps across organizational boundaries (e.g., partnering with Research/Core ML teams) and translating research into reliable product features.


Responsibilities
  • Lead the shift from reactive manual triage to an AI-scaled, automated evaluation loop, while architecting the pipeline, bridging unstructured user feedback to verifiable Continuous Integration (CI)/Continuous Delivery (CD) code mutation by exploring and driving new techniques.
  • Own the technical roadmap for retrieval augmented generation, driving Recall@100 and eliminating hallucinations by integrating advanced new-generation embedding-based retrieval (EBS), cross-corpus signal ingestion, and vector search methodologies.
  • Automate manual hill-climbing with data-driven frameworks, aiming a reduction in Time-to-Resolution (TTR) for Natural Language Understanding (NLU) bugs, dropping feature development life-cycles from weeks to hours.
  • Optimize the performance and efficiency of the AI stack, leading initiatives to reduce inference costs through TPU/GPU utilization improvements and minimizing end-to-end latency for real-time features.
  • Act as the primary technical liaison with Google DeepMind, Core Machine Learning, Product Managers and other Workspace pillars.

About Google

Google is a multinational technology company that specializes in Internet-related services and products. These include online advertising technologies, search engine, cloud computing, software, and hardware. Google was founded in 1998 by Larry Page and Sergey Brin while they were Ph.D. students at Stanford University. The company has grown tremendously since then and has become one of the most valuable companies in the world. Google's mission is to organize the world's information and make it universally accessible and useful.
Learn more about Google
Size
156,500 employees
Market Cap
$1,115.4 billion
Industry
Enterprise Technology
Net Income
$40.2 billion
Founded
1998
5 Year Trend
+23.3%
Revenue
$182.5 billion
NASDAQ
GOOGL
* Ladders Estimates

Similar Jobs

Ad banner background

Get Ready For Your
Next Interview

More Jobs at Google

More Information Technology Jobs

Find similar Staff Software Engineer, Machine Learning, Google Chat jobs:

NationwideSunnyvale, CA