Google

Staff Software Engineer, AutoCloud, Context and Memory

Google$207K — $300K *
Enterprise Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree in Computer Science, AI/ML, Data Systems, Information Retrieval, or equivalent experience.
  • 8 years of software development experience.
  • 5 years in testing and launching software products; 3 years in software design and architecture.
  • 5 years leading ML design and optimizing ML infrastructure.
  • 2 years of experience with GenAI techniques and concepts.
  • 2 years building infrastructure on cloud platforms.

Responsibilities

  • Own the architecture and roadmap for agent memory systems and hybrid search platforms.
  • Lead the design of low-latency context caching and dynamic context synthesis.
  • Architect high-throughput distributed systems and automated benchmarking frameworks.
  • Ensure compliance with multi-tenancy standards and data isolation policies.
  • Collaborate with research partners and mentor engineers in architecture.

Benefits

  • 20% bonus target
  • Equity benefits
  • Access to extensive learning and development programs
  • Comprehensive health and wellness benefits
  • Flexible vacation and leave policies.
Full Job Description
Minimum qualifications:
  • Bachelor's degree in Computer Science, AI/ML, Data Systems, Information Retrieval, a related technical field, or equivalent practical experience.
  • 8 years of experience in software development.
  • 5 years of experience testing, and launching software products, and 3 years of experience with software design and architecture.
  • 5 years of experience leading ML design and optimizing ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).
  • 2 years of experience with GenAI techniques (e.g., LLMs, Multi-Modal, Large Vision Models) or with GenAI-related concepts (language modeling, computer vision).
  • 2 years of experience building infrastructure on cloud platforms.

Preferred qualifications:
  • Master's degree or PhD in Engineering, Computer Science, or a related technical field.
  • Experience building low-latency, high-availability distributed storage systems and APIs on major cloud platforms.
  • Expertise in agent memory (working/episodic), context caching, token pruning, vector search, and knowledge graphs.
  • Ability to define technical roadmaps, author comprehensive design docs, and align multi-organization stakeholders. Demonstrated skill in coaching engineers and clearly communicating complex architectures to leadership and research partners.
  • Track record in hybrid search, graph databases, and querying complex cloud telemetry and topology.
  • Background in engineering secure, multi-tenant cloud architectures with strict data isolation and compliance controls.


About the job
AutoCloud is Google Cloud's autonomous, AI-powered cloud management portfolio. We are transforming how enterprise customers design, deploy, operate, investigate, and optimize their workloads and infrastructure across Google Cloud Platform (GCP). In this role, you will be the principal technical authority guiding the design of scalable memory architectures, solving complex state retrieval issues, and partnering with Principal Engineers, researchers across DeepMind, and partner teams across Google Cloud to deliver a high-precision, low-latency, and secure context platform for autonomous operations.
Individual pay is determined by factors including job-related skills, experience, and relevant education or training.

US: $207000 - $300000 (USD) 20% bonus target equity benefits

Learn more about benefits at Google .

Responsibilities
  • Own the end-to-end architecture, technical roadmap, and core goal for agent memory systems, dynamic context synthesis pipelines, graph-based cloud representations, and hybrid search/RAG platforms.
  • Lead the design and implementation of low-latency context caching, token compression/pruning strategies, working memory buffers, and long-term episodic knowledge stores for autonomous agents.
  • Architect high-throughput, low-latency distributed systems and automated benchmarking frameworks to ensure sub-second cloud state aggregation, high retrieval recall, and hallucination mitigation.
  • Ensure all context and memory subsystems meet stringent enterprise-grade multi-tenancy standards, tenant data isolation policies, compliance mandates, and fine-grained access controls.
  • Partner across research (e.g., DeepMind) and platform service teams to standardize shared context models and APIs, while mentoring engineers and upholding architectural review standards.


About Google

Google is a multinational technology company that specializes in Internet-related services and products. These include online advertising technologies, search engine, cloud computing, software, and hardware. Google was founded in 1998 by Larry Page and Sergey Brin while they were Ph.D. students at Stanford University. The company has grown tremendously since then and has become one of the most valuable companies in the world. Google's mission is to organize the world's information and make it universally accessible and useful.
Learn more about Google
Size
156,500 employees
Market Cap
$1,115.4 billion
Industry
Net Income
$40.2 billion
Founded
1998
5 Year Trend
+23.3%
Revenue
$182.5 billion
NASDAQ

Similar Jobs

More Jobs at Google

More Enterprise Technology Jobs

Find similar Staff Software Engineer, AutoCloud, Context and Memory jobs: