Google

Backend Engineer, AI Systems

Google$176K — $194K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree in Computer Science or related field, or equivalent experience
  • 5 years of software design and full stack development experience
  • Python programming skills with production experience
  • Experience with LLMs, AI agents, and RAG pipelines
  • Understanding of LLM behavior and limitations in production
  • Experience with Google Cloud Platform (GCP)

Responsibilities

  • Drive the lifecycle of agent implementation from design to production
  • Test and optimize AI agents and pipelines to meet performance targets
  • Implement and optimize REST APIs for integration
  • Debug and support production systems in real-time
  • Define best practices for scalable and fault-tolerant design
  • Collaborate with developers and product managers for end-to-end solutions
  • Create and maintain technical documentation
  • Deploy and manage containerized services on Google Kubernetes Engine or Cloud Run
  • Implement monitoring for AI agent behaviors using cloud observability tools

Benefits

  • Comprehensive health coverage
  • Flexible working hours
  • Professional development opportunities
  • Work in innovative AI projects
  • Dynamic and collaborative team environment
Full Job Description
Role Description

In this role you'll work with the team that is building cutting-edge agentic AI chat assistants that help our customers resolve issues faster and more effectively. This is a hands-on role where you'll own features end-to-end, from design through deployment and production support.

This role requires a strong understanding of microservice architecture, RESTful APIs, design patterns, and distributed systems, along with the emerging AI trends and expertise in modern AI systems.

In this role, you'll:
  • Drive the full lifecycle of agent implementation, from initial design to a live, high-performing production environment using RAG, MCP, and agentic architectures
  • Test, evaluate, and fine-tune AI agents, RAG pipelines, and Model Context Protocol (MCP) implementations to hit strict performance targets using real-world data.
  • Implement and optimize REST APIs for seamless system integration
  • Debug, troubleshoot, and support production systems in real-time
  • Define and enforce best practices for system design, including scalability, fault tolerance, and performance optimization.
  • Work closely with frontend developers, DevOps engineers, product managers, and other stakeholders to deliver end-to-end solutions that meet business requirements.
  • Create and maintain technical documentation for architecture, APIs, and processes to facilitate knowledge sharing and onboarding.
  • Deploy and manage containerized services on Google Kubernetes Engine (GKE) or Cloud Run.
  • Implement deep tracking and monitoring for non-deterministic AI agent behaviors using Google Cloud Observability (Stackdriver) or OpenTelemetry.


At a minimum, we would like you to have:
  • Bachelor's degree in Computer Science, Information technology, a similar engineering discipline, or equivalent practical experience.
  • 5 years of software design and full stack development experience.
  • Python programming skills with direct production experience.
  • Practical experience building with LLMs, AI agents, and RAG pipelines, or a demonstrable ability to go deep on new technical frameworks (like MCP) incredibly fast.
  • Understanding of LLM behavior, limitations and failure modes in production contexts.
  • Direct experience with GCP (Google Cloud Platform).


It's preferred if you have:
  • Experience with the Backend-for-a-Frontend design pattern.
  • Familiarity with feature flags or configuration management for AI system rollouts.
  • Familiarity with LLM prompt optimization, prompt patterns, and guardrails against prompt injection/hallucinations.
  • Understanding of context engineering and how to structure information for LLM consumption.
  • Experience using AI coding tools like AntiGravity, Claude, Cursor etc
  • Experience with Java or Kotlin.


The US base salary range for this full-time position is between $176,800 - $194,500 + bonus + benefits. As pay varies by location, your recruiter will share more about the specific salary range for your targeted location during the hiring process.

#LI-DNI

About Google

Google is a multinational technology company that specializes in Internet-related services and products. These include online advertising technologies, search engine, cloud computing, software, and hardware. Google was founded in 1998 by Larry Page and Sergey Brin while they were Ph.D. students at Stanford University. The company has grown tremendously since then and has become one of the most valuable companies in the world. Google's mission is to organize the world's information and make it universally accessible and useful.
Learn more about Google
Size
156,500 employees
Market Cap
$1,115.4 billion
Industry
Net Income
$40.2 billion
Founded
1998
5 Year Trend
+23.3%
Revenue
$182.5 billion
NASDAQ

Similar Jobs

More Jobs at Google

More Information Technology Jobs

Find similar Backend Engineer, AI Systems jobs: