Google

Principal Engineer, AI Ecosystem

Google$307K — $428K *
Information Technology
11 - 15 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree in Computer Science or a related technical field.
  • 15 years of experience in software engineering focused on innovation and large-scale systems.
  • 10 years of experience with distributed systems, ML/AI infrastructure, or large-scale compute orchestration.
  • Expertise in operating at a multi-organization level driving technical direction.
  • Familiarity with cloud-native orchestration frameworks and traditional HPC methodologies.

Responsibilities

  • Enable ML engineers to scale operations seamlessly to massive infrastructures without infrastructure expertise.
  • Enhance team understanding of AI workload problems from the end-user perspective.
  • Lead the development of a substrate optimized for Accelerated and Agentic Workloads.
  • Architect and execute industry-defining technical standards while mentoring engineering teams.

Benefits

  • Health, dental, vision, life, and disability insurance.
  • Retirement benefits with 401(k) company match.
  • 20 days of vacation per year, accruing at 6.15 hours per pay period for the first five years.
  • 40 hours of sick time per year, increased to 69 hours/year for Seattle with additional discretionary days.
  • Maternity leave of 28-30 weeks and baby bonding leave of 18 weeks.
  • 13 paid holidays per year.
Full Job Description
info_outline
X In accordance with Washington state law, we are highlighting our comprehensive benefits package, which is available to all eligible US based employees. Benefits for this role include:
  • Health, dental, vision, life, disability insurance
  • Retirement Benefits: 401(k) with company match
  • Paid Time Off: 20 days of vacation per year, accruing at a rate of 6.15 hours per pay period for the first five years of employment
  • Sick Time: 40 hours/year (increased to 69 hours/year for Seattle) including 5 discretionary sick days per instance
  • Maternity Leave (Short-Term Disability Baby Bonding): 28-30 weeks
  • Baby Bonding Leave: 18 weeks
  • Holidays: 13 paid days per year
Note: By applying to this position you will have an opportunity to share your preferred working location from the following: Sunnyvale, CA, USA; Kirkland, WA, USA; Seattle, WA, USA.

Minimum qualifications:
  • Bachelor's degree in Computer Science, a related technical field, or equivalent practical experience.
  • 15 years of experience in software engineering, focusing on technical innovation, large-scale systems operations, or engineering leadership.
  • 10 years of experience working with distributed systems, ML/AI infrastructure, deep learning frameworks, or large-scale compute orchestration.

Preferred qualifications:
  • Master's degree or PhD in Computer Science, Artificial Intelligence, High-Performance Computing, or a related field.
  • Experience operating at a company-wide or multi-organization level, driving technical direction that influences foundational systems.
  • Expertise in HPC, distributed workload schedulers (e.g. Slurm), and managing complex LLM training and inference workloads at massive scale.
  • Familiarity with cloud-native orchestration frameworks and an understanding of how to bridge traditional HPC methodologies with modern cloud infrastructure.
  • Ability to influence outside lines of formal authority, working effectively within highly matrixed environments to align technical and product strategies.


About the job

Google Cloud accelerates organizations' ability to digitally transform their business with the best infrastructure, platform, industry solutions and expertise. We deliver enterprise-grade solutions that leverage Google's technology - all on the cleanest cloud in the industry. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems.

GKE is the industry-leading managed Kubernetes service. As the originator and a large contributor to OSS Kubernetes, our team holds a unique structural position in the industry. Today, the rapid rise of AI and ML workloads is driving a massive paradigm shift, creating entirely new abstractions over Kubernetes and GKE. To lead this evolution, we are expanding our focus into adjacent projects throughout the OSS AI Infrastructure space. Our goal is to leverage our Kubernetes foundation to accelerate innovation globally, and to make GCP the undisputed best place to train and serve accelerated and agentic workloads, seamlessly supporting the frameworks and tools that AI practitioners rely on daily.

As Principal Engineer, you will be in a critical, high-impact individual contributor position within the GKE organization. You will utilize domain expertise in AI/ML frameworks to augment our technical leadership and build out the team's intuition for AI workloads. You will be the technical bridge between GKE's robust infrastructure and the rapidly evolving OSS AI ecosystem (e.g., Ray, Slurm, KubeFlow, PyTorch, NumPy, CUDA). By bringing deep empathy and technical understanding of the AI end-user, you will guide the architectural outlook that builds on and evolves Kubernetes and related projects.

The ML, Systems, & Cloud AI (MSCA) organization at Google designs, implements, and manages the hardware, software, machine learning, and systems infrastructure for all Google services (Search, YouTube, etc.) and Google Cloud. Our end users are Googlers, Cloud customers and the billions of people who use Google services around the world.

We prioritize security, efficiency, and reliability across everything we do - from developing our latest TPUs to running a global network, while driving towards shaping the future of hyperscale computing. Our global impact spans software and hardware, including Google Cloud's Vertex AI, the leading AI platform for bringing Gemini models to enterprise customers.
Individual pay is determined by factors including job-related skills, experience, and relevant education or training.

US: $307000 - $428000 (USD) 30% bonus target equity benefits

Learn more about benefits at Google .

Responsibilities
  • Enable massive scale so that ML engineers working primarily in Python can iterate locally and seamlessly scale to 1,000,000 accelerators without needing to become experts in infrastructure.
  • Act as a proxy for the emerging AI/ML end-user persona, evolving the GKE team's intuition and empathy for real-world problems and opportunities within the AI workload lifecycle.
  • Drive the development and architectural outlook of a substrate optimized for Accelerated and Agentic Workloads.
  • Imagine, architect, and lead the technical execution of industry-defining standards through both direct, direct technical work and by mentoring and guiding teams of engineers.


Information collected and processed as part of your Google Careers profile, and any job applications you choose to submit is subject to Google's Applicant and Candidate Privacy Policy .

About Google

Google is a multinational technology company that specializes in Internet-related services and products. These include online advertising technologies, search engine, cloud computing, software, and hardware. Google was founded in 1998 by Larry Page and Sergey Brin while they were Ph.D. students at Stanford University. The company has grown tremendously since then and has become one of the most valuable companies in the world. Google's mission is to organize the world's information and make it universally accessible and useful.
Learn more about Google
Size
156,500 employees
Market Cap
$1,115.4 billion
Industry
Net Income
$40.2 billion
Founded
1998
5 Year Trend
+23.3%
Revenue
$182.5 billion
NASDAQ

Similar Jobs

More Jobs at Google

More Information Technology Jobs

Find similar Principal Engineer, AI Ecosystem jobs: