Google

Director, Engineering, AI Accelerator Cluster Systems

Google$307K — $428K *
Enterprise Technology
11 - 15 years of experience
Job Overview by Ladders

Qualifications

  • Master's degree in Computer Science or related technical field, or equivalent experience.
  • 15 years of professional engineering experience.
  • 5 years in a senior leadership role managing large-scale infrastructure teams.
  • Experience managing both physical systems design and software stack for networking/computing products.
  • Preferred: Experience with New Product Introduction for AI Infrastructure.

Responsibilities

  • Lead end-to-end New Product Introduction for AI infrastructure products.
  • Oversee the core bare-metal software stack management.
  • Design systems ensuring low latency and high compute density for AI model training.
  • Partner with teams to optimize the AI accelerator stack from networking to Kubernetes.
  • Collaborate with leadership to define multi-year strategy for AI infrastructure.

Benefits

  • Health, dental, vision, life, and disability insurance.
  • 401(k) with company match for retirement.
  • 20 days of vacation per year, accruing at a rate of 6.15 hours per pay period for first five years.
  • 40 hours sick time per year, with potential increase to 69 hours for Seattle employees.
  • Exceptional maternity and baby bonding leave up to 30 weeks.
Full Job Description
info_outline
X In accordance with Washington state law, we are highlighting our comprehensive benefits package, which is available to all eligible US based employees. Benefits for this role include:
  • Health, dental, vision, life, disability insurance
  • Retirement Benefits: 401(k) with company match
  • Paid Time Off: 20 days of vacation per year, accruing at a rate of 6.15 hours per pay period for the first five years of employment
  • Sick Time: 40 hours/year (increased to 69 hours/year for Seattle) including 5 discretionary sick days per instance
  • Maternity Leave (Short-Term Disability Baby Bonding): 28-30 weeks
  • Baby Bonding Leave: 18 weeks
  • Holidays: 13 paid days per year
Note: By applying to this position you will have an opportunity to share your preferred working location from the following: Kirkland, WA, USA; Seattle, WA, USA.

Minimum qualifications:
  • Master's degree in Computer Science, Computer Engineering, a related technical field, or equivalent practical experience.
  • 15 years of professional engineering experience.
  • 5 years of experience in a senior leadership role managing large-scale infrastructure or systems teams.
  • Experience in engineering leadership managing both physical systems design (electrical/mechanical) and the software stack (operating systems, firmware, and drivers) for networking or computing products.

Preferred qualifications:
  • Experience with New Product Introduction for server/rack and cluster products in AI Infrastructure.
  • Experience building, scaling cloud platforms or high-performance computing infrastructure in a dynamic environment.
  • Exposure to, or experience with, physical data center engineering, infrastructure certification, and physical constraints (e.g., custom cooling schemes, power delivery, rack density).
  • Technical expertise in bare metal provisioning, advanced accelerators (TPUs/GPUs), and high-performance cluster networking.
  • Technical expertise in ML workloads, AI infrastructure scaling, and the unique performance requirements of foundation models.
  • Strong executive communication skills, with the ability to simplify complex silicon-to-software co-design topics to influence leadership and company strategy.


About the job

As the Director, Engineering, AI Accelerator Cluster Systems you will be responsible for driving the provisioning architecture, cluster operations experience, physical-to-software integration, and overall operator experience for Google Cloud's bare metal accelerator infrastructure. In this role, you will sit at the intersection of physical systems engineering and the underlying software stack, leading strategic efforts to deliver AI infrastructure on prem.

Individual pay is determined by factors including job-related skills, experience, and relevant education or training.

US: $307000 - $428000 (USD) 30% bonus target equity benefits

Responsibilities
  • Lead end-to-end New Product Introduction (NPI) for server/rack/clusters, building AI infrastructure focused on custom networking, liquid cooling, and rack density.
  • Oversee the core bare-metal software stack, including OS, drivers, firmware, and accelerator release management.
  • Design systems with direct GPU/TPU access to ensure low latency and high compute density for foundation model training.
  • Partner across teams to optimize the end-to-end AI accelerator stack, from large-scale networking to Kubernetes.
  • Collaborate with Product and GTM leaders to define the multi-year strategy for bare-metal AI infrastructure.


About Google

Google is a multinational technology company that specializes in Internet-related services and products. These include online advertising technologies, search engine, cloud computing, software, and hardware. Google was founded in 1998 by Larry Page and Sergey Brin while they were Ph.D. students at Stanford University. The company has grown tremendously since then and has become one of the most valuable companies in the world. Google's mission is to organize the world's information and make it universally accessible and useful.
Learn more about Google
Size
156,500 employees
Market Cap
$1,115.4 billion
Industry
Net Income
$40.2 billion
Founded
1998
5 Year Trend
+23.3%
Revenue
$182.5 billion
NASDAQ

Similar Jobs

More Jobs at Google

More Enterprise Technology Jobs

Find similar Director, Engineering, AI Accelerator Cluster Systems jobs: