Google

Director of Engineering, GPU Instances and Infrastructure

Google$307K — $427K *
Enterprise Technology
11 - 15 years of experience
Job Overview by Ladders

Qualifications

  • Master's degree in Computer Science, Electrical Engineering, or related field, or equivalent practical experience.
  • 15 years of experience as an engineering leader.
  • Expertise in cloud computing, and hardware acceleration, particularly with GPU infrastructure.
  • Proven history of technical innovation in cross-functional engineering environments.

Responsibilities

  • Lead the strategic direction for GPU Instances and Infrastructure organization to align with Google Cloud AI goals.
  • Collaborate with engineering and business teams to integrate GPU acceleration into Google systems.
  • Oversee development and delivery of GPU-accelerated products across the technology stack.
  • Leverage GPU acceleration for efficient training and inference of large language models.
  • Identify and adopt innovations in GPU technology through collaboration with partners.

Benefits

  • Health, dental, vision, life, disability insurance
  • 401(k) retirement plan with company match
  • 20 days of vacation per year, accruing at nearly six hours per pay period
  • 40 hours of sick time annually, increasing for Seattle residents
  • 28-30 weeks of maternity leave
  • 18 weeks of baby bonding leave
  • 13 paid holidays each year
Full Job Description
info_outline
X In accordance with Washington state law, we are highlighting our comprehensive benefits package, which is available to all eligible US based employees. Benefits for this role include:
  • Health, dental, vision, life, disability insurance
  • Retirement Benefits: 401(k) with company match
  • Paid Time Off: 20 days of vacation per year, accruing at a rate of 6.15 hours per pay period for the first five years of employment
  • Sick Time: 40 hours/year (increased to 69 hours/year for Seattle) including 5 discretionary sick days per instance
  • Maternity Leave (Short-Term Disability Baby Bonding): 28-30 weeks
  • Baby Bonding Leave: 18 weeks
  • Holidays: 13 paid days per year


Minimum qualifications:
  • Master's degree in Computer Science, Electrical Engineering, or a related field, or equivalent practical experience.
  • 15 years of experience as an engineering leader.
  • Experience in cloud computing, hardware acceleration, GPU infrastructure, computer architecture, and software engineering.
  • Experience with technical innovation within cross-functional engineering environments.

Preferred qualifications:
  • Experience in iterative development model.
  • Experience working with a service mindset and delivering on complex engineering solutions.
  • Experience leading and managing high-performing engineering teams in a fast-paced, demanding environment.
  • Expertise in engaging with senior stakeholders and managing competing opinions and viewpoints.
  • Expertise in collaborating with partners and customers to solve problems.


About the job

Google's AI and Infrastructure (AI2) organization builds the technical foundation behind Google's products as well as for Google Cloud's compute and AI/ML offerings. We manage the underlying design elements, developer platforms, product components, and infrastructure at Google.

Google Compute Engine (GCE) is a cloud computing platform that empowers its users with a comprehensive suite of VM and Bare Metal instances for general compute, compute-optimized, memory-optimized, storage-optimized, and GPU/ TPU-accelerated workloads. GCE is one of Google Cloud Platform's (GCP) core services, and it is used by businesses of all sizes, from startups to enterprises running AI/ML, cloud native, and mission critical enterprise services. GCE is committed to driving cloud computing excellence for Google and the world. Our aim is to make it easier for developers to build, deploy, and manage scalable and cost-effective cloud applications. We work closely with hardware partners and Google's engineering teams to harness the latest advancements in CPU (i.e. x86/ARM), Storage, Network, and GPU/TPU virtualization, all backed by security, reliability, and performance.

Additionally, we operate and maintain the infrastructure that provides public cloud infrastructure for customers to scale their operations. We deliver enterprise-grade cloud solutions that leverage Google's technology to help companies operate more efficiently and adapt to changing needs, giving customers a foundation for the future.

Google Cloud accelerates every organization's ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google's cutting-edge technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems.

The US base salary range for this full-time position is $307,000-$427,000 bonus equity benefits. Our salary ranges are determined by role, level, and location. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits. Learn more about benefits at Google .

Responsibilities
  • Lead the strategic direction for the GPU Instances and Infrastructure organization, aligning its goals with Google Cloud AI's overarching objectives and maximizing the impact of GPU acceleration across the company's initiatives.
  • Collaborate with partner engineering teams within Product Areas, business teams, and across Google to integrate GPU acceleration into Google's systems and solutions, ensuring alignment with overarching goals and objectives.
  • Oversee the development and delivery of GPU-accelerated products and solutions, including cross-stack systems that integrate GPU acceleration across different parts of the technology stack, including Frameworks, Data Management, Training, and Inference.
  • Play a role in leveraging GPU acceleration for the training and inference of large language models, ensuring efficient and scalable performance for computationally demanding tasks.
  • Work with internal and external partners to identify and adopt the latest innovations in GPU technology and chip-to-chip interconnects.


About Google

Google is a multinational technology company that specializes in Internet-related services and products. These include online advertising technologies, search engine, cloud computing, software, and hardware. Google was founded in 1998 by Larry Page and Sergey Brin while they were Ph.D. students at Stanford University. The company has grown tremendously since then and has become one of the most valuable companies in the world. Google's mission is to organize the world's information and make it universally accessible and useful.
Learn more about Google
Size
156,500 employees
Market Cap
$1,115.4 billion
Industry
Net Income
$40.2 billion
Founded
1998
5 Year Trend
+23.3%
Revenue
$182.5 billion
NASDAQ

Similar Jobs

More Jobs at Google

More Enterprise Technology Jobs

Find similar Director of Engineering, GPU Instances and Infrastructure jobs: