Google

Software Engineer III, ML, TPU Efficiency, YouTube

Google • $147K — $210K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree or equivalent practical experience.
  • 2+ years programming in C or Python.
  • 2+ years in software design and architecture.
  • 2+ years testing and launching software products.
  • Experience optimizing ML models using frameworks like TensorFlow, JAX, or PyTorch.

Responsibilities

  • Profile ML workloads and optimize accelerator utilization for efficiency.
  • Implement algorithmic efficiency techniques like low-precision quantization.
  • Optimize data pipelines to enhance real-time training and inference.
  • Collaborate with ML developers to design efficient model architectures.
  • Support the deployment of universal efficiency libraries.

Benefits

  • Comprehensive health plans.
  • Retirement savings with company matching.
  • Generous vacation and paid leave policies.
  • Professional development opportunities.
  • Access to on-site wellness programs.
Full Job Description
info_outline
X In most instances, this position requires in-person interviews as part of the hiring process.

Minimum qualifications:
  • Bachelor's degree or equivalent practical experience.
  • 2 years of experience programming in C or Python.
  • 2 years of experience with software design and architecture.
  • 2 years of experience testing, and launching software products.
  • Experience with ML model optimization.
  • Experience with ML frameworks such as TensorFlow, JAX, and PyTorch, or ML compilers (e.g., accelerated linear algebra (XLA)).

Preferred qualifications:
  • Master's degree or PhD in Computer Science or related technical fields.
  • Experience developing accessible technologies.
  • Experience with debugging correctness and performance issues at all levels of the ML software stack.
  • Experience with ML compilers and their internals, experience writing compiler optimization passes.
  • Familiarity with accelerator hardware architectures (TPUs/GPUs).


About the job

With your technical expertise you will manage project priorities, deadlines, and deliverables. You will design, develop, test, deploy, maintain, and enhance software solutions.

On this team, you will own the optimization of the models powering the YouTube algorithm. Your work will focus on model efficiency optimization, such as low-precision quantization , knowledge distillation, parameter sharing, and designing hardware-friendly model architectures, to reduce training and serving costs while maximizing fleet utilization and value delivered to users.

You will build support and optimize new and existing models in our Recommendation System stack, including new model architectures while adapting to next-generation TPU hardware.

You will engage in model and TPU compiler co-design, with opportunities to work across the stack ranging from end-user ML models down to Hardware/Software architecture.

Individual pay is determined by factors including job-related skills, experience, and relevant education or training.

US: $147000 - $210000 (USD) 15% bonus target equity benefits

Learn more about benefits at Google .

Responsibilities
  • Profile ML workloads, identify compute and memory bandwidth bottlenecks, and optimize accelerator utilization to maximize compute efficiency.
  • Explore, implement, and productionize algorithmic efficiency techniques, including low-precision quantization, knowledge distillation, parameter sharing, and attention optimizations.
  • Optimize auxiliary serving and distributed data pipelines, including data ingestion, feature transformation, embedding lookups, and memory caching to support real-time training and inference.
  • Partner closely with ML model developers and researchers to co-design hardware-friendly model architectures and deploy universal efficiency libraries.


About Google

Google is a multinational technology company that specializes in Internet-related services and products. These include online advertising technologies, search engine, cloud computing, software, and hardware. Google was founded in 1998 by Larry Page and Sergey Brin while they were Ph.D. students at Stanford University. The company has grown tremendously since then and has become one of the most valuable companies in the world. Google's mission is to organize the world's information and make it universally accessible and useful.
Learn more about Google
Size
156,500 employees
Market Cap
$1,115.4 billion
Industry
Net Income
$40.2 billion
Founded
1998
5 Year Trend
+23.3%
Revenue
$182.5 billion
NASDAQ

Similar Jobs

More Jobs at Google

More Information Technology Jobs

Find similar Software Engineer III, ML, TPU Efficiency, YouTube jobs: