Experience designing and operating large-scale distributed systems focused on scalability and reliability.
Background in Machine Learning or AI infrastructure.
Proficiency in software performance analysis and high-performance computer architectures.
Experience in software architecture design for AI/ML applications.
Familiarity with site reliability engineering and distributed systems.
Experience building developer tools to enhance development velocity and code quality.
Responsibilities
Lead the architectural design of high-throughput serving infrastructure for evaluation workflows.
Design scalable systems for storing, processing, and serving massive datasets.
Optimize latency and resource efficiency of large-scale inference and evaluation pipelines.
Collaborate with research teams to define infrastructure needs for next-gen AI models.
Establish technical roadmaps for data serving platforms supporting DeepMind's evaluation ecosystem.
Benefits
Comprehensive health and wellness programs.
Generous paid time off and holidays.
Retirement savings plans with company matching.
Opportunities for professional development and training.
Flexible working arrangements and locations.
Full Job Description
info_outline X In most instances, this position requires in-person interviews as part of the hiring process.Note: By applying to this position you will have an opportunity to share your preferred working location from the following: Mountain View, CA, USA; New York, NY, USA.
Minimum qualifications:
Experience designing, building, and operating large-scale distributed systems, with a focus on scalability, fault tolerance, and reliability.
Experience in Machine Learning or AI infrastructure.
Experience in software performance analysis and improvement, and High-Performance computer architectures (e.g., CPU, memory subsystem, multiprocessing).
Experience designing software architecture for applications, including AI/ML systems.
Experience with site reliability engineering, system archiecture, and distributed systems.
Experience building developer tools to improve development velocity, code quality, or code health (e.g., CI/CD, compilers, test automation frameworks).
Preferred qualifications:
Master's degree or PhD in Engineering, Computer Science, or a related technical field.
8 years of experience with data structures/algorithms, with strong proficiency in C or Python.
Experience developing and optimizing ML or production serving infrastructure.
Experience leading complex architectural migrations or cross-team infrastructure projects. Excellent problem-solving skills and ability to collaborate widely across organizations.
Knowledge of VMs and sandboxed execution environments (e.g., Xbox, Capsules).
Understanding of the latest evaluation research and areas important to LLM research.
About the job
The mission of the broader GenAI Data and Evaluation Platform team is to provide the infrastructure and support that accelerates data and evaluation efforts across the Gemini program.
In this role, you will coordinate across all of these groups and accelerate efforts wherever needed to bring serving impact to GDM Data and Eval efforts.
Lead the architectural design of high-throughput serving infrastructure for evaluation workflows.
Design scalable systems to store, process, and serve massive datasets for model evaluation.
Optimize the latency and resource efficiency of large-scale inference and evaluation pipelines.
Collaborate with research teams to define infrastructure requirements for next-generation AI models.
Establish technical roadmaps for data serving platforms supporting DeepMind's evaluation ecosystem.
About Google
Google is a multinational technology company that specializes in Internet-related services and products. These include online advertising technologies, search engine, cloud computing, software, and hardware. Google was founded in 1998 by Larry Page and Sergey Brin while they were Ph.D. students at Stanford University. The company has grown tremendously since then and has become one of the most valuable companies in the world. Google's mission is to organize the world's information and make it universally accessible and useful.
