Bachelor's degree in Computer Science, Robotics, or equivalent experience.
2 years of experience with machine learning tools, specifically deploying LLMs/VLMs and deep learning models.
2 years of experience in robotics.
Technical experience in software engineering, AI/ML engineering, or solutions architecture.
Proficiency in Python and modern AI-assisted development tools for prototyping.
Responsibilities
Design and maintain scalable frameworks for evaluating robot policies in both offline and real-world settings.
Collaborate with researchers to create benchmarks that enhance evaluation signals and test model capabilities.
Develop diagnostic and visualization tools to identify policy failures and monitor performance regressions.
Set evaluation criteria for model releases and oversee stability and benchmarking for critical demonstrations.
Innovate methods to expedite real-world hardware evaluations, making them more reproducible and less dependent on manual processes.
Benefits
Flexible work hours and remote work options.
Opportunities for professional development and continuous learning.
Collaborative and innovative work environment.
Access to cutting-edge technology and resources.
Health and wellness programs.
Full Job Description
Minimum qualifications:
Bachelor's degree in Computer Science, Robotics, or equivalent practical experience.
2 years of experience with machine learning tools and algorithms, specifically deploying Large Language Models (LLMs)/Vision Language Models (VLMs) and deep learning models.
2 years of experience working in and with robotics.
Experience in a technical role (software engineering, AI/ML engineering, or solutions architecture).
Experience with Python, and with modern AI-assisted development tools to accelerate prototyping.
Preferred qualifications:
Experience with ROS/ROS2, or on-device deployment constraints (e.g., Jetson, TPU).
Experience managing multimodal datasets, time-series telemetry data, or building automated pipelines for hardware-in-the-loop testing.
Familiarity with the operational realities of modern vision-language-action (VLA) models or behavior cloning policies and their common pitfalls like task overfitting.
A deep-seated interest in the future of embodied AI and a desire to build the testing bedrock for robotics development.
About the job
As a Research Engineer, you will manage the practical issues of benchmarking foundation models for robotics. You will have an understanding of how modern robotics foundation models work and where they currently fall short. Your mission is to design evaluation protocols, tooling, and frameworks that extract meaningful signals from the messiness of physical policy execution. You will build the infrastructure that allows the engineering team to effectively hillclimb and gives leadership a clear, data-driven understanding of technological readiness.
Responsibilities
Design, implement, and maintain scalable, frameworks to enable evaluation of robot policies across offline open-loop testing and real-world hardware evaluations.
Partner with researchers to design the content of various benchmarks in order to maximize evaluation signal and stress-test model capabilities.
Build diagnostic and visualization tools that allow the team to easily root-cause policy failures and track performance regressions.
Establish evaluation criteria for model releases and own the stability and benchmarking of models slated for critical demos.
Innovate on how to make real-world hardware evaluation faster, more reproducible, and less reliant on manual human intervention.
About Google
Google is a multinational technology company that specializes in Internet-related services and products. These include online advertising technologies, search engine, cloud computing, software, and hardware. Google was founded in 1998 by Larry Page and Sergey Brin while they were Ph.D. students at Stanford University. The company has grown tremendously since then and has become one of the most valuable companies in the world. Google's mission is to organize the world's information and make it universally accessible and useful.