Research Evaluation Lead

Rhoda AI

$120K — $145K *
Consumer Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Some understanding of robotics/ML experimentation.
  • Computer science background or hands-on coding experience.
  • Detail-oriented with a focus on understanding experimental intent.
  • Strong ownership and hands-on execution skills.
  • Preferred experience in robotics testing, data collection, lab operations, or QA.

Responsibilities

  • Translate research questions into eval protocols and success criteria.
  • Oversee entire execution process: from model handoff to results delivery.
  • Train and manage eval pilots, ensuring consistency across the board.
  • Identify issues related to model failures and other system components.
  • Maintain setups, including experiment traceability and data management.
  • Monitor quality and throughput; drive continuous process improvements.
  • Collaborate with Research, Robot Data, and Eval Platform teams.

Benefits

  • Opportunity to own critical evaluation processes in robotics.
  • Chance to collaborate with interdisciplinary teams.
  • Access to cutting-edge research and technology.
  • Engagement in a fast-paced, iterative development environment.
Full Job Description
Mission

Own end-to-end robot model evaluation for Research. Turn research questions into consistent, high-quality, repeatable evals that enable fast iteration and trusted results.
Responsibilities
  • Translate research intent into clear eval protocols, trial plans, and success criteria.
  • Own execution end-to-end: model handoff 1 station readiness 1 pilot execution 1 QA 1 results.
  • Train and manage eval pilots; ensure consistency across people, shifts, and stations.
  • Distinguish model failures from hardware, setup, operator, or data-quality issues.
  • Maintain eval setups, resets, randomization, metadata, and experiment traceability.
  • Track quality, throughput, and bottlenecks; continuously improve the eval process.
  • Partner closely with Research, Robot Data, and Eval Platform teams.
What we1re looking for
  • Some understanding of robotics / ML experimentation.
  • Computer science background or hands-on experience with coding
  • Rigorous, detail-oriented, and able to understand the intent behind an experiment, not just execute instructions.
  • Strong hands-on execution and ownership.
  • Experience in robotics testing, data collection, lab operations, or QA preferred.
Success looks like

A researcher can hand off a model and research question and receive a trusted, standardized eval result with sufficient trials and QA.

Similar Jobs

More Jobs at Rhoda AI

More Consumer Technology Jobs

Find similar Research Evaluation Lead jobs: