What to ExpectWe're looking for an Eval Ops Program Manager to join our Data team and build the operational system for robotics evals.
This role sits at the intersection of machine learning, analytics, and operations. You'll work closely with ML engineers, researchers, the Eval Operations Lead, and Memory Developers to ensure evaluations are producing trustworthy data and running efficiently at scale.
What You'll Do- Build the analytics layer for eval operations, developing dashboards, reporting, and analyses to understand model performance, evaluation throughput, failure patterns, and operational bottlenecks
- Work with stakeholders across ML, Software, Hardware, Product, and Operations to define evaluation goals, ensure data quality, and translate results into actionable insights
- Design and improve processes that increase evaluation quality, repeatability and scale
- Own the logistics required to run evaluations, including sourcing and standardizing props, garments, equipment, and environments
- Identify operational gaps and build solutions, automations, or processes to close them
What You'll Bring- Strong analytical skills and the ability to turn data into actionable insights
- High ownership and bias for execution
- Clear written and verbal communication
- Comfort working across both analytics and hands-on operations
- A level of hardcore-ness while still treating people like people
- Thick-skinned, resilient and receptive to direct feedback
- Intermediate-level understanding of ML
Nice to Have- Previous experience in strategy and ops, technical program management, consulting or investment banking
- Technical skills to build lightweight tooling or automations
- Exposure to ML evaluation, experimentation, or labeling workflows
- Ability to leverage AI to improve productivity
Even if you don't meet every single requirement, we encourage you to apply. Studies show that women and underrepresented groups often hold back unless they meet 100% of the criteria - we don't want that to be the reason we miss out on great talent.
