The roleYou translate what makes a good performance into clear, defensible signals, and use those signals to improve Aidan. Role involves carrying out evaluations of agents on a broad range of areas on the frontier including voice, vision, and browser use, and using the findings to optimize the agent, context, and models.
What you'll do- Design evaluations for voice, vision, and browser use to direct and accelerate improvements in the agent, context, and models
- Build and maintain our internal benchmarks and simulations
- Work on systems to score customer-specific scenarios and identify gaps in current capabilities.
Who you are- Engineer with statistics and/or applied machine learning experience
- Comfortable in a production codebase
- Bonus: prior experience with evaluations or with voice, realtime, or browser use/computer use agents.
