Role DescriptionYou will design experiments, build task generation systems, run evaluations, inspect model failures, and develop methods for mining tasks that are just out of reach of today's agents.
The work is empirical, systems-heavy, and close to the frontier. You will consume real-world trajectories or researcher hypotheses, materialize realistic data, propose candidate tasks, benchmark those tasks against frontier computer-use and agent models, and hill-climb until you find the failures that produce useful learning signal.
This is not a role for someone who only wants to run experiments or only wants to write research code. You will own the full loop: hypothesis, implementation, evaluation, analysis, iteration, and productionalization.
You Will Work On- Discover model failure modes from real-world traces, agent telemetry, targeted researcher hypotheses, and customer workflows.
- Generate realistic curricula grounded in actual workflows rather than toy synthetic benchmarks.
- Benchmark candidate tasks against frontier CUA and agent models using pass rates, rollouts, and behavioral traces as difficulty signals.
- Build hill-climbing loops that mutate, filter, and rescore tasks until they surface high-signal targets.
- Study reward hackability, distribution mismatch, task realism, long-horizon failures, and transfer from simulation to deployed agents.
- Turn research prototypes into reliable internal systems for continuous curriculum generation.
What We're Looking ForWe're looking for someone who is excited to work at the intersection of empirical AI research, systems engineering, and model evaluation.
You may be a strong fit if you:
- Have strong implementation ability and can turn ambiguous research ideas into working systems.
- Have experience with RL, LLM agents, computer-use agents, evals, post-training, synthetic data, simulation, or model behavior analysis.
- Care deeply about whether a task is grounded, difficult, reward-hack-resistant, and capable of producing actual learning signal.
- Are comfortable interpreting ambiguous model behavior and negative results.
- Enjoy building continuous research loops rather than static benchmark artifacts.
How We WorkBeing an engineer at an early-stage AI startup is not easy. These are the values we care about.
OwnershipWe value teammates who bring novel ideas to the table, experiment, and see results through end to end. You'll have access to massive compute budgets to test large scale experiments.
Move Fast, Build DurableDemand is growing faster than our team. We move quickly, prioritize ruthlessly, and ship systems that keep working under load.
Reality Over NarrativesTraining data is incredibly fragile and prone to reward-hacking. We prioritize digging deep through data, manually if we have to, to garner deep intuition on retaining high quality throughput.
Stay Close to the FrontierNew AI capabilities rapidly change how we think about problems and what doors open. We stay close to the frontier of model capability, and encourage teammates to constantly share new findings and update their world model of what's possible.