Member of Technical Staff, Clinical OperationsAbout this role. You will build our approach to evaluating AI systems on the work required to start and run clinical studies. You will translate practical trial experience into realistic tasks involving operational dependencies, incomplete information, and decisions that affect study delivery. You will personally develop the first evaluations, define the roadmap, and build a team of experts.
This is a high-intensity, founder-type role. Our Members of Technical Staff have built companies, run drug programs and scaled complex technical projects.
What you will do:- Develop evaluations for study startup, country and site activation, vendor readiness, investigator engagement, and training.
- Expand the work into recruitment, monitoring, protocol deviations, and coordination across study teams.
- Turn operational plans, correspondence, trackers, and study records into tasks with clear success criteria.
- Work with engineers and trial experts to test agents, validate answers, and identify where apparently reasonable recommendations would fail in practice.
- Recruit and lead a team, establishing standards for evaluation quality and reliable delivery.
What we look for:- Direct ownership of study startup or trial delivery at a sponsor, CRO, or research organization.
- Detailed understanding of how sites, vendors, data systems, and study teams depend on one another.
- The ability to diagnose delays and missing information, prioritize actions, and explain how you would assess whether a proposed solution works.
- A strong interest in working with AI tools, personally building evaluations, and recruiting and developing a productive team.
We welcome scientists who have become fluent with AI tools and quantitative or engineering researchers with substantial hands-on experience in the relevant domain.
How we work. Our MTS team works in person in Mission Bay, San Francisco. We keep meetings to a minimum and are flexible about when you arrive or leave. Tight deadlines and customer commitments sometimes require late hours.
Our work in use. We built the biology evaluations for SemiAnalysis's GDPx, and our benchmarks are featured in Fireworks' Specialized Intelligence Index. Frontier AI labs use our benchmarks to assess biological capabilities and safeguards, with our work appearing in research announcements and model cards from Google, Anthropic, and xAI.
- Google: Introducing Gemini 4 Hydrogen
- Anthropic: Claude Fable 5.1 and Mythos 5.1 system card
- Anthropic: Claude Opus 5.5 system card
- xAI: Grok 4.7 model card
- xAI: Biosecurity at the frontier
Hiring Process.Our process is typically completed within two weeks.
- Round 1: Introduction
- Round 2: Technical project matching
- Round 3: Take-home evaluation project (~2 hours)
- Round 4: Technical interview / live engineering session (1 hour)
- Round 5: Paid onsite project and presentation (2-3 days)
- Offer
Compensation & Benefits- 350K-500K+ OTE
- Equity
- Unlimited PTO
- Health, dental and vision insurance fully covered
- Visa sponsorship and relocation assistance
- 401(k)
- Office in Mission Bay, San Francisco
- Lunch and dinner provided
- Onsite Gym membership