Member of Technical Staff, Embedded Assessments

METR

$402K — $500K+*
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Strong skills in prompting LLMs and rapid comprehension of relevant research.
  • Experience in security protocols or practices.
  • Ability to quickly navigate and understand large codebases.
  • Highly independent and creative problem-solver, effective in sparse team settings.
  • Proficiency in loss-of-control threat modeling and safety case analysis.
  • Strong verbal and written communication skills for stakeholder management.
  • Demonstrated trustworthiness and a solid professional reputation.

Responsibilities

  • Embed within frontier AI labs for extended periods to conduct assessments.
  • Practice and develop methodologies for risk assessments.
  • Engage with other researchers to share insights and strategies.
  • Create tools to enhance the efficiency of future exercises.
  • Assist in hiring and scaling the research team.
  • Document findings and write reports on assessment results.
  • Coordinate and plan subsequent exercises based on findings.

Benefits

  • Catered lunch and dinner provided daily at the office.
  • Relocation support for moving to the Bay Area.
  • Unlimited PTO and 21 weeks of parental leave for new parents.
  • Monthly stipend for transit/parking and annual Uber budget.
  • Professional development funding for courses and conferences.
  • Mental health coverage for therapy and wellness expenses.
  • Gym and wellness expense reimbursement.
  • Home office equipment support for remote work needs.
Full Job Description
Overview

METR has started embedding researchers inside frontier labs to investigate incidents, stress-test labs' internal agent monitoring systems, and assess loss-of-control risks from internal deployment. As agent capabilities increase, we expect this to be one of the most important sources of independent information the world has about catastrophic risks from advanced AI.

As the source of information becomes more important, we'll need many more talented researchers and engineers who can conduct embedded exercises. We expect these assessors to have deep access, and for their work to be a large part of METR's impact in the next year. We want to build on the momentum from previous exercises to further develop our risk assessments.

What the job looks like

You'll be embedded in a frontier AI lab for up to several weeks at a time, likely alongside 1-4 other METR staff. Between exercises, you'll practice, develop the general methodology, talk to other researchers, build tooling to make future exercises go better, help us hire and scale, write up results, and plan/coordinate future exercises.

We are looking for embedded researchers and engineers across multiple current and potential future exercises: AI R&D acceleration assessment, compute allocation, monitorability red-teaming, incident investigations, and more. We expect this role to evolve significantly as we develop and prototype this new form of risk assessment.

Ideal candidate

We are looking for candidates with at least two of the following skills, although the ideal candidate will have most or all of them:
  • You're good at prompting LLMs, are familiar with research relevant to the fields above (or can get up to speed quickly).
  • You have some security experience.
  • You can get spun up on large codebases quickly.
  • You're scrappy, creative, independent, and self-directed (because during the exercises you'll only have a few other METR employees you can talk to). The work is novel and you'll need to figure a lot of stuff out on the fly largely by yourself.
  • You are excellent at loss-of-control threat modeling and breaking down safety cases.
  • You're good at verbal communication, writing, and stakeholder management (e.g., navigating complex relationships with frontier labs).
  • You're trustworthy and have a good reputation.


Compensation & Benefits

$402,048 - $687,759 a year

METR also has a host of benefits:
  • The office: Catered lunch and dinner daily; in-office gym and shower
  • Relocation support: Stipend for moving to the Bay Area
  • Time-off and leave: Unlimited PTO and 21-week parental leave for new parents
  • Commuter benefit: Monthly transit/parking stipend and an annual Uber budget
  • Professional development benefit: for training, courses, conferences, and AI safety education
  • Mental health benefit: for therapy, medication, and other mental health expenses
  • Wellness benefit: for gym memberships and other wellness expenses
  • Work equipment benefit: for home office and workstation equipment expenses


Hybrid Preferred: Our technical team members are in our office in Berkeley 3-5 days/week. We would ideally like for you to be in person too, but we are happy to be flexible here. If you lack US work authorization and would like to work in-person, we can likely sponsor a cap-exempt H-1B visa for this role.

We encourage you to apply even if your background may not seem like the perfect fit! We would rather review a larger pool of applications than risk missing out on a promising candidate for the position.

Similar Jobs

More Jobs at METR

More Information Technology Jobs

Find similar Member of Technical Staff, Embedded Assessments jobs: