Member of Technical Staff, Evaluation Execution

METR

$285K — $500K+*
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 5-7 years of experience in ML research execution and software engineering.
  • Proven track record of executing innovative projects in machine learning.
  • Strong technical decision-making skills in software development.
  • Ability to handle rapid prototyping while ensuring system maintainability.
  • Experience leading large-scale projects from conception to delivery.
  • Familiar with high standards for code quality and system architecture.

Responsibilities

  • Execute and contribute to evaluations in frontier ML research.
  • Identify and implement processes to streamline evaluations.
  • Develop and maintain scalable systems for ongoing model evaluations.
  • Lead cross-functional projects that integrate ML solutions with solid code.
  • Establish and promote best practices in software development across teams.

Benefits

  • Catered lunch and dinner daily at the office.
  • A stipend for relocation to the Bay Area.
  • Unlimited paid time off (PTO) and 21-week parental leave.
  • Monthly transit/parking stipend and annual Uber budget.
  • Support for professional development including training and conferences.
  • Mental health benefits for therapy and medication costs.
  • Wellness benefits for gym memberships and other health expenses.
  • Reimbursement for home office and workstation equipment.
Full Job Description
What We're Looking For

The Evaluation Execution team at METR focuses on productionizing, improving, and executing our various evaluations. We streamline our processes and build common infrastructure to scale our ability to continually run our most up-to-date evaluations on the latest models. This team primarily looks for research execution and software engineering skills.

Research Execution

  • You are an experienced executor/contributor; you are familiar with patterns of successful and unsuccessful execution in frontier ML research. You are undaunted by "I've never done this before" or even "no-one has done this before".
  • You are creative, ambitious and entrepreneurial. You work fast and are highly responsive and available. You can juggle many balls when it is useful.


Software Engineering

  • You balance rapid prototyping with the creation of maintainable, scalable systems and make sound technical decisions.
  • You lead large projects from ideation to delivery, balancing innovative ML solutions with reliable, high-quality code.
  • You set high standards for system architecture, code quality, and maintainability, influencing broad software practices across the organization.


$285,548 - $503,116 a year

For very experienced and exceptional researchers, we are open to exploring paying much higher than this stated range.

The listed range applies to the base salary for this role. METR also has a host of benefits:

- The office: Catered lunch and dinner daily; in-office gym and shower

- Relocation support: Stipend for moving to the Bay Area

- Time-off and leave: Unlimited PTO and 21-week parental leave for new parents

- Commuter benefit: Monthly transit/parking stipend and an annual Uber budget

- Professional development benefit: for training, courses, conferences, and AI safety education

- Mental health benefit: for therapy, medication, and other mental health expenses

- Wellness benefit: for gym memberships and other wellness expenses

- Work equipment benefit: for home office and workstation equipment expenses

Hybrid Requirements: Our technical team members are in our office in Berkeley 3-5 days/week. Please let us know in your application if this is a constraint. If you lack US work authorization and would like to work in-person (strongly preferred), we can likely sponsor a cap-exempt H-1B visa for this role.

We encourage you to apply even if your background may not seem like the perfect fit! We would rather review a larger pool of applications than risk missing out on a promising candidate for the position.

Similar Jobs

More Jobs at METR

More Information Technology Jobs

Find similar Member of Technical Staff, Evaluation Execution jobs: