Clinical Research Scientist, Mental Health AI

Vals

$120K — $145K *
Healthcare
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • PhD, PsyD, MD, or equivalent in Clinical Psychology, Psychiatry, Behavioral Science, Public Health, or a related field.
  • Experience in empirical research design, analysis, and scientific writing.
  • Strong knowledge of psychopathology, clinical assessment, and risk evaluation.
  • Proven track record in peer-reviewed research publications.
  • Familiarity with a range of clinical and psychological research methods, including quantitative and qualitative approaches.
  • Ability to convert complex clinical ideas into measurable evaluation criteria.

Responsibilities

  • Lead the design of evaluations for AI systems in mental health contexts.
  • Identify clinical failure modes and translate these into actionable scenarios and scoring criteria.
  • Design validation studies that include clinician reviews and inter-rater reliability metrics.
  • Collaborate with clinical and academic partners to create rigorous evaluation benchmarks.
  • Work alongside engineers to implement scalable evaluation methods.
  • Analyze model behavior and contribute to the overall research agenda and publications.

Benefits

  • Ownership of the mental health AI research direction.
  • Collaborative environment with clinical, technical, and research teams.
  • Access to strong technical support for large-scale research initiatives.
  • Health and dental insurance coverage.
  • Free lunch, dinner, snacks, coffee, and drinks.
  • $1,500 housing stipend for local living arrangements.
  • Unlimited paid time off.
Full Job Description
About the Role

We're looking for a Clinical Research Scientist to help lead and expand our work evaluating AI systems in mental health and other clinically sensitive settings.

As people increasingly use AI for emotional support, health information, and guidance during periods of distress, we need better ways to determine whether these systems respond safely and appropriately. Many important risks emerge over the course of a conversation, including missed signs of escalating distress, reinforcement of harmful beliefs, diagnostic overreach, and unhealthy emotional dependence.

You'll work closely with our existing research team and engineers to build clinically grounded benchmarks, realistic multi-turn scenarios, scoring criteria, and validation studies. You'll help define what safe and unsafe model behavior looks like and ensure our evaluations reflect meaningful clinical risks.

This role is a strong fit for a clinical psychologist, psychiatrist, or clinical scientist who wants to help shape a growing research program in mental health AI evaluation while maintaining active academic and clinical collaborations.

What You'll Do
  • Lead the clinical design of evaluations for AI systems used in mental health and other sensitive domains.
  • Identify important clinical failure modes and translate them into realistic scenarios and clear scoring criteria.
  • Design studies to validate evaluation methods, including clinician review, inter-rater reliability, and comparisons with real-world interaction data.
  • Work with psychologists, psychiatrists, researchers, and academic collaborators to develop rigorous benchmarks.
  • Partner with technical researchers and engineers to implement evaluations at scale.
  • Analyze model behavior, publish findings, and help shape our broader research agenda.


Requirements
  • PhD, PsyD, MD, or equivalent research training in Clinical Psychology, Psychiatry, Behavioral Science, Public Health, or a closely related field.
  • Experience designing and leading empirical research, including study design, analysis, and scientific writing.
  • Strong grounding in psychopathology, clinical assessment, risk evaluation, or evidence-based mental health care.
  • Track record of peer-reviewed research.
  • Experience with clinical, behavioral, quantitative, qualitative, or psychometric research methods.
  • Ability to translate clinical concepts into clear, testable evaluation criteria.


Nice to Have
  • Research in adolescent mental health, suicide or self-harm, psychosis, eating disorders, trauma, or other clinically complex areas.
  • Experience developing or validating clinical measures, rating systems, or coding frameworks.
  • Experience with longitudinal research, conversation analysis, or real-world behavioral data.
  • Experience studying AI or other digital technologies.
  • Familiarity with large language models or AI evaluation.
  • Experience leading IRBs or cross-institutional collaborations.


What We Offer
  • Significant ownership over the direction of our mental health AI research
  • Close collaboration with clinical, technical, and research colleagues
  • Strong technical support and resources for large-scale studies
  • Competitive salary, meaningful equity, and title flexibility based on experience
  • Health and dental insurance
  • Lunch and dinner provided, plus snacks, coffee, and drinks
  • $1,500 housing stipend (within one-mile radius of our office)
  • Unlimited PTO

Similar Jobs

More Jobs at Vals

More Healthcare Jobs

Find similar Clinical Research Scientist, Mental Health AI jobs: