Safety Validation Lead, Scenarios

Atoms

$149K — $188K *
Manufacturing & Automotive
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 6+ years in safety validation or test engineering for automated vehicles or safety-critical domains, with practical experience over management roles.
  • Proven track record in scenario-based validation with ownership of a scenario catalog.
  • Hands-on expertise with crash-avoidance consumer test protocols and an ability to adapt them for practical application.
  • Strong data handling skills with large vehicle log datasets; proficient in Python and statistical analysis of rare events and coverage.
  • Experience with ASAM OpenSCENARIO and OpenDRIVE, including scenario authoring and debugging; knowledge of relevant safety standards such as ISO 21448 and ISO 34502.
  • Familiarity with simulation principles, particularly understanding simulation evidence credibility and limitations.
  • Excellent written communication skills for clear coverage argumentation.

Responsibilities

  • Define and maintain criteria for safety-relevant scenarios and oversee the taxonomy of these scenarios.
  • Build and manage data extraction pipelines to identify and parameterize log-based safety events.
  • Implement and sustain standardized crash-avoidance protocols and associated test suites.
  • Determine scenario execution methods and maintain a regression suite to manage validation accuracy.
  • Interface with functional safety and safety operations to provide scenario-based evidence for validation arguments.

Benefits

  • Medical, Dental, Vision, Disability, and Life Insurance
  • Flexible Spending Account / Health Savings Account Options
  • 401(k) with company matching
  • Equity options
  • Unlimited flexible time off and paid holidays
  • Paid parental leave
  • Pre-Tax Commuter Benefit Plan
  • Weekly team lunches in office.
Full Job Description
About the role

This role owns the safety-relevant scenarios we validate against. You will define what makes a scenario safety-relevant, build the catalog, and own the argument that it is sufficient.

The catalog draws from two sources that behave very differently. Log-based scenarios come from real events, real interactions, and real distributions, and they bring the problem of finding the few that matter inside a very large volume of ordinary driving. NCAP-based scenarios come from the crash-avoidance portions of published consumer test protocols: precisely specified, externally credible, and designed for a driver-assist framing that has to be adapted before it means anything for an automated platform. You will own both, and you will own the harder question of how they fit together into one coverage argument.

This is a technical individual contributor role. You will build the pipelines and write the analysis yourself, and the coverage position you take becomes part of the safety case.

What you'll do

  • Scenario definition and taxonomy. Own the criteria that make a scenario safety-relevant and the criticality measures that decide it. Maintain the taxonomy and the abstraction levels - functional, logical, concrete - and keep the catalog coherent as it grows rather than letting it accrete.
  • Log-based scenario extraction. Build the pipeline that mines fleet data for safety-relevant events - disengagements, interventions, near-misses, anomalous interactions - and converts them into parameterized, reusable scenarios. Own the criticality metrics used to surface candidates, such as time-to-collision, post-encroachment time, and margin to the drivable envelope, and be clear-eyed about what those metrics miss.
  • Crash-avoidance protocol suites. Own the implementation and upkeep of standardized suites derived from the crash-avoidance portions of NCAP and equivalent published protocols - AEB car-to-car, AEB vulnerable road user (pedestrian, cyclist, motorcyclist), lane support, and emergency steering cases - including test conditions and pass/fail criteria.
  • Execution and evidence. Define how scenarios run - resimulation, SIL and HIL, vehicle-in-the-loop, closed course, on-road - and what evidence each method can and cannot produce. Own the regression suite that keeps known failures from returning.
  • Interfaces. Take triggering conditions and hazards from functional safety and field events from safety operations, and return scenario-based evidence they can rely on. Your output is a substantial part of the validation argument in the safety case.

Working AI-native

We expect this role to be materially more productive than the same role was three years ago, and we expect AI tooling to be the reason. We are adopting AI systems purpose-built to accelerate safety analysis - scenario mining and categorization, criticality assessment, parameter space search, and documentation - and this role is expected to put them to work and shape what they become. Concretely, we want someone who:
  • Uses LLM-based and purpose-built tooling as a working instrument in the analysis itself - classifying and clustering large volumes of log events, proposing and stress-testing scenario variants, cross-checking a catalog for gaps, mapping published protocols onto our own taxonomy, and drafting and maintaining validation documentation.
  • Builds their own tooling rather than filing tickets for it. Writes the extraction pipelines, the coverage analysis, and the reporting, and keeps them running.
  • Understands where AI assistance is legitimate and where it is not. A generated scenario set is a hypothesis to verify, never coverage. Validation claims require human judgment and traceable justification, and you should be rigorous about that boundary while still capturing the leverage.
  • Can reason about the limits of the evidence - simulation fidelity, distribution shift between logged and simulated behavior, and what a passing suite does and does not entitle you to claim.

We would rather hire a strong validation engineer who is curious and moving fast on AI tooling than someone who has the vocabulary but not the practice. Be prepared to show us how you actually work.

What we're looking for
  • 6+ years in safety validation, verification, or test engineering for automated vehicles, ADAS, or another safety-critical domain, with deep hands-on experience rather than test management alone.
  • Demonstrated ownership of scenario-based validation on a real program: you have built or substantially shaped a scenario catalog and defended its sufficiency to someone who pushed back.
  • Hands-on experience with the crash-avoidance side of published consumer test protocols - Euro NCAP's Crash Avoidance protocols in the 2026 series, the ADAS component of US NCAP, or equivalent - and the judgment to adapt rather than transplant them.
  • Strong data ability. You work directly with large volumes of vehicle log data: querying it, building extraction and clustering pipelines, and forming a defensible position from it. Strong Python; comfortable with the statistics of exposure, rare events, and coverage.
  • ASAM OpenSCENARIO and OpenDRIVE, hands-on - you have authored and debugged scenarios in them. ISO 21448 (SOTIF) as the frame for why safety-relevant scenarios matter, and ISO 34502 as the scenario-based safety evaluation framework. Familiarity with SAE J3016.
  • Simulation experience, and specifically an informed view of where simulation evidence is credible and where it is not.
  • Clear written communication. Coverage arguments live or die on whether a reader can follow the reasoning.

Nice to have
  • Proving ground or closed-course test execution experience, including instrumented targets and test equipment.
  • Experience with falsification, adversarial scenario search, or criticality-driven parameter sampling.
  • Experience contributing scenario-based evidence to a safety case defended to an external party.
  • Background in traffic safety research, crash data analysis, or naturalistic driving studies.
  • Experience building validation infrastructure - scenario databases, resimulation at scale, CI for autonomy.


What else you need to know

This role is based in our San Francisco office. Atoms is a company driven by invention and continuous change - we are constantly reimagining our industries, building new products, and refining how we operate. We do our best work together. That's why all of our office-based teams work onsite, five days a week.

The base salary range for this role is $149,000 - $188,000 per year.

Actual compensation will be determined on an individual basis and may vary depending on experience, skills, and qualifications.

Base salary is just one part of your total rewards package. You may also be eligible for equity awards.

Benefits Summary (USA Full-Time Exempt Employees):
  • Medical, Dental, Vision, Disability, and Life Insurance
  • Flexible Spending Account / Health Savings Account Options
  • 401(k)
  • Equity
  • Sick Time, Unlimited Flexible Time Off, and Paid Holidays
  • Paid Parental Leave
  • Pre-Tax Commuter Benefit Plan
  • Team lunch in our SoMa office every Tuesday and Thursday

Benefits are subject to change at the company's discretion.
Atoms accepts applications on an ongoing basis.

Ready to join us as we serve those who serve others?

#LI-Onsite

Similar Jobs

More Jobs at Atoms

More Manufacturing & Automotive Jobs

Find similar Safety Validation Lead, Scenarios jobs: