OpenAI

Data Scientist, Preparedness

OpenAI • $135K — $160K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • Significant experience in data science or applied analytics in high-stakes domains
  • Strong foundations in experimentation and causal thinking
  • Fluency in SQL and Python for analysis and modeling
  • Experience in building impactful metrics and dashboards
  • Track record of driving cross-functional impact with partners
  • Cybersecurity data science experience is preferred
  • Genuine interest in AI safety and catastrophic risk prevention.

Responsibilities

  • Evaluate and improve mitigation systems across various domains
  • Diagnose false positives and false negatives with clear recommendations
  • Build frameworks to track mitigation effectiveness over time
  • Identify trends in blocking behavior and propose interventions
  • Develop insights from customer feedback to detect shifts in behavior
  • Expand risk monitoring into new areas with domain experts
  • Communicate results to stakeholders with decision-ready metrics.

Benefits

  • Meaningful work that has far-reaching importance for society.
  • Opportunities for professional growth in a fast-paced environment.
  • Collaboration with a team dedicated to AI safety and reliability.
  • Access to cutting-edge technology and research in AI.
Full Job Description
About the Role

We're hiring a Data Scientist to help build, evaluate, and continuously improve mitigations that prevent extreme harms from AI systems. This role is for an experienced, highly autonomous individual contributor who can take ambiguous problem statements, structure rigorous analyses, and translate findings into actionable product and policy changes.

This position goes beyond "running evals." You'll help create mitigation intelligence and monitoring systems that enable OpenAI to detect issues early, measure effectiveness over time, and reduce both over-blocking (unnecessary friction) and under-blocking (missed harm).

What You'll Do
  • Evaluate and improve mitigation systems, including classifiers and detection pipelines across domains (e.g., biosecurity, cybersecurity, and emerging risk areas).
  • Diagnose false positives and false negatives with deep error analysis, root cause investigation, and clear recommendations for mitigation adjustments.
  • Build monitoring and measurement frameworks to track mitigation effectiveness over time and across user segments and use cases.
  • Identify trends in over-blocking vs. under-blocking, quantify customer impact, and propose prioritized interventions.
  • Develop insights from customer feedback, complaints, and usage patterns to detect shifts in adversarial behavior and system failure modes.
  • Expand risk monitoring into new areas, including cybersecurity threats and model loss-of-control or sabotage scenarios, in partnership with domain experts.
  • Communicate results to technical and executive stakeholders with crisp narratives, decision-ready metrics, and clear tradeoffs.

You might thrive in this role if you are:
  • An autonomous operator: you can take a problem statement and independently structure the analysis end-to-end.
  • Strong at executive-ready communication: concise, clear, and outcome-oriented.
  • Skilled in turning analysis into productable changes: you're comfortable influencing across functions to drive mitigation improvements.
Qualifications
  • Significant experience in data science or applied analytics in high-stakes domains (e.g., security, trust & safety, abuse prevention, fraud, platform integrity, or reliability).
  • Strong foundations in experimentation, causal thinking, and/or observational inference; ability to design robust measurement under imperfect data.
  • Fluency in SQL and Python (or equivalent) for analysis, modeling, and building monitoring workflows.
  • Experience building metrics, dashboards, and operational monitoring that meaningfully changes outcomes (not just reporting).
  • Track record of driving cross-functional impact with engineering, product, and research partners.
  • Cybersecurity data science experience (strong preference), including exposure to threat modeling, adversarial dynamics, abuse patterns, or security telemetry.
  • Experience with classifier evaluation, calibration, thresholding, and error analysis at scale.
    Familiarity with detection systems in adversarial settings (e.g., evasion, distribution shift, feedback loops).
  • Trust & Safety experience is helpful, but not required.
  • Genuine interest in AI safety, alignment, and catastrophic risk prevention.

About OpenAI

OpenAI is an artificial intelligence research laboratory consisting of the for-profit corporation OpenAI LP and its parent company, the non-profit OpenAI Inc. The company was founded in 2015 by a group of technology leaders, including Elon Musk, Sam Altman, Greg Brockman, Ilya Sutskever, and John Schulman. OpenAI's mission is to develop and promote friendly AI for the betterment of humanity. The company has developed a number of cutting-edge AI technologies, including GPT-3, a language processing system that can generate human-like text. OpenAI has received funding from a number of high-profile investors, including LinkedIn co-founder Reid Hoffman and venture capitalist Peter Thiel.
Learn more about OpenAI
Size
100 employees
Industry
Founded
2015

Similar Jobs

More Jobs at OpenAI

More Information Technology Jobs

Find similar Data Scientist, Preparedness jobs: