5-7 years of experience in data science or a related field
Proficiency in SQL and Python for data analysis
Strong statistical judgment with a focus on experimentation and causal inference
Ability to communicate complex concepts to both technical and non-technical audiences
Experience in integrity, trust and safety, or fraud analytics is advantageous
Responsibilities
Investigate and analyze anomalous activity across products
Define and establish outcome metrics and monitoring systems
Build and evaluate detection rules and human review workflows
Design and implement randomized holdouts and observational studies
Trace and analyze breakdowns in signals and enforcement actions
Benefits
Collaborative work environment with cross-functional teams
Opportunity to influence product improvements and decision-making
Access to advanced AI tools for data analysis
Engagement in meaningful work addressing integrity and safety issues
Professional development opportunities in data science and analytics
Full Job Description
About the Role
As a Data Scientist on Integrity, you'll find emerging abuse patterns, size their impact, and lead the analytical work behind decisions about detection, enforcement, and product launches. You'll work with Product, Engineering, Research, Policy, and Operations to turn findings into improvements and measure what happens after they ship.
Investigate anomalous activity across products. Estimate how common a problem is, who is affected, and what it costs users or the business. Use that evidence to recommend where to focus.
Define outcome metrics and guardrails, establish baselines, and build monitoring that surfaces changes in abuse, customer friction, and operational performance.
Help build and evaluate detection rules, classifiers, and human review workflows. Use labeled samples and review outcomes to understand what the systems miss, where they flag legitimate activity, and how those errors vary across users and products.
Design randomized holdouts and use quasi-experimental or observational methods when randomization is impractical. Estimate harm or fraud losses prevented alongside effects on legitimate users, revenue, compute costs, and review workload. Recommend whether to launch, expand, adjust, or retire a control.
Trace where signals, review decisions, or enforcement actions break down. Work with partners to close gaps and build reusable datasets, analyses, and investigation tools.
Ideal Candidate
You use AI tools to investigate large, messy datasets, test hypotheses quickly, and automate recurring analyses. You're fluent in SQL and Python and can verify AI-generated queries, code, and conclusions against the underlying data.
You have strong statistical judgment and experience with experimentation, causal inference, or observational analysis. You can reason from incomplete or biased labels and explain how uncertainty affects a decision.
You take ownership of open-ended problems, from deciding what to measure through recommending an action and checking whether it worked.
You communicate clearly with technical and nontechnical partners and can explain the tradeoffs behind a recommendation.
Experience in integrity, trust and safety, fraud or risk analytics, security analytics, or applied ML evaluation is helpful. Experience evaluating detection systems, human review, or LLM-based classifiers is a plus.
About OpenAI
OpenAI is an artificial intelligence research laboratory consisting of the for-profit corporation OpenAI LP and its parent company, the non-profit OpenAI Inc. The company was founded in 2015 by a group of technology leaders, including Elon Musk, Sam Altman, Greg Brockman, Ilya Sutskever, and John Schulman. OpenAI's mission is to develop and promote friendly AI for the betterment of humanity. The company has developed a number of cutting-edge AI technologies, including GPT-3, a language processing system that can generate human-like text. OpenAI has received funding from a number of high-profile investors, including LinkedIn co-founder Reid Hoffman and venture capitalist Peter Thiel.