5-7 years of experience in research and data analysis
Proficient in Python and SQL
Strong background in statistical methods and experimental design
Experience in early-stage or ambiguous environments
Effective communicator with ability to influence stakeholders
Responsibilities
Drive in-house research on consumer LLM behavior
Support product and engineering teams with analysis and experimental insights
Design and analyze experiments to gather data
Develop methods for causal inference in product decisions
Transform research insights into actionable product enhancements
Benefits
Opportunity for published research
Work on cutting-edge consumer technology
Collaborative environment with product and engineering teams
Exposure to high-impact decision-making processes
Full Job Description
What You'll Do
Drive our research. Shape the direction of in-house research on how consumer LLMs search, reason, and synthesize sources. Stay on top of frontier AEO/GEO research, form hypotheses, and test them with scientific rigor. Your work will be published.
Set the standard for data-driven decision making. Support the product and engineering teams with the analysis and experiments behind key product decisions, from our agent evals to changes in our core analytical pipelines.
Run experimentation and causal inference. Design and analyze experiments, and build measurement even when clean A/B tests aren't possible.
Turn research into a product. A finding about model behavior is only true for the moment it was measured, and the models change constantly. Build the data pipelines and recurring measurement that keep our research live rather than a snapshot, and push the durable findings into the product.
You'll Excel in This Role If You
Are an expert in Python and SQL
Have strong statistical and experimentation foundations in experiment design, effect estimation, and evaluation metrics
Have built in early-stage, nebulous environments and can strike the right balance between speed and rigor
Communicate clearly in writing and in person, and can influence stakeholders with evidence
