Job Description:
Data Scientist III, Experimentation ScienceChewy is looking for a
Data Scientist III to join the Experimentation Platform (A/B testing) to join our team in
Bellevue, WA or
Boston, MA. Our platform supports hundreds of active internal users across multiple teams and organizations, enabling rigorous A/B testing to drive new customer experiences. In this role, you will play a key role in crafting and advancing measurement best practices and advanced methodologies across the business. This is a high-impact, high-visibility position that plays a meaningful role in how Chewy measures and implements customer-facing changes. You'll work cross-functionally with teams across the business, gaining exposure to diverse domains and influencing decision-making at the highest levels. Join a collaborative, fast-paced team where you'll tackle new challenges daily, contribute to meaningful outcomes, and grow alongside a platform that's central to Chewy's core business strategy.
What You'll Do: - Apply statistical methodologies to design and analyze online experiments (e.g., A/B/n, MAB, holdouts).
- Develop relevant surrogate metrics for faster and more accurate experimentation considering full customer journey and tradeoffs.
- Build out and operationalize causal inference models to calculate annualized incremental lift. Build models to measure long-term impact using high value actions.
- Develop robust holdout design to measure aggregate impact, long term impact, and novelty effect
- Support experimentation platform users with guidance on test setup, metric selection, and hypothesis framing.
- Ensure quality of data and computation by developing monitoring and alerting mechanisms to catch spillovers and bias and provide guidance on step-wise identification of root-causes.
- Define and operationalize experimentation best practices, statistical and scientific methodologies and scalable frameworks for creating, monitoring, and learning from experiments.
- Build AI agents to optimize experiment workflows and knowledge retrieval.
Qualifications: - Bachelor's degree in a quantitative field (e.g., Statistics, Mathematics, Data Science, Economics, Computer Science) or related experience.
- 5+ years Data Science experience.
- 4+ years of experience with A/B testing, preferably within an e-commerce environment.
- 4+ years of experience with causal inference techniques or modeling long-term treatment effects (Diff-in-diff, Propensity Score Matching, Causal Forest, etc...).
- Strong foundational knowledge in statistics (e.g., hypothesis testing, confidence intervals, variance reduction).
- Advanced object-oriented programming in Python.
- Advanced knowledge of SQL.
- Experience communicating insights to non-technical audiences.
- Familiarity with using LLMs and AI Agents to automate data and analytical workflows.
- The specific salary offered to a candidate may be influenced by a variety of factors including but not limited to the candidate's relevant experience, education, and work location. In addition, this position is eligible for 401k and a new hire and annual equity grant. C08+ positions may also be eligible for annual bonus.
We offer different types of insurance and benefits, such as medical/Rx, vision, dental, life, disability, hospital indemnity, critical illness, and accident. We offer parental leave, family services benefits, backup dependent care, flexible spending accounts, telemedicine, pet adoption reimbursement, employee assistance program, and many discounts including 10% off pet insurance and 20% off at Chewy.com.
Exempt salary team members have unlimited PTO, subject to manager approval. Team members will receive six paid holidays per year. Team members may be eligible for paid sick and family leave in compliance with applicable state and local regulations.
