About the Team:The Content Platform & Experience team owns how learning content is created, found and studied on Quizlet. It spans Content Platform (user-generated study material and its quality and safety), Search, Creation and Conversational AI experience. We partner closely with the Data Platform team, who manage our data stores and with the product team.
About the Role:As the Data Scientist for Content Platform & Experience, your goal is to build trust in our data and enable the team to answer most questions on their own. You'll make sure content, search and Coach data reaches our data store correctly, define the metrics we rely on, focus on high-stakes experiments, search and recommendation evaluation, and measure how well AI Coach helps learners. 30% of the time will be on data engineering efforts, ensuring our search data pipeline is optimized and reliable.
In this role, you will:- Own data quality that we rely on to measure the health of the domain and iterate on experiments.
- Write tracking plans and data contracts for new features so every launch has trusted usage data from day one.
- Define engagement metrics for content health, search quality and conversational experiences, and make them available in Omni dashboards the teams use every week.
- Design and analyze high-stakes A/B tests across search ranking, AI feature rollouts and content features
- Own the dbt models and contract tests that feed our search indexes, and build reproducible training and offline-evaluation datasets for search ranking and recommendation models.
What you bring to the table:- 4+ years in data science or product analytics, with a degree in statistics, computer science, economics, math or another quantitative field
- Advanced SQL and proficiency in Python
- Hands-on experience designing and analyzing A/B tests, with solid statistics (hypothesis testing, regression, causal inference basics)
- Hands-on data modeling in a warehouse (e.g., dbt on BigQuery), including data contract tests
- Working knowledge of batch pipelines (e.g., Airflow): incremental loads, backfills, and the order changes must ship in
- Experience owning data quality for a product area: event instrumentation, tracking plans and validation
- Experience building training or evaluation datasets from product logs
- A track record of helping non-technical partners self-serve data, through training, documentation or well-designed dashboards
- Clear written and verbal communication
Bonus points if you have:- Experience with Omni, Looker or another BI semantic layer
- Recommender evaluation (recall, NDCG) or feature stores such as Feast
- LLM or conversational AI evaluation (e.g., Arize)
Work LocationWe're happy to share that this is a
hybrid position in our
San Francisco/New York office. To support collaboration, we ask employees to be in the office at least
two days a week: Wednesday and Thursday.
Compensation, Benefits & Perks:- Collaborate with your manager and team to create a healthy work-life balance
- 20 vacation days that we expect you to take!
- Competitive health, dental, and vision insurance (100% employee and 75% dependent PPO, Dental, VSP Choice)
- Employer-sponsored 401k plan with company match
- Access to LinkedIn Learning and other resources to support professional growth
- Paid Family Leave, FSA, HSA, Commuter benefits, and Wellness benefits
- 40 hours of annual paid time off to participate in volunteer programs of choice
We strive to make everyone feel comfortable and welcome!We work to create a holistic interview process, where both Quizlet and candidates have an opportunity to view what it would be like to work together, in exploring a mutually beneficial partnership. We provide a transparent setting that gives a comprehensive view of who we are!
