Snorkel AI

Research Scientist - Human-AI Systems

Snorkel AI • $200K — $375K *
Consumer Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Ph.D. in machine learning, NLP, or a related field preferred, or equivalent experience.
  • Strong research background in AI, machine learning, NLP, LLMs, or related fields.
  • Experience with synthetic data generation and human in the loop workflows.
  • Proficiency in experimental design and hypothesis testing.
  • Familiarity with software engineering best practices.
  • Ability to translate domain expert input into actionable tasks and workflows.
  • Comfort with ambiguity and rapid iteration in research.

Responsibilities

  • Design and optimize reusable pipelines that integrate AI capabilities and expert judgment.
  • Run rigorous experiments to validate new approaches and measure impacts on data quality and pipeline efficiency.
  • Collaborate with engineering and domain experts to transition prototypes to production workflows.
  • Develop and test workflows that assist experts in authoring and refining data.
  • Work cross-functionally to translate research insights into actionable company strategies.
  • Stay abreast of cutting-edge research and integrate best practices into workflows.
  • Represent the company through publications, talks, and customer engagements.

Benefits

  • Flexible work location: San Francisco, New York, or remote.
  • Opportunity to work on frontier AI and data-centric environments.
  • Collaboration with a cross-disciplinary team of experts and engineers.
  • Chances to publish and share research findings externally.
  • Position at a company dedicated to amplifying human knowledge and judgment.
Full Job Description
We9re looking for a Research Scientist to advance how high-quality data and environments for AI agents are created. You9ll build and optimize pipelines that combine real-world data, automated generation, and human expert input. Working with domain experts, academic partners, customers, and our product and engineering teams, you9ll scale these pipelines to target frontier model performance gaps and expand data and environment diversity. Your work will amplify human knowledge and judgement, enabling experts to create and refine data and agentic environments that strengthens Snorkel9s position as the frontier data lab. This role is ideal for someone who wants to advance frontier AI through data and environment creation and enjoys turning research into reusable, scalable systems. Location: San Francisco, New York, **OR REMOTE** **Main Responsibilities** - Design, implement, and optimize reusable pipelines that combine AI capabilities with expert judgment to accelerate data and agentic environment creation. - Design and run rigorous experiments to validate proof-of-concept approaches, measure their impact on data quality, pipeline efficiency, and model performance, and communicate findings. - Partner with engineering, data operation, domain experts, and customers to turn research prototypes into reliable production workflows. - Work directly with domain experts to design and test workflows that help them author, review, and refine data and environments. - Work cross-functionally with data operations, product, and engineering to surface research findings that inform the company roadmap. - Stay at the frontier of research in data and agentic environment creation and bring best practices into Snorkel9s workflows. - Represent Snorkel9s research externally through publications, blog posts, conference talks, and customer engagements that advance the conversation around data-centric AI. **Preferred Qualifications** - Strong research background in AI, machine learning, NLP, LLMs, or related fields, with experience developing and evaluating new methods. - Experience building environments for AI agents in automated research, computer use, coding, or professional domain workflows. - Experience with one or more of synthetic data generation, human in the loop workflows, reinforcement learning, agent environments, or model evaluation. - Strong experimental design skills, including defining hypotheses and conducting ablations. - Experience with software engineering best practices (e.g., clean coding, modular design, version control). - Ability to collaborate with domain experts and translate their knowledge into concrete tasks, evaluation criteria, and repeatable workflows. - Comfort with rapid iteration, ambiguous research questions, and moving ideas from experimentation into production. - Ph.D. in machine learning, NLP, or a related field preferred; equivalent industry or research lab experience considered. Actual compensation will be determined based on factors including skills, qualifications, experience, and geographic location. Salary range(s) for this role $200,000-$375,000 USD

About Snorkel AI

Snorkel AI is an artificial intelligence company that provides a platform for building and managing machine learning models. The company was founded in 2019 and is headquartered in San Francisco, California. Snorkel AI's platform is designed to make it easier for developers and data scientists to create and manage machine learning models, using a technique called programmatic labeling. The company's platform is used by a number of large enterprises, including Intel, Google, and Microsoft. Snorkel AI has raised over $50 million in funding to date.
Learn more about Snorkel AI
Size
50 employees
Industry
Founded
2019

Similar Jobs

More Jobs at Snorkel AI

More Consumer Technology Jobs

Find similar Research Scientist - Human-AI Systems jobs: