5-7 years of experience in reinforcement learning and model training.
Deep expertise in reward modeling and credit attribution.
Experience with large-scale training of 30B+ language models.
Proficiency in Python and ML frameworks like PyTorch and HuggingFace.
Familiarity with cloud platforms and ML infrastructure (AWS, GCP, Kubernetes).
Strong software engineering skills for building research prototypes.
Ph.D. in machine learning or related field preferred.
Responsibilities
Research and implement advanced reinforcement learning techniques for data products.
Design data pipelines for generating high-quality training signals.
Prototype end-to-end RL training recipes for data-as-a-service.
Collaborate with teams to translate RL research into customer-ready products.
Stay updated on developments in LLM training and scalable RL methods.
Contribute to research publications and internal knowledge base.
Benefits
Collaborative work environment with cross-functional teams.
Opportunity to contribute to cutting-edge AI research.
Access to advanced tools and technologies in ML.
Potential for professional growth and development in a leading AI company.
Full Job Description
ABOUT THE ROLE
We're looking for a Research Scientist to work on reinforcement learning for training and aligning large language models. This is a foundational research role focused on one of the most consequential open data problems in AI: how to generate the data, reward signals, and training procedures that steer LLM behavior in reliable and generalizable directions - and a core capability that directly differentiates Snorkel's data-as-a-service offering.
You'll work closely with Snorkel's research, engineering, and delivery teams to advance our RL data capabilities - translating research ideas into the preference datasets, reward models, and RL-ready corpora we produce for frontier AI labs, and contributing to a research agenda that is central to Snorkel's long-term differentiation as a provider of bespoke training data.
MAIN RESPONSIBILITIES
Research and implement reinforcement learning techniques - including GRPO, RLHF, RLAIF, DPO, and reward modeling - and translate them into data products (preference datasets, reward signals, verifiable rewards) that customers can use to train and fine-tune large language models.
Design and build data pipelines that generate high-quality training signal for RL workflows, including AI-assisted data annotation and curation data pipelines to improve model generalization to unseen benchmarks .
Prototype and iterate on end-to-end RL training recipes that inform what data Snorkel ships as part of its data-as-a-service deliveries.
Work closely with research scientists, ML engineers, and delivery teams to translate RL research into customer-ready data products.
Stay current with the latest developments in large-scale muli-node LLM training, alignment research, and scalable RL methods (on complex environments such as Terminal-Bench), bringing relevant advances into Snorkel's data-as-a-service approach.
Contribute to Snorkel's research publications and internal knowledge base in RL and model training.
PREFERRED QUALIFICATIONS
Deep expertise in reinforcement learning from human or AI feedback, reward modeling and credit attribution ideally with a clear perspective on what data makes these techniques work.
Experience training or fine-tuning 30B+ large language models at scale, including familiarity with distributed training infrastructure.
Strong proficiency in Python and ML frameworks, especially PyTorch and HuggingFace and hands-on experience with RL frameworks such as Verl and SkyRL.
Solid software engineering fundamentals - you can build research prototypes that others can run, extend, and integrate into data production workflows.
Familiarity with ML infrastructure and cloud platforms and tools (AWS, GCP, Kubernetes, Slurm, etc.); experience with large-scale RL training pipelines a strong plus.
Comfort operating in a high-iteration environment with open-ended research questions and shifting, customer-driven technical constraints.
Ph.D. in machine learning, reinforcement learning, or a related field strongly preferred; exceptional industry experience considered.
Actual compensation will be determined based on factors including skills, qualifications, experience, and geographic location.
Salary range(s) for this role
$200,000-$350,000 USD
About Snorkel AI
Snorkel AI is an artificial intelligence company that provides a platform for building and managing machine learning models. The company was founded in 2019 and is headquartered in San Francisco, California. Snorkel AI's platform is designed to make it easier for developers and data scientists to create and manage machine learning models, using a technique called programmatic labeling. The company's platform is used by a number of large enterprises, including Intel, Google, and Microsoft. Snorkel AI has raised over $50 million in funding to date.
