2-7 years of AI or reinforcement learning engineering experience, particularly in building RL environments and evaluation systems.
Strong full-stack or backend engineering skills with a proven track record of shipping production code.
Proficiency in Python, PyTorch, reinforcement learning, and ML evaluation frameworks.
Familiarity with distributed systems and data pipelines, including scraping and indexing.
A degree in computer science and fluent English communication skills.
Willingness to work on-site in San Francisco five days a week.
Responsibilities
Build and scale reinforcement learning environments and evaluation frameworks for creative domains.
Design tasks and grading rubrics to assess design quality and taste.
Develop agent harnesses, context layers, and supporting product infrastructure.
Collaborate with internal research teams to enhance model output quality.
Ship production code end-to-end and establish reliable backend systems and data pipelines.
Benefits
Competitive equity package.
Support for visa transfers, including OPT and H1B transfers.
Full Job Description
The role
As AI Engineer, RL & Evals, you will build reinforcement learning environments, evaluation frameworks and production infrastructure for creative domains. You will combine backend or full-stack product engineering with applied ML and own systems from design through delivery.
What you'll do • Build and scale RL environments and evaluation frameworks for creative, non-verifiable domains. • Design tasks and grading rubrics that capture design quality and taste. • Build agent harnesses, context layers and supporting product infrastructure. • Collaborate with internal research teams and frontier labs to improve model output quality. • Ship production code end to end and build reliable backend systems and data pipelines.
Requirements
What we're looking for • 2-7 years of relevant AI or reinforcement learning engineering experience, with depth building RL environments, evaluation systems or ML post-training systems. • Strong full-stack or backend engineering skills and demonstrated production shipping experience. • Experience with Python, PyTorch, RL, ML evaluation frameworks and LLMs. • Knowledge of distributed systems and data pipelines; relevant scraping, indexing, embedding or agent-harness work is valuable. • A computer science degree and fluent English communication. • Ability to work in the San Francisco office five days per week.
Bonus points • Experience at creative technology, generative AI, crawling, indexing or data companies. • Building agentic frameworks or evaluations for non-verifiable domains. • Experience connecting research work to practical products and infrastructure.
Benefits
Compensation and benefits • $175,000-$275,000 annual base salary. • Competitive equity.
Location and work model
Full-time, on-site five days per week in Levi's Plaza, San Francisco, California. Visa transfers, including OPT and H1B transfers, are supported.
