Staff Software Engineer, Code RL

Anthropic$405K — $500K+*
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Deep expertise in Python, including static typing and concurrency patterns
  • Experience designing intuitive, widely-adopted APIs or frameworks
  • Ability to work with evolving research codebases created by others
  • Demonstrated capability to foresee and mitigate silent failure modes
  • Strong communication skills to articulate designs to diverse engineering teams

Responsibilities

  • Design APIs and frameworks with a focus on clarity and usability
  • Embed with research teams to identify needs and build supportive systems
  • Enhance the reliability and structure of existing research code
  • Proactively prevent silent failures with robust design and testing
  • Ensure the operational reliability of production RL systems through monitoring

Benefits

  • Flexible work environment with hybrid policy
  • Visa sponsorship available for eligible candidates
  • Opportunity for impactful work in reinforcement learning
  • Collaboration with cutting-edge research teams
  • Chance to define engineering standards and mentor others
Full Job Description
About the role

Code RL at Anthropic drives reinforcement learning efforts behind Claude's coding capabilities, creating and scaling agentic coding environments. This is an engineering role with unusual latitude to set technical direction and standards.

You'll be part of a team solving the engineering side of research efforts such as embedding with research teams, getting up to speed on their systems and needs, and designing the frameworks, APIs, and infrastructure that let researchers move faster, then rotating off, leaving behind well-oiled systems those teams can understand, own, and maintain themselves. Your remit also includes the ongoing health of production RL runs: maintainable, monitored, and straightforward to triage.

The team's problem space spans the client side of sandboxed execution for agentic RL environments, large-scale data processing jobs, the lifecycle of production datasets, and the frameworks researchers build environments on. You won't own all of this yourself, you'll take on the slices where your depth matters most. You'll be a strong fit if you have deep expertise in Python, a refined sense of taste for API and framework design, and hard-won intuition for how complex systems fail - especially silently. You should be comfortable diving into messy research code, finding the load-bearing abstractions, and improving them incrementally while researchers continue to build on top of your work.
Key responsibilities
  • Design widely-used APIs, frameworks, and abstractions that other engineers and researchers build on, with careful attention to interface legibility and principled defaults
  • Embed with research teams on a rotational basis: understand their engineering needs, build systems and APIs that support their work, and transfer ownership so teams can maintain those systems after you rotate off
  • Work directly in research codebases, improving reliability and structure without slowing down the research they support
  • Anticipate silent failure modes and prevent them structurally through type safety, well-designed invariants, targeted testing, and refactors that shrink the surface area for bugs
  • Contribute to the reliability of production RL systems, including monitoring, regression detection, and triage tooling
  • Help define engineering standards, review practices, and design patterns for a new team, and mentor researchers and engineers in adopting them
Minimum qualifications
  • Deep expertise in Python, including static typing, safe async and concurrency patterns, and writing performant Python code
  • A track record of designing intuitive, safe APIs or frameworks that other engineers or teams adopted and built on
  • Experience working productively in large, evolving, or research-style codebases that you didn't originally write
  • Demonstrated ability to anticipate failure modes - especially silent ones - and prevent them structurally through system design, type safety, and testing
  • Strong written and verbal communication skills, including the ability to explain system designs to collaborators with varied engineering backgrounds
  • Comfort with ambiguity: able to scope your own work from a loosely defined problem and drive it to a maintainable outcome
Preferred qualifications
  • Experience building infrastructure, tooling, or frameworks for machine learning research or RL workflows
  • Familiarity with reinforcement learning concepts, agentic systems, or LLM training pipelines
  • Experience building or operating large-scale distributed systems
  • Experience building client libraries or SDKs on top of sandboxed, containerized, or remote execution platforms
  • Experience with large-scale data processing or dataset lifecycle management
  • Experience designing plugin systems or extensible class hierarchies used across an organization
  • Experience embedding with or consulting for other teams, including successfully handing off systems for others to own
  • Experience defining code standards, lint rules, or static verification approaches adopted across multiple teams
  • Prior experience as a technical lead, or setting engineering standards for a team
  • Prior experience maintaining an open source project
Representative projects

These are examples of the challenges the team tackles; no one person will work on all of them:
  • Design a base RL environment abstraction general enough to be subclassed across a wide range of environments
  • Design a model-tool interface for sandboxed agentic environments that has explicit serialization semantics
  • Partner with the platform teams that own the sandbox runtime to specify low-level features that improve the integrity of agentic coding tasks
  • Design probes that catch sandbox regressions early
  • Design the lifecycle and maintenance scheme for a production dataset
  • Lead a research code refactor replacing loosely structured data containers with equivalents that carry stronger correctness guarantees, without breaking the experiments that depend on them
  • Design lint rules and code-style requirements that favor statically verifiable patterns - including patterns less likely to be overlooked by an LLM reviewing or writing the code - to shrink the surface area for silent bugs
  • Build the access layer that lets researchers discover and reuse data artifacts across teams


The annual compensation range for this role is listed below.

For sales roles, the range provided is the role's On Target Earnings ("OTE") range, meaning that the range includes both the sales commissions/sales bonuses target and annual base salary for the role.

Annual Salary:

$405,000-$625,000 USD

Logistics

Minimum education: Bachelor's degree or an equivalent combination of education, training, and/or experience

Required field of study: A field relevant to the role as demonstrated through coursework, training, or professional experience

Minimum years of experience: Years of experience required will correlate with the internal job level requirements for the position

Location-based hybrid policy: Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.

Visa sponsorship: We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this.

About Anthropic

Anthropic is an artificial intelligence research lab that focuses on developing AI systems that are safe, reliable, and trustworthy. The company was founded in 2019 by Dr. Yoshua Bengio, a leading AI researcher and winner of the Turing Award. Anthropic's research is focused on developing AI systems that can learn from small amounts of data, reason about complex systems, and interact with humans in a natural way. The company is based in New York City and has a team of experienced AI researchers and engineers.
Learn more about Anthropic
Size
50 employees
Industry
Founded
2019

Similar Jobs

More Jobs at Anthropic

More Information Technology Jobs

Find similar Staff Software Engineer, Code RL jobs: