Autodesk, Inc

Principal AI Research Scientist Post-Training - Alignment - Reinforcement Learning Autodesk AI Lab: London - San Francisco - Toronto - Remote (US/CA/EU

Autodesk, Inc$130K — $180K *
Plano, TX 75025In-Person
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Deep expertise in reinforcement learning for foundation models and post-training methods (RLHF, RLAIF, etc.)
  • Experience leading or mentoring technical research teams in various environments
  • Intuition for model behavior, alignment challenges, and trade-offs
  • Ability to design evaluation systems for model readiness
  • Strong communication skills for technical and non-technical audiences
  • PhD or equivalent experience in ML, RL, AI, or related fields
  • Background in alignment research or agentic AI

Responsibilities

  • Conduct post-training model development including RLHF and preference optimization
  • Develop algorithms to enhance model reliability and alignment
  • Make architectural decisions regarding pre-training and post-training challenges
  • Design experiments to improve model behavior and reasoning quality
  • Collaborate with infrastructure teams on scalable post-training workflows
  • Contribute to publications and enhance Autodesk's research profile
  • Design evaluation frameworks for model behaviors and real-world workflows
  • Lead model analysis and interpretability efforts
  • Drive human-in-the-loop evaluation processes
  • Communicate technical risks and limitations to leadership

Benefits

  • Flexible work options including remote work opportunities
  • Comprehensive health benefits and wellness programs
  • Access to professional development resources
  • Support for research and publishing in leading AI venues
  • Opportunities to work on cutting-edge projects in a dynamic environment
Full Job Description
Job Requisition ID #

26WD98667

Position Overview

Autodesk's domains - architecture, engineering, construction, manufacturing, media & entertainment - provide a distinctive research environment: rich structured data, long-horizon reasoning tasks, and real-world evaluation grounded in professional workflows. Uniquely, decades of investment in physics simulation engines, CAD kernels, and computational design tools give us something most labs don't have: high-fidelity, domain-grounded verifiers that can serve as reward signals for post-training. Rather than relying solely on human preference data, we can ground reinforcement learning in the laws of physics and the constraints of real engineering. These are exactly the kinds of challenges - and assets - that make post-training and alignment research here genuinely distinctive.

Respoinsibilities
  • Post-training for model development - from RLHF and preference optimization to agentic systems and long-horizon reasoning
  • Develop novel algorithms that improve model reliability, controllability, and alignment
  • Make principled architectural decisions about when to address challenges at the pre-training, post-training, or system level
  • Design and run experiments that shape model behavior, robustness, and reasoning quality
  • Partner with infrastructure teams to build scalable, reproducible post-training workflows
  • Contribute to publications, patents, and Autodesk's external research visibility
  • Design evaluation frameworks for long-horizon reasoning, tool use, agentic behavior, safety, and real-world workflow completion
  • Lead rigorous model analysis and interpretability efforts
  • Drive human-in-the-loop evaluation with high annotation quality and sound scientific methodology
  • Establish model readiness criteria and provide go/no-go recommendations for releases
  • Communicate technical risks, limitations, and trade-offs clearly to leadership


Minimum Requirements
  • Deep hands-on expertise in reinforcement learning for foundation models, and fluency with post-training methods (RLHF, RLAIF, DPO, PPO, or adjacent approaches)
  • Proven experience leading or mentoring technical research teams - whether in an academic lab, AI research organization, or industry setting
  • Strong intuition for model behavior, alignment challenges, and post-training trade-offs
  • Experience designing evaluation systems and thinking rigorously about what it means for a model to be ready
  • Ability to communicate complex technical trade-offs clearly to both technical and non-technical audiences
  • A PhD or equivalent depth of industry research experience in ML, RL, AI, or a related field
  • Experience at a frontier model lab or advanced applied AI organization
  • A strong publication record at leading ML or AI venues
  • Background in alignment research, preference learning, or agentic AI
  • Experience deploying or supporting production AI systems
  • Familiarity with large-scale training infrastructure and compute trade-offs


About Autodesk, Inc

Autodesk, Inc. is an American multinational software corporation that makes software products and services for the architecture, engineering, construction, manufacturing, media, education, and entertainment industries. Autodesk is headquartered in San Rafael, California, and features a gallery of its customers' work in its San Francisco building.
Learn more about Autodesk, Inc
Size
12,600 employees
Market Cap
$40.1 billion
Industry
Net Income
$1.2 billion
Founded
1982
5 Year Trend
+16.6%
Revenue
$3.7 billion
NASDAQ

Similar Jobs

More Jobs at Autodesk, Inc

More Information Technology Jobs

Find similar Principal AI Research Scientist Post-Training - Alignment - Reinforcement Learning Autodesk AI Lab: London - San Francisco - Toronto - Remote (US/CA/EU jobs: