Machine Learning Researcher

Inference

• $250K — $350K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 3+ years of experience training AI models using PyTorch
  • Deep understanding of transformer architectures and model internals
  • Hands-on experience with post-training LLMs using techniques like SFT, RLHF, or DPO
  • Experience with LLM-specific training frameworks such as Hugging Face Transformers
  • Strong experimental methodology skills, including designing and analyzing experiments
  • Track record of implementing ideas from ML papers
  • Experience training on NVIDIA GPUs at scale

Responsibilities

  • Research new model architectures to enhance quality and efficiency
  • Explore methods to decrease inference latency and boost serving efficiency
  • Run experiments with innovative learning methods like novel SFT and RLHF
  • Conduct reinforcement learning research to improve model alignment
  • Develop our distillation pipeline for high-quality model training
  • Train models for clients and validate research findings in production
  • Create benchmarks and evaluation frameworks for custom models

Benefits

  • Equity in a high-growth startup
  • Comprehensive benefits package
  • Opportunity to work with a high-agency, experienced team
  • Autonomy in research and experimentation
  • Access to a large compute budget for ambitious projects
Full Job Description
Help us push the boundaries of what's possible in LLM post-training. If you love training models, exploring new architectures, running experiments, and turning research insights into products that ship, we'd love to meet you.

About the Role

You will be responsible for conducting research into experimental models, training systems, and modalities to create novel products for our customers. Your work will span from exploring new architectures and learning methods to optimizing latency and efficiency, with the goal of delivering better models to customers.

Your north star is pushing the frontier of what's possible in LLM post-training. You'll explore new techniques, run rigorous experiments, and when something works, help bring it into production with the help of your teammates. This includes training models for customers and running evaluations as part of validating your research. This role reports directly to the founding team. You'll have the autonomy, a large compute budget / GPU reservation, and technical support to explore ambitious ideas and ship the ones that work.

Key Responsibilities
  • Research and experiment with new model architectures to improve quality, efficiency, or capability
  • Explore methods to decrease inference latency and improve serving efficiency
  • Run experiments with new learning methods, including novel approaches to SFT, RLHF, DPO, and other post-training techniques
  • Perform reinforcement learning research to improve model alignment and capability
  • Develop and improve our distillation pipeline for training high-quality models from frontier teachers
  • Train models for clients and run evaluations to validate research findings in production settings
  • Create robust benchmarks and evaluation frameworks that ensure custom models match or exceed frontier performance
  • Stay current with ML research and identify techniques that can improve our platform
  • Collaborate with applied engineers to bring successful research into production systems
  • Document findings and share knowledge with the team

Requirements
  • 3+ years of experience training AI models using PyTorch
  • Deep understanding of transformer architectures, attention mechanisms, and model internals
  • Hands-on experience with post-training LLMs using SFT, RLHF, DPO, or other alignment techniques
  • Experience with LLM-specific training frameworks (e.g., Hugging Face Transformers, DeepSpeed, Megatron, TRL, or similar)
  • Strong experimental methodology, including ability to design, run, and analyze rigorous experiments
  • Track record of implementing ideas from recent ML papers
  • Experience training on NVIDIA GPUs at scale
  • Strong foundation in ML fundamentals: optimization, loss functions, regularization, generalization

Nice-to-Have
  • Publications in ML venues
  • Experience with model distillation or knowledge transfer
  • Experience with LLM speed optimization techniques
  • Familiarity with vision encoders, multimodal models, or other modalities
  • Experience with distributed training and infrastructure at scale
  • Contributions to open-source ML projects

You don't need to tick every box. Curiosity and the ability to learn quickly matter more.

Compensation

We offer competitive compensation, equity in a high-growth startup, and comprehensive benefits. The base salary range for this role is $250,000 - $350,000, plus equity and benefits, depending on experience.

If you're excited about pushing the boundaries of custom AI research, we'd love to hear from you. Please send your resume and GitHub to and/or here on Ashby.

Similar Jobs

More Jobs at Inference

More Information Technology Jobs

Find similar Machine Learning Researcher jobs: