Research Engineers, Post-Training

Distyl AI

$150K — $250K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 5-7 years of experience in AI research or systems engineering focusing on post-training methods
  • Proficiency in building and managing training and evaluation pipelines
  • Strong analytical skills for running experiments and interpreting results
  • A research-focused approach aiming for understanding system behavior in real-world applications
  • Familiarity with machine learning constraints like cost, latency, and data availability
  • Daily utilization of AI tools for coding and experimentation
  • Proven ownership mentality towards system outcomes and improvements

Responsibilities

  • Design and run workflows to enhance AI system behavior and reliability
  • Develop evaluation and feedback systems for applied AI use cases
  • Investigate post-training techniques' impact on system behavior
  • Build experimentation infrastructure for model comparison and analysis
  • Collaborate with AI Researchers and Engineers on methodology and application
  • Analyze output data and production traces for behavioral insights
  • Create standardized processes for AI adaptation to various customer environments
  • Communicate model behavior and evaluation results to stakeholders

Benefits

  • 100% coverage of medical, dental, and vision for employees and dependents
  • 401(k) plan with added perks like commuter benefits and in-office lunch
  • Access to cutting-edge AI models and modern tools
  • Opportunity to lead significant projects impacting major enterprises
  • Culture that encourages curiosity and excellence with a mission-driven approach
Full Job Description
What We Are Looking For

At Distyl, Research Engineers build the bridge between frontier AI research and production systems that deliver real business value. This role is for engineers who are excited to investigate how AI systems should be designed, rapidly prototype new ideas, and turn promising concepts into reliable systems that work inside real customer environments.

Research Engineers operate at the intersection of applied research, systems engineering, and customer-facing deployment. They design and implement compound AI systems, run experiments to understand system behavior, build evaluation frameworks, and collaborate closely with AI Researchers, AI Engineers, and customer stakeholders. Their work is not limited to demos or isolated prototypes: they help turn new techniques into robust systems that can be measured, operated, and improved in production.

Key Responsibilities
  • Design and run post-training workflows that improve the behavior, reliability, and usefulness of AI systems
  • Develop datasets, preference signals, evaluation suites, reward models, fine-tuning workflows, and feedback loops for applied AI use cases
  • Investigate how different post-training techniques affect system behavior across enterprise workflows and production constraints
  • Build infrastructure for experimentation, model comparison, regression testing, and behavior analysis
  • Partner with AI Researchers to explore new post-training methods and with AI Engineers to apply successful techniques in deployed systems
  • Analyze model outputs, failure modes, human feedback, and production traces to identify opportunities for behavioral improvement
  • Create repeatable processes for adapting AI systems to customer domains while preserving robustness, transparency, and maintainability
  • Communicate clearly with internal teams and customer stakeholders about model behavior, evaluation results, limitations, and tradeoffs


Who You Are
  • Experience Improving Model Behavior: You have worked with fine-tuning, preference optimization, reinforcement learning, reward modeling, synthetic data, evals, or related post-training techniques
  • Strong Programming and Experimentation Skills: You can build training and evaluation pipelines, run controlled experiments, analyze results, and iterate quickly
  • Research-Oriented Builder: You care about understanding why behavior changes, not just whether a benchmark improves
  • AI Systems Mindset: You understand that model behavior is shaped by data, prompts, tools, retrieval, evaluators, and deployment context-not model weights alone
  • AI-Native Working Style: You use AI tools daily to accelerate coding, analysis, debugging, experimentation, and research exploration
  • Bias Towards Measurement: You make behavioral improvements concrete through evaluations, comparisons, regression tests, and production-relevant metrics
  • Comfort with Applied Constraints: You can balance research ambition with practical constraints around cost, latency, reliability, data availability, and customer requirements
  • Ownership Mentality: You take responsibility for whether post-training work improves real system outcomes, not just offline scores


What We Offer
  • The base salary range for this role is $150K - $250K, depending on experience, location, and level. In addition to base compensation, this role is eligible for meaningful equity, along with a comprehensive benefits package
  • 100% covered medical, dental, and vision for employees and dependents
  • 401(k) with additional perks (e.g., commuter benefits, in-office lunch)
  • Access to state-of-the-art models, generous usage of modern AI tools, and real-world business problems
  • Ownership of high-impact projects across top enterprises
  • A mission-driven, fast-moving culture that prizes curiosity, pragmatism, and excellence

Distyl has offices in San Francisco and New York. This role follows a hybrid collaboration model with 3+ days per week (Tuesday-Thursday) in-office.

#LI-Hybrid

Similar Jobs

More Jobs at Distyl AI

More Information Technology Jobs

Find similar Research Engineers, Post-Training jobs: