Deloitte

Research Engineer - Post-Training & Small Language Models (SLMs), Healthcare AI

Deloitte$189K — $372K *
Healthcare
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree in Computer Science, Machine Learning, AI, Applied Mathematics, Computational Linguistics, or related field.
  • Expertise in training and post-training large transformer-based language models.
  • Hands-on experience with reasoning-model training and verifiable-reward workflows.
  • Strong understanding of modern post-training techniques including SFT, RLHF, and others.
  • Experience with open-weight foundation models like Llama or Mistral.
  • Expertise in PyTorch and modern deep-learning tools; familiarity with distributed training frameworks.
  • Strong Python engineering skills and production-grade software practices.

Responsibilities

  • Design and execute post-training pipelines for healthcare decisioning.
  • Build and optimize training techniques to enhance reasoning quality and performance.
  • Develop reward models and preference datasets for improving AI tasks.
  • Curate and evaluate large-scale domain-specific datasets with rigorous quality control.
  • Implement efficient fine-tuning strategies and optimize model inference performance.
  • Train and optimize small language models for various deployment scenarios.
  • Design evaluation frameworks with healthcare-grade benchmarks and metrics for model safety.

Benefits

  • Broad range of employee benefits designed to promote wellness.
  • Opportunities for professional development and growth.
  • Exposure to diverse projects in the healthcare sector.
  • Collaborative work environment with experts across various domains.
Full Job Description
As a Research Engineer on our post-training team, you will design, train, evaluate, and align the models that reason about healthcare - working across the full post-training lifecycle to shape model behavior for clinical and operational decisioning across the industry. Healthcare decisioning is one of the cleanest verifiable-reward domains outside math and code: the problems are hard. We ground that reward in real signals - clinical policy and criteria, adjudicated outcomes, and clinical-expert judgment - so correctness is checkable rather than asserted.

You will own the post-training stack for our clinical reasoning models end to end - from data and reward design through trained, evaluated models that ship. This is not a prompt-engineering role. We are looking for people who understand not just how to use LLMs, but how to improve and shape model behavior through advanced post-training.

You do not need a healthcare background. We pair every engineer with clinical and domain experts and teach you the domain - you bring the modeling depth.

We hire on demonstrated depth, not years - the level you join at is determined through our interview process, based on the depth and judgment you demonstrate, not your years in a title.

Work you'll do

Post-training & alignment
• Design and execute post-training pipelines: supervised fine-tuning (SFT), preference optimization, and reinforcement learning / alignment workflows.
• Build and optimize training using techniques such as SFT, RLHF, PPO, DPO, GRPO, RLAIF, and Constitutional AI, and understand how each affects reasoning quality, safety, latency, cost, and reliability.
• Train reasoning models for healthcare decisioning using verifiable-reward RL - designing reward signals and verifiers grounded in clinical guidelines, policy and criteria, and adjudicated outcomes.

Reward modeling & data
• Develop reward models and preference datasets to improve reasoning quality, factuality, safety, policy adherence, and task performance.
• Curate, clean, synthesize, and evaluate large-scale instruction, preference, and domain-specific datasets, with rigorous filtering, deduplication, and quality control.
• Build verification and reward pipelines from our proprietary clinical, claims, and operational data and from clinical-expert labeling - turning guidelines, policy, and adjudicated outcomes into checkable reward signals at scale.

Efficient fine-tuning, training & inference infrastructure
• Implement efficient fine-tuning strategies including LoRA, QLoRA, PEFT, and adapter-based approaches; build scalable distributed training using DeepSpeed, FSDP, Megatron-LM, Ray, or equivalent.
• Optimize inference performance - latency, throughput, quantization, and deployment efficiency - for production, including frameworks such as vLLM, TensorRT-LLM, or TGI.

Small language models & open-weight models
• Train and optimize open-weight models such as Llama, Qwen, Mistral, or DeepSeek; build specialized small language models (SLMs) for on-premise and cloud-hybrid deployment with strong performance-per-dollar.

Evaluation, safety & red teaming
• Design evaluation frameworks covering reasoning, hallucination detection, factuality, instruction following, structured outputs, and domain-specific metrics.
• Build healthcare-grade evaluation - held-out clinical benchmarks, deployment regression gates, calibration and uncertainty, factuality against ground truth, and bias/fairness evaluation across patient populations and subgroups - co-designed with clinical experts.
• Apply PHI/HIPAA-aware data handling and produce model documentation suitable for regulated clinical use.
• Perform red teaming and adversarial testing to identify alignment failures, unsafe behaviors, jailbreak vulnerabilities, and regression risks; collaborate with agentic and application teams to improve tool use, grounding, and long-horizon reasoning.

The team

Deloitte brings together AI researchers, modeling and platform engineers, architects, clinical and domain specialists, and product leaders to build, deploy, and operate verticalized AI systems across software, data, models, and cloud infrastructure - engineered for one of the most complex operating environments in the world. The work spans the healthcare industry - payers, providers, and life sciences - and involves genuinely hard reasoning problems, nuanced operational workflows, and a high bar for reliability, with little tolerance for shallow or unreliable outputs. We pair frontier AI research with production-grade engineering, and we ship into real clinical and operational settings rather than leaving models in the lab.

You can go deep. The team sub-specializes across post-training research, data and reward engineering, and training and inference infrastructure - you won't be expected to own all of it alone.

Required qualifications
• Bachelor's degree in Computer Science, Machine Learning, Artificial Intelligence, Applied Mathematics, Computational Linguistics, or a related field.
• Demonstrated depth training and post-training large transformer-based language models in production or research - this is your craft, not coursework or a one-off fine-tune. Genuine depth including SFT and at least one preference-optimization or RL method, evidenced by shipped models, releases, or research.
• Hands-on experience with reasoning-model training and/or verifiable-reward (RLVR) workflows.
• Strong understanding of modern post-training techniques: SFT, RLHF, PPO, DPO, GRPO, RLAIF, and preference optimization workflows.
• Experience with open-weight foundation models such as Llama, Qwen, Mistral, DeepSeek, or equivalent architectures.
• Strong expertise in PyTorch and modern deep-learning tooling; experience with distributed training frameworks such as DeepSpeed, FSDP, Megatron-LM, or Ray.
• Experience implementing efficient fine-tuning techniques such as LoRA, QLoRA, PEFT, and quantization-aware workflows.
• Deep understanding of transformer architectures, tokenization, attention mechanisms, decoding strategies, and model scaling trade-offs.
• Strong grasp of LLM evaluation methodologies, benchmarking, reward modeling, and alignment trade-offs; experience with large-scale and synthetic datasets, filtering, deduplication, and quality-control pipelines.
• Strong Python engineering skills and production-grade software practices; ability to work through ambiguous, highly complex technical problems in fast-moving environments.
• Ability to travel 0-50%, on average, based on the work you do and the clients and industries/sectors you serve.
• Limited immigration sponsorship may be available.

Preferred qualifications
• Experience building or optimizing reasoning models, agentic models, or tool-using LLM systems.
• Familiarity with inference optimization frameworks such as vLLM, TensorRT-LLM, TGI, or Ollama.
• Experience with multimodal models, speech models, or domain-specific foundation models; experience using large-scale GPU clusters and distributed compute.
• Contributions to open-source AI projects, research publications, benchmark development, or model releases.
• Familiarity with safety, governance, and responsible-AI practices; experience in regulated or high-stakes industries such as healthcare, finance, insurance, or public sector.

Compensation

Base salary is benchmarked to leading technology companies rather than traditional consulting scales, and the role carries a substantial performance-based incentive opportunity designed to grow with the value you help create - startup-style upside, with the backing of a committed, well-capitalized platform. The estimated base salary range is $189,200-$372,900 (not adjusted for geographic differential); actual base pay depends on your skills, experience, and level, and you may also be eligible for a discretionary annual incentive based on individual and organizational performance.

Recruiting tips

From developing a stand out resume to putting your best foot forward in the interview, we want you to feel prepared and confident as you explore opportunities at Deloitte. Check out recruiting tips from Deloitte recruiters.

Benefits

At Deloitte, we know that great people make a great organization. We value our people and offer employees a broad range of benefits. Learn more about what working at Deloitte can mean for you.

About Deloitte

Deloitte is a multinational professional services network that provides audit, tax, consulting, enterprise risk and financial advisory services. The company was founded in London in 1845 and has since grown to become one of the largest professional services firms in the world. Deloitte has over 330,000 employees in more than 150 countries and territories. The company's mission is to help clients achieve their goals and make an impact that matters in their businesses and communities.
Learn more about Deloitte
Size
330,000 employees
Industry
Founded
1999

Similar Jobs

More Jobs at Deloitte

More Healthcare Jobs

Find similar Research Engineer - Post-Training & Small Language Models (SLMs), Healthcare AI jobs: