Your Job The Senior LLM Engineer will fine-tune and deploy LLMs on Azure OpenAI / Azure AI Foundry to power generative AI capabilities within our engineering design platform, translating natural-language design intent into structured, engineering-valid outputs.
What You Will Do - Fine-tune foundation models (LoRA/QLoRA, RLHF/DPO, instruction tuning) for domain-specific tasks and terminology.
- Build agentic and tool-use workflows that connect the LLM to internal engineering tools and data sources.
- Design evaluation harnesses for factuality and accuracy; own hallucination and safety guardrails.
- Build RAG pipelines (Azure AI Search) and structured tool-use/function-calling systems on top of fine-tuned Azure OpenAI models.
- Deploy and optimize inference (quantization, KV-cache, vLLM/TensorRT-LLM) on Azure Kubernetes Service for cost-efficient serving.
Who You Are (Basic Qualifications) - 8+ years overall ML/AI engineering experience, with deep hands-on LLM/foundation model work - not just calling APIs.
- Demonstrated experience fine-tuning models (LoRA/QLoRA/PEFT, full fine-tuning, or pretraining at some scale).
- Practical experience with alignment techniques (RLHF, RLAIF, DPO, or instruction tuning).
- Strong Python and deep PyTorch proficiency; solid grasp of transformer architecture internals.
- Hands-on experience building RAG pipelines, embeddings/vector search, and agentic or tool-use LLM systems.
- Familiarity with Azure OpenAI / Azure AI Foundry or an equivalent cloud LLM platform.
What Will Put You Ahead - Direct experience with Azure OpenAI Service and Azure AI Foundry for enterprise-scale deployment.
- Experience orchestrating LLM-driven code or structured-output generation for technical/engineering domains.
- Distributed training experience across multi-GPU/multi-node clusters (DeepSpeed, FSDP).
- Publications, blog posts, or open-source contributions in generative AI.
For this role, we anticipate paying $195,000- $255,000 per year. This role is eligible for variable pay, issued as a monetary bonus or in another form.
At Koch companies, we are entrepreneurs. This means we openly challenge the status quo, find new ways to create value and get rewarded for our individual contributions. Any compensation range provided for a role is an estimate determined by available market data. The actual amount may be higher or lower than the range provided considering each candidate's knowledge, skills, abilities, and geographic location. If you have questions, please speak to your recruiter about the flexibility and detail of our compensation philosophy.
Hiring Philosophy All Koch companies value diversity of thought, perspectives, aptitudes, experiences, and backgrounds. We are Military Ready and Second Chance employers. Learn more about our hiring philosophy here .
Our Benefits Our goal is for each employee, and their families, to live fulfilling and healthy lives. We provide essential resources and support to build and maintain physical, financial, and emotional strength - focusing on overall wellbeing so you can focus on what matters most. Our benefits plan includes - medical, dental, vision, flexible spending and health savings accounts, life insurance, ADD, disability, retirement, paid vacation/time off, educational assistance, and may also include infertility assistance, paid parental leave and adoption assistance. Specific eligibility criteria is set by the applicable Summary Plan Description, policy or guideline and benefits may vary by geographic region. If you have questions on what benefits apply to you, please speak to your recruiter.
Additionally, everyone has individual work and personal needs. We seek to enable the best work environment that helps you and the business work together to produce superior results.
