Koch Industries

GPU MLOps Engineer

Koch Industries$200K — $280K *
Information Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • 10+ years in MLOps, DevOps, or Cloud Infrastructure with experience in ML deployment.
  • Extensive knowledge of Azure services, particularly GPU compute and Azure Kubernetes Service.
  • Proficient in infrastructure-as-code using Terraform or Bicep.
  • Strong understanding of cloud security principles including IAM and secrets management.
  • Experience with effective cloud cost optimization strategies.
  • Hands-on familiarity with model registries and experiment tracking tools like Azure ML and MLflow.

Responsibilities

  • Build and maintain CI/CD pipelines using Azure DevOps for ML model lifecycle management.
  • Provision and scale Azure GPU compute and container infrastructure for AI workloads.
  • Automate ML model retraining and redeployment workflows in Azure.
  • Implement and manage cloud security protocols across all systems and data artifacts.
  • Monitor cloud costs and develop dashboards for cost visibility using Power BI.

Benefits

  • Comprehensive medical, dental, and vision coverage.
  • Flexible spending and health savings accounts.
  • Life insurance and disability coverage.
  • Generous paid vacation and time-off policies.
  • Educational assistance to support professional development.
Full Job Description
Your Job

The GPU- MLOps Engineer will own the Azure platform layer end-to-end - deploying AI/ML models, provisioning and managing GPU compute, securing the environment, and continuously optimizing cost for our engineering AI/ML platform.

What You Will Do
  • Build and maintain CI/CD pipelines (Azure DevOps) for training, validation, versioning, and deployment of ML models.
  • Provision and scale Azure GPU compute (ND/NC series) and container infrastructure (AKS/ACI) for training and simulation workloads.
  • Automate retraining/redeployment workflows in Azure ML pipelines as new data becomes available.
  • Implement access control, identity management, and secrets management (Microsoft Entra ID, Azure Key Vault) across compute, data, and model artifacts.
  • Monitor and optimize GPU/cloud spend (Azure Cost Management) and build cost visibility dashboards in Power BI.


Who You Are (Basic Qualifications)
  • 10+ years in MLOps, DevOps, or Cloud Infrastructure, with real exposure to both ML deployment and cloud infrastructure management.
  • Strong Azure experience - GPU compute (ND/NC), Azure Kubernetes Service, containerization (Docker).
  • Infrastructure-as-code experience (Terraform or Bicep).
  • Solid grasp of cloud security fundamentals (IAM, network security, secrets management).
  • Demonstrated experience with cloud cost optimization (right-sizing, autoscaling, spot/preemptible strategies).
  • Hands-on experience with model registries and experiment tracking (Azure ML + MLflow).


What Will Put You Ahead
  • Experience with GPU-heavy workloads specifically (ML training, HPC simulation) rather than general web/app infrastructure.
  • Azure certifications (Solutions Architect Expert, Security Engineer Associate).
  • Experience with HPC job schedulers (Slurm via Azure CycleCloud).
  • Experience supporting engineering simulation tools.


For this role, we anticipate paying $200,000 - $280,000 per year. This role is eligible for variable pay, issued as a monetary bonus or in another form.

At Koch companies, we are entrepreneurs. This means we openly challenge the status quo, find new ways to create value and get rewarded for our individual contributions. Any compensation range provided for a role is an estimate determined by available market data. The actual amount may be higher or lower than the range provided considering each candidate's knowledge, skills, abilities, and geographic location. If you have questions, please speak to your recruiter about the flexibility and detail of our compensation philosophy.

Hiring Philosophy

All Koch companies value diversity of thought, perspectives, aptitudes, experiences, and backgrounds. We are Military Ready and Second Chance employers. Learn more about our hiring philosophy here .

Our Benefits

Our goal is for each employee, and their families, to live fulfilling and healthy lives. We provide essential resources and support to build and maintain physical, financial, and emotional strength - focusing on overall wellbeing so you can focus on what matters most. Our benefits plan includes - medical, dental, vision, flexible spending and health savings accounts, life insurance, ADD, disability, retirement, paid vacation/time off, educational assistance, and may also include infertility assistance, paid parental leave and adoption assistance. Specific eligibility criteria is set by the applicable Summary Plan Description, policy or guideline and benefits may vary by geographic region. If you have questions on what benefits apply to you, please speak to your recruiter.

Additionally, everyone has individual work and personal needs. We seek to enable the best work environment that helps you and the business work together to produce superior results.

About Koch Industries

Koch Industries, Inc. is an American privately-held multinational conglomerate corporation based in Wichita, Kansas. Its subsidiaries are involved in the manufacturing, refining, and distribution of petroleum, chemicals, energy, fiber, intermediates and polymers, minerals, fertilizers, pulp and paper, chemical technology equipment, ranching, finance, commodities trading, and investing. Koch owns Infor, Invista, Georgia-Pacific, Molex, Flint Hills Resources, Koch Pipeline, Koch Fertilizer, Koch Minerals, Matador Cattle Company, i360, and Guardian Industries. The firm employs 120,000 people in 60 countries, with about half of its business in the United States. The company is the largest non-Canadian landowner in the Athabasca oil sands. With annual revenues of $110 billion by 2014, the company is the largest privately held company in the United States. In 2007, it was ranked as the largest privately held company. If Koch Industries had been a public company in 2013, it would have ranked 17th in the Fortune 500. The company was founded by its namesake, Fred C. Koch, in 1940 after he developed an innovative crude oil refining process. Fred C. Koch died in 1967 and his majority interest in the company was split amongst his four sons. In June 1983, after a bitter legal and boardroom battle, the stakes of Frederick R. Koch and William "Bill" Koch were bought out for $1.1 billion and Charles Koch and David Koch became majority owners in the company. Charles owns 42% of the company; trusts for the benefit of Elaine Tettemer Marshall and Elaine's children, Preston Marshall and E. Pierce Marshall Jr., own 16% of the company. The heirs of David Koch, who died on August 23, 2019, own the balance, 42%, of the corporation.
Learn more about Koch Industries
Industry
Founded
1940

Similar Jobs

More Jobs at Koch Industries

More Information Technology Jobs

Find similar GPU MLOps Engineer jobs: