Koch Industries

GPU MLOps Engineer

Koch Industries$200K — $280K *
Information Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • 10+ years in MLOps, DevOps, or Cloud Infrastructure with a focus on ML deployment and management.
  • Strong Azure expertise, particularly with GPU compute and Azure Kubernetes Service.
  • Proficiency in Infrastructure-as-Code tools such as Terraform or Bicep.
  • Firm understanding of cloud security, including IAM and secrets management.
  • Experience in optimizing cloud costs using strategies like right-sizing and autoscaling.
  • Hands-on familiarity with model registries and tracking tools like Azure ML and MLflow.

Responsibilities

  • Build and manage CI/CD pipelines using Azure DevOps for ML models.
  • Provision and scale GPU compute resources and container infrastructures for training.
  • Automate the retraining and redeployment of models in Azure ML pipelines.
  • Implement robust access control and security measures across digital assets.
  • Monitor GPU/cloud expenditures and create cost visibility dashboards in Power BI.

Benefits

  • Comprehensive medical, dental, and vision plans.
  • Flexible spending and health savings accounts available.
  • Life insurance, accidental death and disability insurance offered.
  • Retirement plans with company contributions.
  • Paid vacation and time off allowances.
  • Educational assistance benefits provided.
  • Other family-oriented support options including paid parental leave and adoption assistance.
Full Job Description
Your Job

The GPU- MLOps Engineer will own the Azure platform layer end-to-end - deploying AI/ML models, provisioning and managing GPU compute, securing the environment, and continuously optimizing cost for our engineering AI/ML platform.

What You Will Do
  • Build and maintain CI/CD pipelines (Azure DevOps) for training, validation, versioning, and deployment of ML models.
  • Provision and scale Azure GPU compute (ND/NC series) and container infrastructure (AKS/ACI) for training and simulation workloads.
  • Automate retraining/redeployment workflows in Azure ML pipelines as new data becomes available.
  • Implement access control, identity management, and secrets management (Microsoft Entra ID, Azure Key Vault) across compute, data, and model artifacts.
  • Monitor and optimize GPU/cloud spend (Azure Cost Management) and build cost visibility dashboards in Power BI.


Who You Are (Basic Qualifications)
  • 10+ years in MLOps, DevOps, or Cloud Infrastructure, with real exposure to both ML deployment and cloud infrastructure management.
  • Strong Azure experience - GPU compute (ND/NC), Azure Kubernetes Service, containerization (Docker).
  • Infrastructure-as-code experience (Terraform or Bicep).
  • Solid grasp of cloud security fundamentals (IAM, network security, secrets management).
  • Demonstrated experience with cloud cost optimization (right-sizing, autoscaling, spot/preemptible strategies).
  • Hands-on experience with model registries and experiment tracking (Azure ML + MLflow).


What Will Put You Ahead
  • Experience with GPU-heavy workloads specifically (ML training, HPC simulation) rather than general web/app infrastructure.
  • Azure certifications (Solutions Architect Expert, Security Engineer Associate).
  • Experience with HPC job schedulers (Slurm via Azure CycleCloud).
  • Experience supporting engineering simulation tools.


For this role, we anticipate paying $200,000 - $280,000 per year. This role is eligible for variable pay, issued as a monetary bonus or in another form.

At Koch companies, we are entrepreneurs. This means we openly challenge the status quo, find new ways to create value and get rewarded for our individual contributions. Any compensation range provided for a role is an estimate determined by available market data. The actual amount may be higher or lower than the range provided considering each candidate's knowledge, skills, abilities, and geographic location. If you have questions, please speak to your recruiter about the flexibility and detail of our compensation philosophy.

Hiring Philosophy

All Koch companies value diversity of thought, perspectives, aptitudes, experiences, and backgrounds. We are Military Ready and Second Chance employers. Learn more about our hiring philosophy here .

Our Benefits

Our goal is for each employee, and their families, to live fulfilling and healthy lives. We provide essential resources and support to build and maintain physical, financial, and emotional strength - focusing on overall wellbeing so you can focus on what matters most. Our benefits plan includes - medical, dental, vision, flexible spending and health savings accounts, life insurance, ADD, disability, retirement, paid vacation/time off, educational assistance, and may also include infertility assistance, paid parental leave and adoption assistance. Specific eligibility criteria is set by the applicable Summary Plan Description, policy or guideline and benefits may vary by geographic region. If you have questions on what benefits apply to you, please speak to your recruiter.

Additionally, everyone has individual work and personal needs. We seek to enable the best work environment that helps you and the business work together to produce superior results.

About Koch Industries

Koch Industries, Inc. is an American privately-held multinational conglomerate corporation based in Wichita, Kansas. Its subsidiaries are involved in the manufacturing, refining, and distribution of petroleum, chemicals, energy, fiber, intermediates and polymers, minerals, fertilizers, pulp and paper, chemical technology equipment, ranching, finance, commodities trading, and investing. Koch owns Infor, Invista, Georgia-Pacific, Molex, Flint Hills Resources, Koch Pipeline, Koch Fertilizer, Koch Minerals, Matador Cattle Company, i360, and Guardian Industries. The firm employs 120,000 people in 60 countries, with about half of its business in the United States. The company is the largest non-Canadian landowner in the Athabasca oil sands. With annual revenues of $110 billion by 2014, the company is the largest privately held company in the United States. In 2007, it was ranked as the largest privately held company. If Koch Industries had been a public company in 2013, it would have ranked 17th in the Fortune 500. The company was founded by its namesake, Fred C. Koch, in 1940 after he developed an innovative crude oil refining process. Fred C. Koch died in 1967 and his majority interest in the company was split amongst his four sons. In June 1983, after a bitter legal and boardroom battle, the stakes of Frederick R. Koch and William "Bill" Koch were bought out for $1.1 billion and Charles Koch and David Koch became majority owners in the company. Charles owns 42% of the company; trusts for the benefit of Elaine Tettemer Marshall and Elaine's children, Preston Marshall and E. Pierce Marshall Jr., own 16% of the company. The heirs of David Koch, who died on August 23, 2019, own the balance, 42%, of the corporation.
Learn more about Koch Industries
Industry
Founded
1940

Similar Jobs

More Jobs at Koch Industries

More Information Technology Jobs

Find similar GPU MLOps Engineer jobs: