Mirantis

Senior Software Engineer, AI Infrastructure

Mirantis • $135K — $160K *
US-AnywhereRemote in United States
Information Technology
5 - 7 years of experience
Today
Be an Early Applicant
Job Overview by Ladders

Qualifications

  • 5+ years of software engineering experience in infrastructure, platform, or distributed systems.
  • Deep hands-on Kubernetes experience including building and operating production workloads and Helm charts.
  • Experience with GPU workloads or LLM inference, or strong adjacent systems experience with a fast learning aptitude.
  • Strong Go programming skills alongside solid CI/CD and infrastructure-as-code abilities.
  • Fluency with AI-assisted development tools integrated into daily engineering tasks.
  • Comfortable working autonomously within a small, remote-first, written-culture team.

Responsibilities

  • Design and build LLM serving infrastructure on Kubernetes, focusing on deployment, GPU scheduling, scaling, and model lifecycle management.
  • Package the platform for enterprise-ready installations, including Helm-based installs, upgrades, and support for restricted networks.
  • Integrate the serving layer with the platform's API gateway, identity, and metering services.
  • Develop observability tools for operating GPU inference in production, such as serving metrics and GPU telemetry.
  • Contribute across a multi-service codebase, guiding engineering direction through thoughtful design documentation and peer reviews.

Benefits

  • Work with a leader in the cloud infrastructure industry.
  • Collaborate with passionate, skilled colleagues supporting Fortune 500 and Global 2000 clients in cloud tech.
  • Engage in cutting-edge, open-source innovations.
  • Experience a dynamic environment that fosters collaboration, risk-taking, and growth.
  • Access to professional development and training opportunities.
  • Opportunities to attend conferences and participate in working groups.
  • Enjoy company outings, happy hours, hackathons, and tech talks.
Full Job Description
Job Description

Mirantis is building a new enterprise AI infrastructure product that lets organizations run and govern large language models on their own Kubernetes clusters. You will join a small senior team early, with broad ownership of the model-serving layer and its path to production.

What you'll do
  • Design and build LLM serving infrastructure on Kubernetes: deployment, GPU scheduling, scaling, and model lifecycle management.
  • Package the platform for enterprise environments: Helm-based installs, upgrades, and restricted/offline networks.
  • Integrate the serving layer with the platform's API gateway, identity, and metering services.
  • Build the observability for operating GPU inference in production (serving metrics, GPU telemetry).
  • Contribute across a multi-service codebase and help set engineering direction through design docs and reviews.


Qualifications

What we're looking for
  • 5+ years of software engineering experience in infrastructure, platform, or distributed systems.
  • Deep hands-on Kubernetes experience: building and operating production workloads and Helm charts, not just consuming managed clusters.
  • Experience with GPU workloads or LLM inference, or strong adjacent systems experience and a track record of learning fast.
  • Strong Go programming skills; solid CI/CD and infrastructure-as-code skills.
  • Fluency with AI-assisted development tools (Claude Code, OpenAI Codex) as part of your daily engineering workflow.
  • Comfortable with high autonomy on a small, remote-first, written-culture team.

Nice to have
  • Inference performance work (quantization, batching, caching) or distributed serving frameworks.
  • Enterprise deployment experience: air-gapped installs, SSO/OIDC, supply-chain security.
  • UI development experience (e.g. React/TypeScript), useful as the product's management surfaces grow.
  • Open-source contributions in the Kubernetes or ML-infrastructure ecosystems.


Additional Information

What does Mirantis offer you?
  • Work with an established Silicon Valley leader in the cloud infrastructure industry;
  • Work with exceptionally passionate, talented and engaging colleagues, helping Fortune 500 and Global 2000 customers implement next-generation cloud technologies;
  • Be a part of cutting-edge, open-source innovation;
  • Thrive in the high-energy environment of a young company where openness, collaboration, risk-taking, and continuous growth are valued;
  • Professional development and training;
  • Attend conferences and working groups;
  • Company outings, happy hours, hackathons, and tech talks;
  • Receive a competitive compensation package with a strong benefits plan.

About Mirantis

Mirantis is a software company that provides cloud computing services and solutions. The company was founded in 2011 and is headquartered in Sunnyvale, California. Mirantis offers a range of cloud computing services, including OpenStack, Kubernetes, and Docker. The company's solutions are used by a variety of industries, including telecommunications, finance, and healthcare. Mirantis has over 1,000 employees and offices in the United States, Russia, Ukraine, and the United Kingdom.
Learn more about Mirantis
Size
1,000 employees
Industry
Enterprise Technology
Founded
2011
* Ladders Estimates

Similar Jobs

Ad banner background

Get Ready For Your
Next Interview

More Jobs at Mirantis

More Information Technology Jobs

Find similar Senior Software Engineer, AI Infrastructure jobs:

NationwideRemote