Mirantis

Senior Software Engineer, AI Infrastructure

Mirantis • $135K — $160K *
US-AnywhereRemote in United States
Enterprise Technology
5 - 7 years of experience
Today
Be an Early Applicant
Job Overview by Ladders

Qualifications

  • 5+ years of software engineering experience in infrastructure, platform, or distributed systems.
  • Deep hands-on Kubernetes experience with production workloads and Helm charts.
  • Experience with GPU workloads or LLM inference, or quick learning of adjacent systems.
  • Strong Go programming skills; CI/CD and infrastructure-as-code proficiency.
  • Fluency with AI-assisted development tools integrated into daily workflow.
  • Ability to work autonomously within a small, remote-first, and collaborative team.

Responsibilities

  • Design and build LLM serving infrastructure on Kubernetes, focusing on deployment and GPU scheduling.
  • Package the platform for enterprise use, including Helm-based installs and supporting offline environments.
  • Integrate the serving layer with existing API gateway and identity services.
  • Build observability tools for monitoring GPU inference production metrics and telemetry.
  • Contribute to a multi-service codebase and influence engineering direction through design documentation and reviews.

Benefits

  • Work with a Silicon Valley leader in cloud infrastructure.
  • Collaborate with talented professionals to deliver next-gen cloud technologies to Fortune 500 and Global 2000 firms.
  • Engage in cutting-edge, open-source innovations.
  • Enjoy a dynamic environment that values openness, collaboration, and growth.
  • Opportunities for professional development and training support.
  • Attend industry conferences and participate in working groups.
  • Participate in company events such as outings and hackathons.
Full Job Description
Job Description

Mirantis is building a new enterprise AI infrastructure product that lets organizations run and govern large language models on their own Kubernetes clusters. You will join a small senior team early, with broad ownership of the model-serving layer and its path to production.

What you'll do
  • Design and build LLM serving infrastructure on Kubernetes: deployment, GPU scheduling, scaling, and model lifecycle management.
  • Package the platform for enterprise environments: Helm-based installs, upgrades, and restricted/offline networks.
  • Integrate the serving layer with the platform's API gateway, identity, and metering services.
  • Build the observability for operating GPU inference in production (serving metrics, GPU telemetry).
  • Contribute across a multi-service codebase and help set engineering direction through design docs and reviews.


Qualifications

What we're looking for:
  • 5+ years of software engineering experience in infrastructure, platform, or distributed systems.
  • Deep hands-on Kubernetes experience: building and operating production workloads and Helm charts, not just consuming managed clusters.
  • Experience with GPU workloads or LLM inference, or strong adjacent systems experience and a track record of learning fast.
  • Strong Go programming skills; solid CI/CD and infrastructure-as-code skills.
  • Fluency with AI-assisted development tools (Claude Code, OpenAI Codex) as part of your daily engineering workflow.
  • Comfortable with high autonomy on a small, remote-first, written-culture team.

Nice to have:
  • Inference performance work (quantization, batching, caching) or distributed serving frameworks.
  • Enterprise deployment experience: air-gapped installs, SSO/OIDC, supply-chain security.
  • UI development experience (e.g. React/TypeScript), useful as the product's management surfaces grow.
  • Open-source contributions in the Kubernetes or ML-infrastructure ecosystems


Additional Information

What does Mirantis offer you?
  • Work with an established Silicon Valley leader in the cloud infrastructure industry;
  • Work with exceptionally passionate, talented and engaging colleagues, helping Fortune 500 and Global 2000 customers implement next-generation cloud technologies;
  • Be a part of cutting-edge, open-source innovation;
  • Thrive in the high-energy environment of a young company where openness, collaboration, risk-taking, and continuous growth are valued;
  • Professional development and training;
  • Attend conferences and working groups;
  • Company outings, happy hours, hackathons, and tech talks;
  • Receive a competitive compensation package with a strong benefits plan.


About Mirantis

Mirantis is a software company that provides cloud computing services and solutions. The company was founded in 2011 and is headquartered in Sunnyvale, California. Mirantis offers a range of cloud computing services, including OpenStack, Kubernetes, and Docker. The company's solutions are used by a variety of industries, including telecommunications, finance, and healthcare. Mirantis has over 1,000 employees and offices in the United States, Russia, Ukraine, and the United Kingdom.
Learn more about Mirantis
Size
1,000 employees
Industry
Enterprise Technology
Founded
2011
* Ladders Estimates

Similar Jobs

Ad banner background

Get Ready For Your
Next Interview

More Jobs at Mirantis

More Enterprise Technology Jobs

Find similar Senior Software Engineer, AI Infrastructure jobs:

NationwideRemote