Shield AI

Senior Staff Engineer, ML Ops (R4941)

Shield AI$150K — $180K *
Aerospace & Defense
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Experience building Kubernetes-native AI or MLOps platforms for distributed machine learning.
  • Deep knowledge of AI training frameworks like PyTorch and Hugging Face Transformers.
  • Familiarity with operating GPU-accelerated infrastructures and distributed training systems.
  • Strong grasp of Kubernetes, Linux, networking, security, and storage systems.
  • Experience with GPU scheduling and handling large-scale AI workloads.
  • Proficient in deploying cloud-native infrastructures using Terraform or Helm.
  • Strong coding skills in Python and Golang.

Responsibilities

  • Lead design and development of the AI Factory Reference Architecture.
  • Collaborate with ML researchers to enhance training workflows.
  • Develop self-service AI workflows for seamless local to distributed execution.
  • Build infrastructure for distributed training and reinforcement learning.
  • Design shared GPU infrastructure for improved resource utilization.
  • Create capabilities for data and model lifecycle management.
  • Develop deployment solutions using Infrastructure as Code.

Benefits

  • Comprehensive health benefits.
  • Equity opportunities in the company.
  • Performance bonuses.
  • Flexible work schedule options.
Full Job Description


Job Description:

Shield AI builds autonomy systems for defense applications, including air, maritime, and space platforms operating in complex and contested environments.

We are building the AI Factory Reference Architecture, a Kubernetes-native platform for developing, training, evaluating, and deploying next-generation AI systems.

The AI Factory serves two purposes. Internally, it powers autonomy development across Hivemind and other AI programs. Externally, it becomes the reference architecture deployed into customer environments, spanning commercial cloud, on-premise infrastructure, sovereign deployments, and fully air-gapped systems.

We are looking for a Senior Staff Engineer to help define and build this platform. You will partner closely with ML researchers, platform engineers, and autonomy teams to deliver an exceptional developer experience for training and deploying modern AI models.

Success in this role requires balancing researcher productivity, platform simplicity, operational excellence, and long-term maintainability. You will work hands-on across the stack, helping shape both the platform architecture and its implementation while staying closely aligned with the rapidly evolving AI ecosystem.

What you'll do:
  • AI Platform Development: Lead the design and implementation of the AI Factory Reference Architecture, delivering a Kubernetes-native platform for AI development, distributed training, simulation, evaluation, and deployment.
  • AI Research Enablement: Partner directly with ML researchers to understand evolving training workflows and ensure the platform supports state-of-the-art AI frameworks, foundation model development, reinforcement learning, distributed training, and emerging research workflows.
  • Developer Experience: Design self-service AI development workflows that enable engineers to move seamlessly from local experimentation to large-scale distributed execution using familiar open source tools and frameworks.
  • Distributed AI Infrastructure: Build the infrastructure required to support distributed training, simulation, inference, and reinforcement learning workloads. Evaluate and integrate orchestration, scheduling, and resource management technologies to maximize scalability and developer productivity.
  • Compute Platform: Design and optimize shared GPU infrastructure across cloud and on-premises environments. Improve resource utilization, scheduling efficiency, storage, networking, observability, and overall platform reliability.
  • Data & Model Lifecycle: Build platform capabilities that enable dataset management, experiment tracking, artifact management, model versioning, evaluation, deployment, monitoring, and continuous model improvement.
  • Platform Distribution: Develop repeatable deployment and lifecycle management solutions using Infrastructure as Code and modern platform engineering practices. Support commercial cloud, customer-managed infrastructure, sovereign environments, and fully air-gapped deployments.
  • Technology Leadership: Evaluate emerging AI infrastructure technologies and establish architectural patterns that balance scalability, performance, maintainability, and developer experience.
  • Cross-Functional Collaboration: Work closely with AI researchers, autonomy teams, infrastructure engineers, and product teams to ensure the platform evolves alongside customer needs and advances in AI.

Key Outcomes:
  • Engineers move from idea to distributed training in hours instead of days.
  • High GPU utilization through efficient scheduling with KAI on Kubernetes.
  • Researchers use modern AI tooling without unnecessary platform friction.
  • AI Workspaces become the standard development environment across autonomy programs.
  • Training, simulation, evaluation, and deployment operate as a unified platform.
  • The AI Factory Reference Architecture can be deployed consistently across cloud, on-premise, and air-gapped environments.
  • Platform capabilities are reusable across multiple autonomy programs and customer deployments.

Required qualifications:
  • Experience building Kubernetes-native AI or MLOps platforms supporting distributed machine learning workloads.
  • Deep understanding of modern AI training frameworks, including PyTorch, Hugging Face Transformers and distributed training techniques.
  • Experience operating GPU-accelerated infrastructure and distributed training systems.
  • Strong understanding of Kubernetes, Linux, networking, security, storage, and distributed systems.
  • Experience with GPU scheduling concepts and large-scale AI workloads.
  • Experience packaging and deploying cloud-native infrastructure using Terraform and Helm.
  • Strong software engineering skills in Python and Golang and modern cloud-native technologies.
  • Experience collaborating closely with ML researchers to translate research workflows into scalable platform capabilities.

Preferred qualifications:
  • Experience with Ray or other distributed AI orchestration frameworks.
  • Experience with KAI, Slurm or other GPU scheduling technologies.
  • Experience supporting reinforcement learning, simulation-driven training, robotics, or autonomy workloads.
  • Experience deploying and optimizing AI models for edge hardware.
  • Experience designing infrastructure for classified, sovereign, or air-gapped environments.
  • Experience with observability technologies such as OpenTelemetry, Prometheus, and Grafana.
  • Experience contributing to or maintaining open-source infrastructure projects.


#LI-DM2

#LF

Full-time regular employee offer package:

Pay within range listed + Bonus + Benefits + Equity

Temporary employee offer package:

Pay within range listed above + temporary benefits package (applicable after 60 days of employment)

Salary compensation is influenced by a wide array of factors including but not limited to skill set, level of experience, licenses and certifications, and specific work location. All offers are contingent on a cleared background and possible reference check. Military fellows and part-time employees are not eligible for benefits. Please speak to your talent acquisition representative for more information.

About Shield AI

Shield AI is a defense technology company that develops artificially intelligent systems for military applications. The company was founded in 2015 by Brandon Tseng, Ryan Tseng, and Andrew Reiter, and is headquartered in San Diego, California. Shield AI's products include autonomous drones and software that can be used for reconnaissance, surveillance, and other military operations. The company's mission is to reduce the number of military casualties by providing soldiers with better intelligence and situational awareness. Shield AI has received funding from a number of investors, including Andreessen Horowitz and Founders Fund.
Learn more about Shield AI
Size
200 employees
Industry
Founded
2015

Similar Jobs

More Jobs at Shield AI

More Aerospace & Defense Jobs

Find similar Senior Staff Engineer, ML Ops (R4941) jobs: