Senior Product Manager, AI Infrastructure

Vultr

$130K — $165K *
US-AnywhereRemote in United States
Enterprise Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years of experience in technical product management, specifically in infrastructure, cloud computing, or AI/ML platforms.
  • Deep technical knowledge of GPU compute, high-performance networking technologies such as InfiniBand and RoCE.
  • Experience directly engaging with enterprise customers to gather and define infrastructure specifications.
  • Solid understanding of AI/ML workloads, including training, fine-tuning, and inference at scale.
  • Demonstrated ability to work collaboratively with engineering teams on complex infrastructure products.
  • Strong communication skills, suitable for interacting with both technical personnel and executive audiences.
  • Familiarity with bare metal infrastructure alongside managed cloud services.
  • Bachelor's degree in Computer Science, Engineering, or a related field; an advanced degree is preferred.

Responsibilities

  • Own customer requirement discovery for AI infrastructure use cases, covering training, inference, and GPU clusters.
  • Engage with strategic customers to assess their technical needs, project timelines, and success metrics.
  • Translate customer feedback into specific product and engineering requirements.
  • Collaborate with engineering and operations teams to create customer-ready solutions.
  • Ensure alignment among customer needs, the product roadmap, and delivery execution processes.
  • Define technical requirements related to GPU compute, memory, storage, and networking infrastructure.
  • Assist with customer discussions on infrastructure design, capacity planning, and performance expectations.
  • Help develop scalable AI infrastructure capabilities that can serve multiple customers.

Benefits

  • Join a fast-growing team in a pivotal role at Vultr.
  • Opportunity to shape and influence the future of cloud infrastructure.
  • Engage with cutting-edge AI technologies and high-performance computing.
  • Collaborative environment with tech-focused teams and direct customer interactions.
Full Job Description


Vultr is seeking a Senior Product Manager, AI Infrastructure to work directly with customers and engineering teams to define, build, and deliver AI infrastructure capabilities for large-scale GPU workloads. The ideal candidate deeply understands customer requirements across AI infrastructure and can translate them into clear product and engineering requirements, with strong technical depth across GPU compute, storage, networking, cluster orchestration, and AI workload infrastructure. This is your opportunity to join our fast growing team and leave your mark on Vultr and the future of Cloud Infrastructure.

Key Responsibilities
  • Own the discovery and definition of customer requirements for AI infrastructure use cases, including training, inference, GPU clusters, bare metal, managed orchestration, networking, and storage
  • Work directly with strategic customers to understand their technical needs, deployment timelines, workload patterns, and success criteria
  • Translate customer requirements into clear product requirements, technical specifications, and engineering priorities
  • Partner closely with engineering, infrastructure, networking, storage, and operations teams to deliver customer-ready solutions
  • Drive alignment across customer needs, product roadmap, architecture decisions, and delivery execution
  • Understand and define requirements across GPU compute, CPU, memory, local and shared storage, high-performance networking, cluster topology, and orchestration layers such as Kubernetes and Slurm
  • Support customer conversations around infrastructure design, capacity planning, performance expectations, operational readiness, and acceptance criteria
  • Help define product capabilities that can scale beyond a single customer into repeatable AI infrastructure offerings

Qualifications
  • 5+ years of experience in technical product management, with focus on infrastructure, cloud computing, or AI/ML platforms
  • Deep technical understanding of GPU compute, high-performance networking (InfiniBand, RoCE), distributed storage, and cluster orchestration (Kubernetes, Slurm)
  • Experience working directly with enterprise customers to define infrastructure requirements and translate them into product specifications
  • Strong understanding of AI/ML workloads including training, fine-tuning, and inference at scale
  • Proven ability to collaborate with engineering teams to deliver complex infrastructure products
  • Excellent written and verbal communication skills, with the ability to engage both technical and executive audiences
  • Experience with bare metal infrastructure and managed cloud services
  • Bachelor's degree in Computer Science, Engineering, or related technical field; advanced degree preferred

Compensation

$130,000 - $165,000

Final compensation will vary depending on years of experience, background/skill set, location, and applicable laws.

Similar Jobs

More Jobs at Vultr

More Enterprise Technology Jobs

Find similar Senior Product Manager, AI Infrastructure jobs: