Group Product Manager - Inference and Token Factory

Volta

• $150K — $180K *
Enterprise Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • Significant product management experience in AI/ML infrastructure or inference serving
  • Experience managing other product managers or leading a product team
  • Strong technical understanding of model serving, inference optimization, or GPU compute
  • Track record of delivering infrastructure products in fast-evolving technical settings
  • Excellent prioritization and cross-functional communication skills

Responsibilities

  • Own product strategy and roadmap for inference infrastructure and token-serving capabilities
  • Lead and develop a team of product managers focusing on inference and serving infrastructure
  • Partner with platform engineering to define features that enhance inference throughput, latency, and cost efficiency
  • Track and translate industry and customer trends in inference workloads into roadmap priorities
  • Define and monitor key metrics for inference performance and efficiency
  • Represent inference and token-serving priorities in cross-functional and leadership planning
  • Collaborate with key customers to understand their evolving inference needs

Benefits

  • Equity in Volta, allowing you to share in the company's long-term success
  • Retirement/pension contributions
  • Comprehensive health, wellbeing, and insurance benefits
  • Generous vacation days to promote work-life balance
Full Job Description
About The Role

The Group Product Manager, Inference and Token Factory, owns product strategy for Volta's inference infrastructure - the systems that serve models efficiently at scale and turn compute into tokens, reliably and cost-effectively. You will lead a team of product managers focused on inference performance, efficiency, and the token-serving infrastructure that underpins AI workloads.

This is a role at the leading edge of AI infrastructure product work, in one of the fastest-moving technical spaces in the industry.

What You Will Be Doing
  • Own product strategy and roadmap for inference infrastructure and token-serving capabilities
  • Lead and develop a team of product managers focused on inference and serving infrastructure
  • Partner with platform engineering to define features that improve inference throughput, latency, and cost efficiency
  • Track industry and customer trends in inference workloads and translate them into roadmap priorities
  • Define and monitor metrics for inference performance and efficiency
  • Represent inference and token-serving priorities in cross-functional and leadership planning
  • Work with key customers to understand evolving inference needs


What You Bring
  • Significant product management experience in AI/ML infrastructure or inference serving is essential
  • Experience managing other product managers or leading a product team
  • Strong technical understanding of model serving, inference optimization, or GPU compute
  • A track record shipping infrastructure products in a fast-evolving technical space
  • Excellent prioritization and cross-functional communication skills
    REQ-141


What We Offer

At Volta, we believe people do their best work when they feel supported, trusted and able to grow. We're building a company where you can make an impact, keep a healthy balance between work and life, and build a career you're proud of.
As a global team, we do our best to provide great benefits wherever you're based. While some benefits vary by country due to local regulations, we believe looking after our people is simply the right thing to do.
  • Competitive salary based on the work you do here, not your previous salary
  • Equity in Volta, giving you the opportunity to share in the company's long-term success
  • Retirement/pension contributions
  • Comprehensive health, wellbeing and insurance benefits
  • Generous number of vacation days each year


Additional Information

Background Checks

All offers of employment at Volta are conditional on the satisfactory completion of pre-employment screening, which includes confirmation of your right to work, verification of your employment history and a criminal record check, where this is permitted by local law. Screening is carried out by Zinc, an accredited third-party provider, after an offer is made and all information is handled confidentially and in accordance with applicable data protection law.

Similar Jobs

More Jobs at Volta

More Enterprise Technology Jobs

Find similar Group Product Manager - Inference and Token Factory jobs: