Principal Product Manager - Inference Engine

DigitalOcean

• $218K — $273K *
Enterprise Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years in product management for infrastructure or AI-related products
  • Strong grasp of GPU economics and utilization strategies
  • Familiarity with modern AI workloads like LLM inference and model serving
  • Ability to communicate complex technical concepts to diverse audiences
  • Proven analytical skills for turning data into actionable product insights
  • Customer-focused mindset prioritizing developer needs and infrastructure reliability
  • Comfortable in fast-paced, ambiguous environments needing adaptability and ownership

Responsibilities

  • Define and drive the GPU strategy for inference offerings
  • Maximize GPU utilization to improve revenue and efficiency
  • Develop and prioritize the product roadmap in collaboration with engineering
  • Create a balanced product experience focusing on developer use and economic viability
  • Establish pricing and packaging strategies in partnership with finance and engineering teams
  • Engage with customers to guide product direction based on their needs
  • Collaborate with engineering teams to translate market demands into infrastructure requirements
  • Track and define key operating metrics for business performance

Benefits

  • Hybrid work flexibility
  • Opportunity to shape a high-growth infrastructure business
  • Collaboration with cutting-edge technology and talent
  • Access to professional development and training
  • Engagement with innovative AI-native companies
  • Ability to make a tangible impact in the AI infrastructure space
Full Job Description
We are looking for a Principal Product Manager for Inference Engine to define and own the product strategy for DigitalOcean's inference business. This product leader will be responsible for shaping our GPU strategy, pricing and packaging, utilization framework, and roadmap for serving developers and AI-native companies with high-performance inference at scale.This is a rare opportunity to help define a high-growth infrastructure business where product strategy, technical judgment, and business economics must come together. What You'll Do • Own the GPU strategy for the inference business: Define how DigitalOcean should deploy, allocate, price, and optimize GPU capacity across serverless inference, dedicated inference, batch workloads, and future inference offerings. • Maximize GPU utilization and margin: Create a clear product and business framework for improving token revenue per GPU hour, reducing idle capacity, reclaiming underutilized infrastructure, and driving better gross margin as the business scales. • Define the inference product roadmap: Partner with engineering to prioritize capabilities such as prompt caching, autoscaling, batching, latency optimization, observability, dedicated deployments, compliance features, and media model support. • Balance developer experience with infrastructure economics: Build products that are simple for developers to use while making rigorous tradeoffs around latency, availability, throughput, pricing, and cost-to-serve. • Create pricing and packaging strategy: Work with finance, GTM, and engineering to define SKUs, pricing models, discounting frameworks, and packaging for serverless, dedicated, and enterprise inference customers. • Drive customer-backed product decisions: Work directly with AI-native startups, mid-market customers, and strategic accounts to understand model needs, performance requirements, compliance expectations, and deployment patterns. • Partner deeply with engineering and infrastructure teams: Translate customer demand and business goals into infrastructure requirements across GPU fleet planning, model serving, capacity allocation, performance optimization, and reliability. • Establish operating metrics for the business: Define and track the metrics that matter, including GPU utilization, token throughput, revenue per GPU hour, latency, error rates, model adoption, margin, customer retention, and capacity efficiency. What You'll Bring • Deep product judgment in infrastructure or AI: Experience building infrastructure, developer platforms, ML platforms, inference systems, cloud services, or highly technical products for developers and enterprises. • Strong understanding of GPU economics: Ability to reason about utilization, throughput, latency, CapEx, cost-to-serve, gross margin, capacity planning, and workload placement. • Fluency in modern AI workloads: Familiarity with LLM inference, open-source models, model serving, prompt caching, batching, model routing, media models, latency tradeoffs, and production AI application patterns. • Technical depth with business orientation: You can work credibly with infrastructure engineers while also making clear product and business tradeoffs for executives, GTM teams, and customers. • Strong analytical rigor: You are comfortable building frameworks, models, and decision systems that turn ambiguous infrastructure and customer signals into clear product direction. • Customer obsession: You work backwards from developers and AI-native companies, but you also understand that great infrastructure products must be reliable, performant, simple, and economically sustainable. • Executive communication: You can explain complex technical and business decisions clearly to senior leaders, customers, and cross-functional teams. • Ownership mindset: You thrive in ambiguous, fast-moving environments where the product category is still forming and the right answer requires judgment, experimentation, and operational discipline. Compensation Range: • $218,000 - $273,000.00 *This is a hybrid role #LI-Hybrid

Similar Jobs

More Jobs at DigitalOcean

More Enterprise Technology Jobs

Find similar Principal Product Manager - Inference Engine jobs: