Senior Product Manager, Compute Platform

Emerald AI

$120K — $160K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years of product management experience in infrastructure software, cloud platforms, or distributed systems.
  • Experience delivering complex technical platform products like APIs or control planes.
  • Ability to create clear product specifications and acceptance criteria.
  • Experience in managing technical challenges from concept to execution balancing customer and engineering needs.
  • Strong prioritization and communication skills with cross-functional leadership experience.
  • Comfortable in a fast-paced startup environment and collaboration with senior engineering teams.

Responsibilities

  • Own the roadmap for the AI compute platform focusing on orchestration and observability.
  • Define product capabilities for AI workloads on distributed infrastructure, ensuring high reliability.
  • Translate product strategy into precise, technical requirements with the engineering team.
  • Drive development of platform services, including telemetry pipelines and power profile simulations.
  • Engage with customers to understand operational workflows and platform requirements.
  • Lead product releases, ensuring quality and operational readiness for a seamless experience.
  • Balance customer value and technical feasibility in prioritizing platform investments.

Benefits

  • Make an impact on AI infrastructure and sustainable data center scaling.
  • Collaborate within a team of experts in a low-ego environment.
  • Influence various company strategies from day one as part of initial growth.
  • Receive competitive pay and equity options.
  • Access comprehensive benefits including medical, dental, vision, and 401(k) matching.
  • Enjoy flexible work options with location choices and work-from-home days.
  • Join a company supported by prominent investors like Radical Ventures and NVIDIA.
Full Job Description
About the Role

Emerald AI is building the software platform that enables AI infrastructure to intelligently orchestrate compute in response to power availability, grid conditions, and operational constraints. We are looking for a Senior Product Manager to own the core platform powering our technology.

This is a highly technical product role where you'll work alongside engineering to define platform capabilities, translate complex customer and technical requirements into clear product direction, and drive execution from concept through production. You'll operate at the intersection of distributed systems, AI infrastructure, cloud platforms, and data center software.

If you enjoy solving deeply technical infrastructure problems, partnering closely with engineers, and building products from first principles, we'd love to talk.

Key Responsibilities
  • Own the roadmap for Emerald AI's core compute platform, including workload orchestration, control plane capabilities, APIs, telemetry, and platform observability.
  • Define product capabilities that intelligently orchestrate AI workloads across distributed compute infrastructure while ensuring reliability, scalability, and performance.
  • Partner closely with engineering to translate product strategy into clear, technically rigorous requirements and execution plans.
  • Drive the evolution of platform services, including workload power profile simulation, NVIDIA DSX integrations, and telemetry pipelines.
  • Work directly with customers and internal stakeholders to understand infrastructure workflows, operational challenges, and platform requirements.
  • Lead platform releases from planning through deployment, ensuring high quality, operational readiness, and a seamless customer experience.
  • Prioritize platform investments by balancing customer value, technical complexity, and long-term architectural goals.


Minimum requirements
  • 5+ years of product management experience building infrastructure software, cloud platforms, or distributed systems.
  • Experience delivering highly technical platform products, including APIs, control planes, or developer-facing infrastructure.
  • Demonstrated ability to write exceptionally clear product requirements, technical specifications, and acceptance criteria.
  • Proven ability to drive ambiguous technical problems from concept to execution while balancing customer needs and engineering constraints.
  • Excellent prioritization, written communication, and cross-functional leadership skills.
  • Comfortable operating in a fast-moving, early-stage startup environment and partnering closely with senior engineering teams.


Preferred requirements
  • Experience with AI infrastructure, GPU scheduling, or large-scale compute orchestration.
  • Experience building platform or infrastructure software products.
  • Familiarity with observability platforms, telemetry pipelines, monitoring systems, or infrastructure instrumentation.
  • Experience with Kubernetes, workload schedulers (e.g., Slurm), or distributed compute platforms.
  • Exposure to NVIDIA's AI software ecosystem, including NVIDIA DSX and related technologies.
  • Experience with power-aware scheduling, workload optimization, or data center infrastructure is a plus.


What We Offer
  • Make an impact. Solve the AI power bottleneck and shape how data centers scale sustainably.
  • Join a world-class team of AI, cloud, software, and energy experts in a collaborative, low-ego environment.
  • Build from 01. Influence strategy, GTM, org design, and customer/investor engagement from day one.
  • Competitive pay + equity. Stock options let you share in the value you help create.
  • Comprehensive benefits, including medical, dental, vision, and 401(k) matching.
  • Flexible location. Work from D.C., Boston, or the Bay Area, with 2 WFH day/week.
  • Backed by top investors, including Radical Ventures and NVIDIA.


Similar Jobs

More Jobs at Emerald AI

More Information Technology Jobs

Find similar Senior Product Manager, Compute Platform jobs: