Advanced Micro Devices, Inc

Senior Product Manager - ROCm & AI/ML Inference Software

Advanced Micro Devices, Inc • $130K — $180K *
Santa Clara, CA 95051In-Person
Consumer Technology
5 - 7 years of experience
Today
Be an Early Applicant
Job Overview by Ladders

Qualifications

  • 5-7 years of product management experience in software, focusing on developer tools or AI/ML infrastructure.
  • Deep familiarity with frameworks such as PyTorch or JAX, understanding their developer experience.
  • Practical knowledge of large language model (LLM) inference techniques and performance optimizations.
  • Hands-on ability to read and understand GPU programming code, with experience in HIP, CUDA, or Triton kernels.
  • Strong communication skills to produce technical documentation and deliver strategy presentations.
  • Previous experience at a GPU vendor or in AI infrastructure teams is preferred.
  • Contributions or experience in open-source projects related to AI inference.

Responsibilities

  • Own the ROCm product roadmap for inference software, enhancing integrations with frameworks.
  • Define and convey a strategy for AMD's software to support production inference workloads.
  • Drive the inclusion of necessary AMD software features responsive to emerging architectures and techniques.
  • Continuously assess industry research and technology trends to refine product strategies.
  • Engage actively with the open-source AI community, monitoring trends and identifying opportunities.
  • Build lasting relationships with key open-source contributors and communicate AMD's direction.
  • Collaborate with engineering teams to prioritize and drive effective software development.

Benefits

  • Comprehensive health, dental, and vision plans.
  • 401(k) retirement savings plan with company match.
  • Paid time off for vacation and personal days.
  • Professional development and training opportunities.
  • Flexible work arrangements, including remote work options.
Full Job Description
THE ROLE:

AMD is seeking a Senior Product Manager to drive strategy and execution for ROCm, AMD's open-source GPU software stack, with a specific focus on large-scale model inference on AMD Instinct™ and Radeon™ hardware. This is a key, central role sitting at the intersection of the open-source community, high-performance computing, and production AI deployment.

You will join a small but focused team of product managers whose shared remit is inference at scale and the frameworks that enable it. You will influence engineering roadmaps, represent AMD in open-source communities and at conferences, and connect the needs of AMD's most strategic customers with the direction of the open-source ecosystem. AMD's customers include some of the organizations deploying and serving the largest language models in the world.

THE PERSON:

You are a technically fluent product leader with deep roots in GPU computing, open-source software, and AI inference infrastructure. You thrive on moving fast in a community-driven environment while also navigating the nuanced requirements of enterprise-scale customers. You are as comfortable reading a GitHub issue thread as you are presenting a roadmap to a VP of Engineering at a hyperscaler.

KEY RESPONSBILITIES:

Product Strategy & Roadmap
  • Own the product roadmap for ROCm's inference software capabilities, including integrations with key frameworks like PyTorch and JAX, serving runtimes like vLLM and SGLang, and the libraries and profiling tools that make inference workloads perform well on AMD hardware.
  • Define and communicate a coherent strategy for how AMD software enables production inference workloads, covering the full range from single-GPU to rack-scale deployments, with a focus on developer experience, performance portability, and competitive standing.
  • Identify when emerging OSS model architectures, serving runtimes, or inference techniques require an AMD software response and drive those requirements into the roadmap.
  • Bring a strategic lens to inference by continuously evaluating the latest research, technology trends, and evolving deployment needs, ensuring the organization stays ahead of future inference requirements and translates market signals into actionable product strategy.

Open-Source Community Engagement
  • Serve as AMD's active presence in the open-source AI/ML community: monitor GitHub repositories, Discord servers, developer blogs, and academic papers to track emerging trends, pain points, and opportunities.
  • Own and communicate AMD's open-source software roadmap, publishing updates across key community projects to build awareness, solicit feedback from model developers and researchers, and signal AMD's long-term direction to the open-source ecosystem.
  • Build and maintain relationships with key OSS maintainers, foundation working groups, and community contributors whose work shapes how AMD hardware is perceived and adopted.
  • Represent AMD at major conferences such as SC, PyTorch Conference, and MLSys; write and review technical blog posts and community announcements on the AMD ROCm blog.

Engineering Partnership & Execution
  • Partner with engineering leads across inference libraries, kernel, runtime, and serving integration teams to translate developer and customer needs into prioritized engineering work.
  • Drive release planning across rapid release cadences with a CI/CD-first mindset and strong attention to compatibility, regression, and ecosystem readiness.
  • Provide software-informed feedback to hardware teams on future GPU architecture decisions, particularly where features relevant to inference workloads affect serving performance at scale.

Customer & Partner Engagement
  • Balance the signal from large customers, who may need specific optimizations or bespoke integrations, against the needs of the broader open-source community, who value standards, portability, and low friction.
  • Collaborate with ecosystem partners such as Hugging Face, Red Hat, and cloud providers on joint integrations and AMD-supported software solutions.


PREFERRED EXPERIENCE:
  • Proven years of product management experience in a software-focused role, ideally developer tools, GPU computing, or AI/ML infrastructure.
  • Deep familiarity with at least one of PyTorch, JAX, or Triton: how they are structured, how they dispatch work to hardware backends, and what the end-to-end developer experience looks like.
  • Practical understanding of LLM inference, including attention mechanisms, KV cache design, quantization strategies such, continuous batching, speculative decoding, and parallel serving across multiple GPUs.
  • Hands-on familiarity with GPU programming at some level, whether HIP, CUDA, or Triton kernels, with the ability to read kernel-level code and benchmark output even if not writing it day to day.
  • Strong written communication skills across technical documentation, roadmap narratives, community blog posts, and executive-facing strategy documents.
  • Prior experience at a GPU vendor, cloud provider AI infrastructure team, or frontier AI lab.
  • Experience contributing to or managing products in an open-source context: GitHub workflows, community governance, and OSS release management.
  • Contributions in code, issues, or documentation to major open-source inference projects such as vLLM, SGLang, Triton, or PyTorch.
  • Familiarity with AMD's hardware portfolio: Instinct MI-series for data center compute and Radeon for workstation and consumer GPU compute.

ACADEMIC CREDENTIALS:
  • Bachelor's degree in Computer Science, Electrical Engineering, or a related technical field. Advanced degree a plus but not required given equivalent experience.

LOCATION:
  • Bay Area • Austin • Remote

This role is not eligible for visa sponsorship.

#LI-EV1

#LI-HYBRID

Benefits offered are described: AMD benefits at a glance.

About Advanced Micro Devices, Inc

Advanced Micro Devices, Inc. Careers

Join the innovative forefront of technology with a career at Advanced Micro Devices, Inc. (AMD), a leader in semiconductor development. As part of our global team, you will contribute to an organization renowned for its dedication to innovation, leadership, and diversity in the tech industry.

Work You’ll Do

At AMD, we offer job opportunities that push the boundaries of what is possible. Our team is composed of professionals who lead the way in microprocessor and graphics technology, driving industry standards and innovation. With AMD, you will be part of a culture that values growth and professional development, ensuring that every team member has the opportunity to excel.

Transform Your Career

AMD is not just about advancing technology, but also about advancing careers. Whether you are looking for an internship, a full-time position, or leadership roles, AMD provides the platform to propel your career to new heights. Our commitment to professional growth is matched by our dedication to diversity and inclusion, making AMD a place where everyone can thrive.

Innovative Work Environment

Join a team of over 12,000 dedicated professionals at the intersection of technology, industry expertise, and digital innovation. At AMD, you will work on groundbreaking projects that shape the future of computing and graphics. Our collaborative environment encourages networking and the sharing of ideas across teams and disciplines.

Career Development and Benefits

AMD is committed to the development of its employees. We offer robust training programs, including leadership development and diversity training, to ensure our team is equipped for both current challenges and future opportunities. Our benefits package is designed to support the well-being and financial security of our employees and their families.

Explore Job Opportunities

From engineering to marketing, AMD offers a range of career paths that cater to diverse skills and interests. Our hiring process is designed to be transparent and engaging, helping you to understand where you fit within our team and how you can contribute to our collective goals.

Stay Connected

Join Our Team Search open positions that match your skills and interest. We look for passionate, curious, creative, and solution-driven team players. Explore the opportunities to join a company that’s committed to your career growth and to innovation in the technology sector.

Keep Up to Date

Stay ahead with career tips, insider perspectives, and industry-leading insights you can put to use today—all from the people who work here.

Job Alert Emails

Personalize your subscription to receive job alerts, latest news, and insider tips tailored to your preferences. Discover the exciting and rewarding career opportunities that await at Advanced Micro Devices, Inc.

Interview and Resume Tips

Prepare for your future with AMD by accessing resources that help you craft your resume and excel in interviews. Our goal is to help you showcase your best professional self and align your skills with the needs of our dynamic team. At Advanced Micro Devices, Inc., we empower our employees to innovate, lead, and grow. Join us in driving the future of technology while building a rewarding and sustainable career.
Learn more about Advanced Micro Devices, Inc
Size
15,500 employees
Market Cap
$100.9 billion
Industry
Manufacturing & Automotive
Net Income
$2.4 billion
Founded
1969
5 Year Trend
+30.9%
Revenue
$9.7 billion
NASDAQ
AMD
* Ladders Estimates

Similar Jobs

Ad banner background

Get Ready For Your
Next Interview

More Jobs at Advanced Micro Devices, Inc

More Consumer Technology Jobs

Find similar Senior Product Manager - ROCm & AI/ML Inference Software jobs:

NationwideSanta Clara, CA