Advanced Micro Devices, Inc

Fellow Software Development Engineer, GEMM Optimization

Advanced Micro Devices, Inc • $150K — $180K *
San Jose, CA 95123In-Person
Enterprise Technology
Less than 5 years of experience
Today
Be an Early Applicant
Job Overview by Ladders

Qualifications

  • 5-7 years of experience in GPU microarchitecture and low-level code generation
  • Extensive knowledge of GEMM algorithms and GPU hardware mapping
  • Strong software engineering skills with experience in production-quality software
  • Experience in optimizing GPU compute kernels, particularly GEMM and attention
  • Proficient in C++ and assembly-level GPU programming
  • Familiarity with parallel computing and memory hierarchies
  • Effective communication skills for cross-functional collaboration

Responsibilities

  • Analyze AMD GPU specifications to align design with silicon capabilities
  • Develop support for new optimization features in code-generator
  • Innovate algorithms for GEMM and GEMM + X implementations
  • Profile and diagnose performance bottlenecks in GEMM across the stack
  • Work with customers to understand workload requirements and improve performance

Benefits

  • Comprehensive AMD benefits at a glance
Full Job Description
THE ROLE:

AMD is seeking a Fellow Software Development Engineer to architect and develop features in the tensile-lite assembly code generator for General Matrix Multiplication (GEMM) and GEMM + X (including attention). GEMM performance is one of the most critical levers for AI workload efficiency and this role sits at the center of AMD's effort to deliver best-in-class matrix-multiply performance across current and next-generation hardware.

You will own the deep, hardware-aware optimization work that turns AMD's GPU architecture into delivered performance: understanding the hardware specification at the instruction and pipeline level, partnering directly with hardware architects to influence future designs, and innovating algorithms to extract maximum throughput.

THE PERSON:

This role is a strong fit for an engineer who wants to work at the intersection of GPU microarchitecture, low-level code generation, and applied AI performance - someone equally comfortable reading a hardware spec, writing hand-tuned assembly, and explaining a performance tradeoff to a customer or an architect.

KEY RESPONSIBILITIES
  • Analyze AMD GPU hardware specifications in depth and work closely with hardware architects to align kernel design with current silicon capabilities and to influence requirements for future generations.
  • Develop support for new ISA and HW/SW optimization features in the code-generator
  • Innovate and implement new algorithms for implementing GEMM and GEMM + X
  • Profile and root-cause GEMM performance bottlenecks across the stack
  • Partner with customers and internal stakeholders to understand real-world workload requirements, reproduce performance issues, and deliver targeted performance

PREFERRED EXPERIENCE:
  • Strong command of GPU computer architecture: compute units, register files, cache/LDS hierarchies, memory bandwidth, matrix cores/WMMA-style instructions, and instruction scheduling/latency hiding.
  • Deep expertise in GEMM algorithms and their mapping onto GPU hardware (tiling, blocking, register/LDS allocation, wave scheduling, memory hierarchy utilization).
  • Strong software engineering fundamentals with a track record of building production-quality, high-performance software.
  • Demonstrated experience optimizing GPU compute kernels, ideally GEMM and attention
  • Proficiency in C++ and assembly-level GPU programming; working knowledge of Python for tooling/automation.
  • Solid understanding of parallel computing, memory hierarchies, and hardware-software performance tradeoffs.
  • Clear written and verbal communication skills; ability to work effectively with hardware architects, customers, and cross-functional engineering teams.
  • Direct experience with any GPU compiler backend
  • Experience with AMD GPU architectures (CDNA/RDNA) or comparable competitive architectures (NVIDIA Hopper/Blackwell, etc.)
  • Contributions to industry standards, publications, or patents related to GPU compute or matrix-multiply optimization

PREFERRED ACADEMIC CREDENTIALS:

BS/MS/PHD in CS/CE or related field with deep relevant experience

LOCATION: San Jose, CA

Benefits offered are described: AMD benefits at a glance.

About Advanced Micro Devices, Inc

Advanced Micro Devices, Inc. Careers

Join the innovative forefront of technology with a career at Advanced Micro Devices, Inc. (AMD), a leader in semiconductor development. As part of our global team, you will contribute to an organization renowned for its dedication to innovation, leadership, and diversity in the tech industry.

Work You’ll Do

At AMD, we offer job opportunities that push the boundaries of what is possible. Our team is composed of professionals who lead the way in microprocessor and graphics technology, driving industry standards and innovation. With AMD, you will be part of a culture that values growth and professional development, ensuring that every team member has the opportunity to excel.

Transform Your Career

AMD is not just about advancing technology, but also about advancing careers. Whether you are looking for an internship, a full-time position, or leadership roles, AMD provides the platform to propel your career to new heights. Our commitment to professional growth is matched by our dedication to diversity and inclusion, making AMD a place where everyone can thrive.

Innovative Work Environment

Join a team of over 12,000 dedicated professionals at the intersection of technology, industry expertise, and digital innovation. At AMD, you will work on groundbreaking projects that shape the future of computing and graphics. Our collaborative environment encourages networking and the sharing of ideas across teams and disciplines.

Career Development and Benefits

AMD is committed to the development of its employees. We offer robust training programs, including leadership development and diversity training, to ensure our team is equipped for both current challenges and future opportunities. Our benefits package is designed to support the well-being and financial security of our employees and their families.

Explore Job Opportunities

From engineering to marketing, AMD offers a range of career paths that cater to diverse skills and interests. Our hiring process is designed to be transparent and engaging, helping you to understand where you fit within our team and how you can contribute to our collective goals.

Stay Connected

Join Our Team Search open positions that match your skills and interest. We look for passionate, curious, creative, and solution-driven team players. Explore the opportunities to join a company that’s committed to your career growth and to innovation in the technology sector.

Keep Up to Date

Stay ahead with career tips, insider perspectives, and industry-leading insights you can put to use today—all from the people who work here.

Job Alert Emails

Personalize your subscription to receive job alerts, latest news, and insider tips tailored to your preferences. Discover the exciting and rewarding career opportunities that await at Advanced Micro Devices, Inc.

Interview and Resume Tips

Prepare for your future with AMD by accessing resources that help you craft your resume and excel in interviews. Our goal is to help you showcase your best professional self and align your skills with the needs of our dynamic team. At Advanced Micro Devices, Inc., we empower our employees to innovate, lead, and grow. Join us in driving the future of technology while building a rewarding and sustainable career.
Learn more about Advanced Micro Devices, Inc
Size
15,500 employees
Market Cap
$100.9 billion
Industry
Manufacturing & Automotive
Net Income
$2.4 billion
Founded
1969
5 Year Trend
+30.9%
Revenue
$9.7 billion
NASDAQ
AMD
* Ladders Estimates

Similar Jobs

Ad banner background

Get Ready For Your
Next Interview

More Jobs at Advanced Micro Devices, Inc

More Enterprise Technology Jobs

Find similar Fellow Software Development Engineer, GEMM Optimization jobs:

NationwideSan Jose, CA