Advanced Micro Devices, Inc

Fellow Software Engineer - AI Performance & Reliability

Advanced Micro Devices, Inc • $150K — $180K *
San Jose, CA 95123In-Person
Consumer Technology
Less than 5 years of experience
Today
Be an Early Applicant
Job Overview by Ladders

Qualifications

  • 5-7 years of experience in software engineering with a focus on AI infrastructure.
  • Proficiency in programming languages like Python or C++ for systems-oriented tasks.
  • Expertise in profiling and optimizing AI workloads, specifically in model training or inference.
  • Strong understanding of computer architecture and systems performance concepts.
  • Experience with machine learning frameworks such as PyTorch, TensorFlow, or JAX.

Responsibilities

  • Profile and optimize AI workloads for improved performance.
  • Investigate and resolve complex performance issues across software and hardware layers.
  • Collaborate closely with customers to understand and address their technical challenges.
  • Develop performance tools and documentation to facilitate better system observability.
  • Translate customer feedback into actionable product enhancements.

Benefits

  • Hybrid work model with preferred locations in San Jose, CA or Bellevue, WA.
  • Comprehensive AMD benefits package.
Full Job Description
Fellow Software Engineer - AI Performance & Reliability

THE ROLE:

We are looking for a strong, Principal or Fellow level software engineer to join our AI Infrastructure team. You will work on improving the performance, efficiency, and reliability of AI workloads across both model training and inference.

Our team supports a broad range of machine learning systems, including large language models, diffusion models, and recommendation models. You will collaborate closely with customers and internal engineering teams to understand performance bottlenecks, optimize workloads, and ensure that models run reliably at scale.

This role is a strong fit for an engineer who enjoys working across the AI software and hardware stack, solving technically challenging performance problems, and partnering directly with customers to make them successful.

You will help customers achieve meaningful improvements in model performance and system reliability. You will identify difficult bottlenecks, develop reusable solutions, and help shape the infrastructure and product capabilities needed to run demanding AI workloads efficiently at scale.

THE PERSON:
  • Profile and optimize AI model training and inference workloads.
  • Improve model throughput, latency, memory efficiency, scalability, and reliability.
  • Identify bottlenecks across models, frameworks, compilers, runtimes, operating systems, and hardware.
  • Optimize workloads involving large language models, diffusion models, recommendation systems, and other modern machine learning architectures.
  • Develop performance tooling, benchmarks, automation, and observability systems.
  • Investigate and resolve complex production issues affecting AI workloads.
  • Collaborate with customers to understand their technical requirements, reproduce issues, and recommend effective solutions.
  • Translate customer feedback into product and infrastructure improvements.
  • Work closely with machine learning engineers, systems engineers, hardware teams, and product teams.
  • Document performance findings, technical recommendations, and best practices.

KEY RESPONSIBILITIES:
  • Strong software engineering skills and experience building production-quality systems.
  • Experience working with AI infrastructure for model training, inference, or both.
  • Demonstrated experience profiling and optimizing machine learning models or AI workloads.
  • Strong foundations in computer architecture, including processors, memory hierarchies, parallelism, and performance tradeoffs.
  • Solid understanding of systems performance concepts such as latency, throughput, memory bandwidth, utilization, and distributed communication.
  • Proficiency in languages such as Python, C++, or similar systems-oriented programming languages.
  • Experience with machine learning frameworks such as PyTorch, TensorFlow, or JAX.
  • Strong debugging and analytical skills, with the ability to investigate problems across multiple layers of the technology stack.
  • Clear written and verbal communication skills.
  • A customer-focused mindset and willingness to work directly with customers through technical evaluations, deployments, troubleshooting, and ongoing support.

PREFERRED EXPERIENCE:
  • Experience optimizing large language models, diffusion models, or recommendation models.
  • Experience with GPU, accelerator, or distributed computing environments.
  • Familiarity with technologies such as ROCm, HIP, CUDA, Triton, XLA, MLIR, NCCL, or similar performance-oriented tools and runtimes.
  • Experience with distributed training, model serving, quantization, compilation, kernel optimization, or memory optimization.
  • Experience operating AI systems in production environments.
  • Prior experience in solutions engineering, field engineering, developer relations, or another customer-facing technical role.
  • Experience designing benchmarks and conducting systematic performance analysis.

ACADEMIC CREDENTIALS:
  • A PhD (or a master's degree with equivalent experience) in artificial intelligence, machine learning, computer science, or a related field.

LOCATION:

San Jose, CA or Bellevue, WA preferred (Hybrid). Other US locations may be considered.

#LI-MV1

#HYBRID

Benefits offered are described: AMD benefits at a glance.

About Advanced Micro Devices, Inc

Advanced Micro Devices, Inc. Careers

Join the innovative forefront of technology with a career at Advanced Micro Devices, Inc. (AMD), a leader in semiconductor development. As part of our global team, you will contribute to an organization renowned for its dedication to innovation, leadership, and diversity in the tech industry.

Work You’ll Do

At AMD, we offer job opportunities that push the boundaries of what is possible. Our team is composed of professionals who lead the way in microprocessor and graphics technology, driving industry standards and innovation. With AMD, you will be part of a culture that values growth and professional development, ensuring that every team member has the opportunity to excel.

Transform Your Career

AMD is not just about advancing technology, but also about advancing careers. Whether you are looking for an internship, a full-time position, or leadership roles, AMD provides the platform to propel your career to new heights. Our commitment to professional growth is matched by our dedication to diversity and inclusion, making AMD a place where everyone can thrive.

Innovative Work Environment

Join a team of over 12,000 dedicated professionals at the intersection of technology, industry expertise, and digital innovation. At AMD, you will work on groundbreaking projects that shape the future of computing and graphics. Our collaborative environment encourages networking and the sharing of ideas across teams and disciplines.

Career Development and Benefits

AMD is committed to the development of its employees. We offer robust training programs, including leadership development and diversity training, to ensure our team is equipped for both current challenges and future opportunities. Our benefits package is designed to support the well-being and financial security of our employees and their families.

Explore Job Opportunities

From engineering to marketing, AMD offers a range of career paths that cater to diverse skills and interests. Our hiring process is designed to be transparent and engaging, helping you to understand where you fit within our team and how you can contribute to our collective goals.

Stay Connected

Join Our Team Search open positions that match your skills and interest. We look for passionate, curious, creative, and solution-driven team players. Explore the opportunities to join a company that’s committed to your career growth and to innovation in the technology sector.

Keep Up to Date

Stay ahead with career tips, insider perspectives, and industry-leading insights you can put to use today—all from the people who work here.

Job Alert Emails

Personalize your subscription to receive job alerts, latest news, and insider tips tailored to your preferences. Discover the exciting and rewarding career opportunities that await at Advanced Micro Devices, Inc.

Interview and Resume Tips

Prepare for your future with AMD by accessing resources that help you craft your resume and excel in interviews. Our goal is to help you showcase your best professional self and align your skills with the needs of our dynamic team. At Advanced Micro Devices, Inc., we empower our employees to innovate, lead, and grow. Join us in driving the future of technology while building a rewarding and sustainable career.
Learn more about Advanced Micro Devices, Inc
Size
15,500 employees
Market Cap
$100.9 billion
Industry
Manufacturing & Automotive
Net Income
$2.4 billion
Founded
1969
5 Year Trend
+30.9%
Revenue
$9.7 billion
NASDAQ
AMD
* Ladders Estimates

Similar Jobs

Ad banner background

Get Ready For Your
Next Interview

More Jobs at Advanced Micro Devices, Inc

More Consumer Technology Jobs

Find similar Fellow Software Engineer - AI Performance & Reliability jobs:

NationwideSan Jose, CA