Advanced Micro Devices, Inc

Principal Software Engineer - PyTorch Training Frameworks

Advanced Micro Devices, Inc$150K — $180K *
Enterprise Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 5-7 years of experience with PyTorch and training systems
  • In-depth knowledge of distributed training techniques
  • Strong track record in performance engineering
  • Proficient in Python and C/C++ programming
  • Familiar with Linux-based environments and performance tools
  • Excellent communication skills for technical documentation and teamwork
  • Proven leadership ability in cross-team projects.

Responsibilities

  • Act as the technical authority for PyTorch training performance at AMD
  • Optimize performance for key training workloads in various systems
  • Debug and improve training performance across multiple areas
  • Collaborate with teams to resolve performance and correctness bottlenecks
  • Influence upstream PyTorch contributions and discussions
  • Develop benchmarks and workflows for training performance
  • Mentor engineers to enhance framework quality and practices.

Benefits

  • Comprehensive health and wellness programs
  • Flexible work hours and hybrid work options
  • Retirement savings plans with company match
  • Continuous learning and development opportunities
  • Collaborative and innovative work environment.
Full Job Description
PRINCIPAL SOFTWARE DEVELOPMENT ENGINEER - PYTORCH TRAINING FRAMEWORKS

THE ROLE:

AMD is looking for a Principal-level PyTorch training framework expert to help drive performance, scalability, and correctness of large-scale AI training on AMD Instinct™ accelerators. You will work at the intersection of PyTorch internals, distributed training, and hardware-aware optimization, partnering closely with compiler, kernel, driver, and architecture teams to deliver industry-leading training performance and developer experience.

THE PERSON:

The ideal candidate is deeply hands-on with PyTorch training and thrives on solving complex systems problems (performance, scaling, memory efficiency, distributed communication). You bring strong technical leadership, can influence architecture across teams, and are comfortable driving ambiguity to crisp execution. You communicate clearly with both engineers and stakeholders and can represent AMD credibly in upstream/open-source discussions.

KEY RESPONSIBILITIES:
  • Act as a technical authority for PyTorch training at AMD, setting direction for performance, scalability, and reliability
    Drive optimization of key PyTorch training workloads (LLMs/foundation models) across single-node and multi-node systems
  • Improve and debug training performance in areas such as DDP/FSDP, gradient checkpointing, mixed precision, memory planning, and communication/computation overlap
  • Partner with ROCm compiler/runtime, kernel, and driver teams to resolve performance bottlenecks and correctness issues across the full stack
  • Contribute to and influence upstream PyTorch (design discussions, code contributions, performance fixes, CI/debug)
  • Develop and maintain representative training benchmarks, profiling workflows, and performance regression detection for key models
  • Lead deep-dive investigations of performance regressions and hard correctness issues; drive cross-team resolution to closure
  • Mentor engineers and raise the bar on framework-quality code, performance engineering practices, and technical rigor
  • Engage with strategic customers/partners on training enablement, root-cause analysis, and best-practices for AMD platforms

PREFERRED EXPERIENCE:
  • Deep experience with PyTorch internals and training systems (Autograd, optimizers, dataloading, compilation paths, runtime behavior)
  • Strong distributed training expertise: DDP, FSDP, tensor/pipeline parallel concepts, collectives (NCCL/RCCL), multi-node debugging
  • Proven track record in performance engineering (profiling, tracing, kernel/runtime analysis, memory optimization, scaling studies)
  • Strong programming skills in Python and C/C++ (ability to land clean, maintainable changes in large codebases)
  • Familiarity with PyTorch ecosystem components such as TorchInductor / torch.compile, Triton, CUDA/HIP-style programming models, and performance tooling
  • Experience working across OS/hardware boundaries in Linux-based environments (containers, CI, drivers/runtimes are a plus)
  • Clear technical communication: design docs, code reviews, stakeholder updates, and cross-team coordination
  • Demonstrated ability to lead through influence (principal-level impact, mentoring, and architectural decision-making)


ACADEMIC CREDENTIALS:
  • Bachelor's or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent


LOCATION:

San Jose, Seattle or Austin are preferred US locations (hybrid). Open to considering other US locations near AMD offices.

#LI-MV1

#HYBRID

Benefits offered are described: AMD benefits at a glance.

About Advanced Micro Devices, Inc

Advanced Micro Devices, Inc. Careers

Join the innovative forefront of technology with a career at Advanced Micro Devices, Inc. (AMD), a leader in semiconductor development. As part of our global team, you will contribute to an organization renowned for its dedication to innovation, leadership, and diversity in the tech industry.

Work You’ll Do

At AMD, we offer job opportunities that push the boundaries of what is possible. Our team is composed of professionals who lead the way in microprocessor and graphics technology, driving industry standards and innovation. With AMD, you will be part of a culture that values growth and professional development, ensuring that every team member has the opportunity to excel.

Transform Your Career

AMD is not just about advancing technology, but also about advancing careers. Whether you are looking for an internship, a full-time position, or leadership roles, AMD provides the platform to propel your career to new heights. Our commitment to professional growth is matched by our dedication to diversity and inclusion, making AMD a place where everyone can thrive.

Innovative Work Environment

Join a team of over 12,000 dedicated professionals at the intersection of technology, industry expertise, and digital innovation. At AMD, you will work on groundbreaking projects that shape the future of computing and graphics. Our collaborative environment encourages networking and the sharing of ideas across teams and disciplines.

Career Development and Benefits

AMD is committed to the development of its employees. We offer robust training programs, including leadership development and diversity training, to ensure our team is equipped for both current challenges and future opportunities. Our benefits package is designed to support the well-being and financial security of our employees and their families.

Explore Job Opportunities

From engineering to marketing, AMD offers a range of career paths that cater to diverse skills and interests. Our hiring process is designed to be transparent and engaging, helping you to understand where you fit within our team and how you can contribute to our collective goals.

Stay Connected

Join Our Team Search open positions that match your skills and interest. We look for passionate, curious, creative, and solution-driven team players. Explore the opportunities to join a company that’s committed to your career growth and to innovation in the technology sector.

Keep Up to Date

Stay ahead with career tips, insider perspectives, and industry-leading insights you can put to use today—all from the people who work here.

Job Alert Emails

Personalize your subscription to receive job alerts, latest news, and insider tips tailored to your preferences. Discover the exciting and rewarding career opportunities that await at Advanced Micro Devices, Inc.

Interview and Resume Tips

Prepare for your future with AMD by accessing resources that help you craft your resume and excel in interviews. Our goal is to help you showcase your best professional self and align your skills with the needs of our dynamic team. At Advanced Micro Devices, Inc., we empower our employees to innovate, lead, and grow. Join us in driving the future of technology while building a rewarding and sustainable career.
Learn more about Advanced Micro Devices, Inc
Size
15,500 employees
Market Cap
$100.9 billion
Industry
Net Income
$2.4 billion
Founded
1969
5 Year Trend
+30.9%
Revenue
$9.7 billion
NASDAQ

Similar Jobs

More Jobs at Advanced Micro Devices, Inc

More Enterprise Technology Jobs

Find similar Principal Software Engineer - PyTorch Training Frameworks jobs: