Ampere Computing

Software Principal Engineer- AI Compiler

Ampere Computing$195K — $292K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree in Computer Science, Mathematics, or a related field & 8 years of experience; or Master's degree & 6 years
  • Strong understanding of algorithms, data structures, and systems
  • Expertise in graph algorithms and optimization techniques
  • Proficient in Python and C/C++
  • Exceptional problem-solving skills, especially in competitive programming
  • Preferred background in CPU or GPU compiler development
  • Familiarity with LLVM and MLIR dialects is a plus
  • Quick learner with knowledge of deep learning concepts is advantageous

Responsibilities

  • Optimize deep learning computational graphs for better performance
  • Enable various models and frameworks for efficient serving
  • Identify and implement optimizations like op fusion and redundancy elimination
  • Collaborate on hardware/software co-design for maximum efficiency
  • Integrate AI solutions within Ampere's hardware platforms

Benefits

  • Premium medical, dental, and vision insurance
  • Income protection and a 401K retirement plan
  • Unlimited flextime and 10+ paid holidays for work-life balance
  • Healthy snacks, espresso, and drinks provided
Full Job Description
Description

About the Role:

In this role, you will optimize computational graphs to unlock the full potential of Ampere's deep learning accelerator. You'll work across the full SW/HW stack - from inference serving and framework integration down to compiler, runtime, and compute kernels.

What You'll Achieve:
  • Optimize deep learning computational graphs for performance, throughput, and latency on Ampere's accelerator hardware
  • Enable popular models and frameworks (PyTorch, Llama.cpp) and serving platforms (vLLM, SGLang)
  • Identify and implement graph-level optimizations: op fusion, pattern recognition, redundancy elimination
  • Collaborate on HW/SW co-design to push computational efficiency
  • Work with cross-functional teams to integrate AI solutions into Ampere's AI hardware platforms

About You:
  • Bachelors degree in Computer Science, Mathematics or a related technical field & 8 years of related experience; or Master's degree & 6 years
  • Strong CS fundamentals: algorithms, data structures, systems
  • Solid graph algorithm knowledge and reasoning ability
  • Proficiency in Python and C/C++
  • Demonstrated exceptional problem-solving ability - IOI medal, ACM ICPC medal, Codeforces Grandmaster, USACO Platinum, or equivalent competitive programming achievement is a big plus
  • Preferred to have traditional CPU or GPU compiler development background
  • Familiar with LLVM compiler framework as well as MLIR dialects is a plus
  • Fast learner who can pick up new domains quickly and maximize agent-assisted development
  • Familiarity with deep learning concepts and neural network architectures is a plus

What We'll Offer:

At Ampere we believe in taking care of our employees and providing a competitive total rewards package that includes base pay, cash long-term incentive, and comprehensive benefits. The full base pay range for this role is between $195,000 and $292,000. Our benefits include health, wellness, and financial programs that support employees through every stage of life.

Benefit highlights include:
  • Premium medical insurance, dental insurance, vision insurance, as well as income protection and a 401K retirement plan, so that you can feel secure in your health and financial future.
  • Unlimited Flextime and 10+ paid holidays so that you can embrace a healthy work-life balance.
  • A variety of healthy snacks, energizing espresso, and refreshing drinks to keep you fueled and focused throughout the day.

And there is much more than compensation and benefits. At Ampere, we foster an inclusive culture that empowers our employees to do more and grow more. We are excited to share more about our career opportunities with you through the interview process. Our benefits include health, wellness, and financial programs that support employees through every stage of life.

#LI-Hybrid

About Ampere Computing

Ampere Computing is a semiconductor company that designs and manufactures high-performance processors for cloud and edge computing. The company's processors are based on the Arm architecture and are optimized for power efficiency and performance. Ampere Computing was founded in 2017 by former Intel president Renee James and is headquartered in Santa Clara, California.
Learn more about Ampere Computing
Size
200 employees
Industry
Founded
2017

Similar Jobs

More Jobs at Ampere Computing

More Information Technology Jobs

Find similar Software Principal Engineer- AI Compiler jobs: