ARM

Principal AI Performance Engineer

ARM • $262K — $355K *
Consumer Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Experience optimizing DNNs in Triton, CUDA, or another kernel-level programming language.
  • Deep understanding of parallel computing and memory hierarchies.
  • Strong programming skills in Python and C++, with experience in modern AI frameworks.
  • Proficient in profiling and analysis tools for performance optimization.
  • Strong communication and interpersonal skills.

Responsibilities

  • Develop highly optimized solutions for AI workloads from kernel level to system level.
  • Create production-quality reference implementations and technical documentation.
  • Act as a technical liaison between customers and internal teams to resolve performance issues.
  • Influence Arm's IP and software roadmap based on customer use cases and insights.

Benefits

  • Career-defining opportunity in critical initiatives at Arm.
  • Central role in building how Arm innovates and partners globally.
  • Access to a competitive and equitable reward package.
Full Job Description
Job Summary:

Are you passionate about optimizing AI workloads and delivering real-world performance improvements on edge devices?

We're looking for an experienced engineer to help customers achieve best-in-class inference performance for production AI models running on Arm technology.

This role is based in San Jose, with significant time spent working directly with customers across the Bay Area.

Job Description:

In this role, you will work closely with customers to optimize AI workloads targeting Arm technology, focusing on achieving best-in-class performance and power efficiency.

Using your experience with Arm's AI optimization tools and your understanding of hardware architectures, you will develop kernel level implementations across a range of DNN models, optimizing for power and performance.

In collaboration with multiple teams across Arm's engineering organization, you will diagnose and resolve performance challenges, and use these insights to influence Arms IP and tooling roadmaps.

This role requires strong coding and communication skills; you'll translate complex technical challenges into clear insights, presenting progress and recommendations to audiences ranging from engineers to senior leadership.

Responsibilities:

  • Develop highly optimized solutions for AI workloads, from kernel level to system level, to meet the needs of the customer application.
  • Create production quality reference implementations, documentation, and performance focused technical content
  • Act as a technical bridge between customers and internal teams, driving resolution of complex performance issues
  • Influence Arm's IP and software roadmap through insights gained from real-world customer use cases


Required Skills and Experience :

  • Experience optimizing DNNs in Triton, CUDA or other kernel level programming language
  • Deep understanding of parallel computing, memory hierarchies and performance optimization techniques for DNNs
  • Strong programming skills in Python and C++, a solid experience with modern AI frameworks and execution models, experience with profiling and analysis tools
  • Strong communication and interpersonal skills


"Nice To Have":

  • Experience in a customer facing or field engineering environment
  • Experience within the Arm ecosystem
  • Background in AI performance optimization for edge devices


In Return:

Joining Arm means stepping into a career-defining opportunity. You'll occupy a central role in the company's most critical initiatives. These initiatives build how Arm innovates, scales, and partners globally.

Additional Information

Please note this role does not meet the eligibility requirements for sponsorship, and therefore the successful candidate must have the right to work in the US without relying on sponsorship by Arm.

Salary Range:

$262,700-$355,400 per year
We value people as individuals and our dedication is to reward people competitively and equitably for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment and selection process.

About ARM

ARM Holdings is a British multinational semiconductor and software design company, owned by SoftBank Group and its Vision Fund. With its headquarters in Cambridge, England, the company designs microprocessors, physical intellectual property (IP) and related technology and software, and sells development tools to deliver complete solutions for the digital world. ARM's technology is used in a wide range of applications, including automotive, consumer electronics, and Internet of Things (IoT) devices. The company was founded in 1990 and has grown to become one of the world's leading semiconductor IP companies.
Learn more about ARM
Size
6,000 employees
Industry

Similar Jobs

More Jobs at ARM

More Consumer Technology Jobs

Find similar Principal AI Performance Engineer jobs: