DescriptionAbout the role: As a Software Engineer on Ampere's AI Accelerator team, you will develop high-performance kernels to optimize throughput, latency, and hardware resource utilization for state-of-the-art deep learning models used in real-world AI applications, with potential implications across industries such as robotics and automotive. You will identify kernel-development opportunities across a broad range of models and optimize memory bandwidth utilization, data movement, and parallel execution to deliver efficient workloads on accelerator hardware.
What You'll Achieve: - Deliver high-performance kernels that improve the throughput and latency of production deep learning workloads.
- Turn model profiling results into targeted kernel and data-movement optimizations for accelerator hardware.
- Improve utilization of compute resources, memory bandwidth, and on-chip resources across different deep learning models.
- Help shape the kernel-development workflow, performance methodology, and software stack for the accelerator platform.
- Identify and prioritize the operations that dominate end-to-end model latency and throughput.
- Design specialized kernels for compute-intensive and memory-bandwidth-intensive operations.
- Develop reusable kernel components and optimization techniques for multiple models.
- Enable efficient execution of state-of-the-art models on the accelerator platform.
- Collaborate with compiler, runtime, kernel, architecture, hardware, and application teams to drive hardware-software co-design.
- Contribute to architecture definition, design reviews, code reviews, documentation, and engineering best practices.
About You: - Bachelor's degree in Computer Science, Computer Engineering, or a related technical field and 12 years of relevant experience; or a Master's degree and 8 years of relevant experience; or a PhD and 5 years of relevant experience.
- Demonstrated proficiency in Python and C/C++ for performance-sensitive software development.
- Experience developing or optimizing kernels for GPUs, AI accelerators, DSPs, or other parallel computing hardware.
- Ability to use profiling and benchmarking tools to identify performance bottlenecks and measure optimization impact.
- Understanding of the performance characteristics of deep learning operations, including matrix multiplication, convolution, attention, normalization, reduction, and data movement.
- Experience validating kernel correctness and numerical accuracy across different data types and problem sizes.
- Strong analytical and debugging skills, with the ability to investigate ambiguous technical problems and deliver robust solutions.
- Ability to quickly learn new architectures, frameworks, compilers, and workloads.
Preferred Qualifications: - Experience with accelerator programming platforms or frameworks such as CUDA, ROCm, OpenCL, SYCL, or Triton, and familiarity with GPU, NPU, or other accelerator architectures.
- Familiarity with compiler technologies, graph compilers, code generation, or runtime systems.
- Experience developing complex, multi-stage kernels, such as FlashAttention, paged attention, block-sparse attention, MoE routing and dispatch, Mamba selective scan kernels, and fused Transformer decoding kernels.
- Experience developing or optimizing DSP workloads, such as audio and speech processing, image and video processing, wireless communications, radar, or sensor fusion.
What We'll Offer: At Ampere we believe in taking care of our employees and providing a competitive total rewards package that includes base pay, cash long-term incentive, and comprehensive benefits. The full base pay range for this role is between $237,000 and $338,500 , except in the San Francisco Bay Area where the range is between $237,000 and $356,000.
Our benefits include health, wellness, and financial programs that support employees through every stage of life.
Benefit highlights include:
- Premium medical insurance, dental insurance, vision insurance, as well as income protection and a 401K retirement plan, so that you can feel secure in your health and financial future.
- Unlimited Flextime and 10+ paid holidays so that you can embrace a healthy work-life balance.
- A variety of healthy snacks, energizing espresso, and refreshing drinks to keep you fueled and focused throughout the day.
And there is much more than compensation and benefits. At Ampere, we foster an inclusive culture that empowers our employees to do more and grow more. We are excited to share more about our career opportunities with you through the interview process. Our benefits include health, wellness, and financial programs that support employees through every stage of life.
#LI-Hybrid
We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.