NVIDIA Corporation

Senior ML Compiler Engineer

NVIDIA Corporation$184K — $287K *
Enterprise Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree in Computer Science, Electrical Engineering, or related field; advanced degrees preferred
  • 6+ years experience in machine learning systems, including ML compilers and LLM inference kernels
  • Proficient in deep learning frameworks like PyTorch or JAX
  • Strong programming skills in Python and C/C++

Responsibilities

  • Innovate and develop new machine learning compiler technologies
  • Design, implement, and optimize compilers for AI workloads
  • Build domain-specific language solutions for LLM inference workloads
  • Create AI-driven solutions to automate development workflows
  • Co-design learning system solutions with ML compiler technologies
  • Collaborate with engineering teams to enhance machine learning acceleration

Benefits

  • Eligible for equity
  • Comprehensive benefits package
  • Work in a cutting-edge AI technology environment
  • Opportunity to collaborate with top-tier hardware and software teams at NVIDIA
Full Job Description
We are looking for outstanding ML/DL compiler engineers to join the team and develop groundbreaking technologies in machine learning compilers and AI systems. We build innovative AI compiler solutions that work together with NVIDIA's software stack to provide comprehensive acceleration for modern machine learning models. As a member of the team, you will develop innovative AI compiler technologies for NVIDIA's hardware architecture. You will develop new ML/DL compiler abstractions, build efficient attention runtimes, and ML/DL -compiler driven system solutions to accelerate large language models, agents and other high-impact machine learning workloads. As part of this role, you will be building a close technical relationship with internal NVIDIA software and hardware teams to push the latest developments to NVIDIA's product.

What you'll be doing:
  • Innovate and develop new machine learning compiler and systems technologies
  • Design, implement, and optimize compilers for high impact AI workloads
  • Building strong kernel and domain specific language solutions for state of art kernels in LLM inference workloads
  • Developing AI-driven solutions to automate the overall development flow.
  • Co-design learning system solutions with current and future ML compiler and algorithm technologies.
  • Collaborate closely with other engineering teams at NVIDIA to build high impact solutions for machine learning acceleration


What we need to see:
  • Bachelor's degree in Computer Science, Electrical Engineering, or related field (or equivalent experience); MS or PhD are preferred
  • 6+ years (academic/ industry) experience in machine learning systems development - including ML compilers, LLM inference kernels, kernel generations.
  • Strong experience in developing or using deep learning frameworks (e.g. PyTorch, JAX etc)
  • Strong python and C/C++ programming skills


Ways to stand out from the crowd:
  • Expertise in AI frameworks such as PyTorch, TensorFlow, and ONNX
  • Expertise in machine learning compilers (e.g. Apache TVM, MLIR)
  • Expertise in domain specific compiler and library solutions for LLM inference and training (e.g. FlashInfer, Flash Attention)
  • Strong experience in GPU performance optimizations as well as experience machine learning systems research and productization
  • Open source project ownership or contributions


Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until June 29, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

About NVIDIA Corporation

Nvidia, a global leader in graphics, gaming, and AI technology, offers Nvidia careers and internship opportunities for those passionate about driving innovation in the tech industry. you'll find a company committed to growth, teamwork, and leadership in computer science and machine learning domains.

About Nvidia

A Pioneer in Technology and Innovation

Nvidia has cemented its reputation as a powerhouse in developing advanced graphics processing units (GPUs) and has significantly contributed to the gaming industry's evolution. Moreover, its foray into AI and machine learning has opened new frontiers in technology, making Nvidia a beacon of innovation and a desirable workplace for ambitious tech professionals.

Job Opportunities

Diverse Positions in a Dynamic Field

Nvidia is continuously on the lookout for talented individuals across various domains, including hardware and software engineering, product design, marketing, and sales. Employment opportunities at Nvidia are vast, catering to a wide range of expertise and career aspirations.

Employment in Hardware and Graphics

For those fascinated by the intricacies of hardware and graphics technology, Nvidia offers positions that sit at the forefront of gaming and computing advancements.

Growth in Machine Learning and AI

Nvidia's leadership in AI and machine learning has created numerous vacancies for specialists eager to contribute to groundbreaking projects.

Recruitment in Computer Science

With the constant demand for innovation, Nvidia's recruitment efforts focus on computer science experts capable of pushing the boundaries of what's possible.

Internship Program

Opening Doors to Future Innovators

Nvidia's internship program is designed to nurture the next generation of technology leaders, offering hands-on experience in a culture that celebrates creativity and teamwork.

Benefits and Culture

Interns at Nvidia enjoy a plethora of benefits, from competitive stipends to mentorship opportunities, all within an environment that values growth and learning.

Opportunities for Students

Whether you're an undergraduate, a master's student, or a Ph.D. candidate, Nvidia's internships provide a real-world glimpse into the tech industry, offering valuable experience in various technology fields.

Pathways to Full-Time Employment

Many interns have transitioned into full-time positions, marking the start of successful careers at Nvidia. The internship program is more than a stepping stone into the company; it’s an investment in the professional development of interns. The goal is to ensure that interns are well-equipped for future challenges.

Nvidia Careers: More Than Just a Job

Nvidia offers more than just a job to its employees; it provides a front-row seat on the journey into the future of technology. Nvidia stands as a pillar of innovation with its vast opportunities in hardware, graphics, gaming, machine learning, and computer science. Nvidia careers serve as a launching pad for talented workers who aim to redefine the technological landscape. Whether through full-time positions or internships, joining Nvidia means contributing to a legacy of breakthroughs and becoming part of a global community dedicated to pushing the boundaries of what's possible.
Learn more about NVIDIA Corporation
Size
22,473 employees
Market Cap
$350.4 billion
Industry
Net Income
$4.3 billion
Founded
1993
5 Year Trend
+31.3%
Revenue
$16.6 billion
NASDAQ

Similar Jobs

More Jobs at NVIDIA Corporation

More Enterprise Technology Jobs

Find similar Senior ML Compiler Engineer jobs: