NVIDIA Corporation

DL System Software Engineer - AI Platform

NVIDIA Corporation$116K — $201K *
Enterprise Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree or equivalent experience in Computer Science or a relevant technical field.
  • 5+ years of experience in systems engineering.
  • Experience building large scale systems from scratch; container-based deployment experience, particularly with Kubernetes, is beneficial.
  • Strong coding skills in Python, Go, Rust, and/or C/C++.
  • Solid understanding of algorithms, data structures, operating systems, and computer architecture; familiarity with AI technologies is a plus.
  • Ability to quickly learn and adapt in evolving situations.

Responsibilities

  • Develop NVIDIA's AI platform for training and serving AI models with optimal performance and efficiency.
  • Design and implement solutions for scheduling AI workloads on GPU clusters across cloud infrastructures.
  • Explore solutions for challenges in resource management, GPU scheduling, performance prediction, and workload migration.
  • Collaborate with teams working on TensorRT, Dynamo, ML compilers, and other related NVIDIA technologies.

Benefits

  • Eligible for equity participation.
  • Comprehensive benefits package.
Full Job Description
We are seeking highly motivated and skilled systems engineers to join our team to help in developing an AI Platform that offers an efficient infrastructure for inference and training large scale models. As a systems engineer, you will play a crucial role in building a unified solution that brings our innovative NVIDIA technologies such as high-performance, inference/training frameworks, ML compilers, performance predictor, and cluster scheduler into a single, cohesive platform.

What you will be doing:
  • Taking part in the development of the NVIDIA's AI platform for training, fine-tuning and serving latest and greatest AI models with the best performance and efficiency.
  • Designing and building solutions for scheduling large scale AI training and inference workloads on GPU clusters over many cloud infrastructure.
  • Exploring and finding solution for open problems like industry-scale resource management, GPU scheduling, performance prediction, and live workload migration.
  • Work with and contribute to adjacent teams like TensorRT/Dynamo inference engine, ML compiler, KAI/Grove scheduler, Lepton cloud etc.


What we need to see:
  • Bachelor's degree or equivalent experience in Computer Science, Computer Engineering, relevant technical field.
  • 5+ years of experience.
  • Experience building large scale systems from scratch. Prior experience in container-based deployment systems like Kubernetes is beneficial.
  • Strong coding skills in programming languages like Python, Go, Rust and/or C/C++.
  • Solid foundation in other computer science and computer engineering topics: algorithms and data structures, operating systems, computer architecture, etc. Strong understanding of AI and related technologies is a huge plus.
  • Most importantly, ability to quickly grasp new concepts and thrive in evolving situations.


Ways to stand out from the crowd:
  • Graduate-level education or relevant practical background, particularly in research, is beneficial.
  • Practical experience in building and optimizing AI applications is highly desired.
  • Proficiency in container software such as containerd, CRI-O, Linux namespace, CRIU, and NVIDIA GPU technology such as CUDA graphs, Driver/runtime is greatly advantageous.


Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 116,250 CAD - 201,500 CAD.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until September 6, 2025.

About NVIDIA Corporation

Nvidia, a global leader in graphics, gaming, and AI technology, offers Nvidia careers and internship opportunities for those passionate about driving innovation in the tech industry. you'll find a company committed to growth, teamwork, and leadership in computer science and machine learning domains.

About Nvidia

A Pioneer in Technology and Innovation

Nvidia has cemented its reputation as a powerhouse in developing advanced graphics processing units (GPUs) and has significantly contributed to the gaming industry's evolution. Moreover, its foray into AI and machine learning has opened new frontiers in technology, making Nvidia a beacon of innovation and a desirable workplace for ambitious tech professionals.

Job Opportunities

Diverse Positions in a Dynamic Field

Nvidia is continuously on the lookout for talented individuals across various domains, including hardware and software engineering, product design, marketing, and sales. Employment opportunities at Nvidia are vast, catering to a wide range of expertise and career aspirations.

Employment in Hardware and Graphics

For those fascinated by the intricacies of hardware and graphics technology, Nvidia offers positions that sit at the forefront of gaming and computing advancements.

Growth in Machine Learning and AI

Nvidia's leadership in AI and machine learning has created numerous vacancies for specialists eager to contribute to groundbreaking projects.

Recruitment in Computer Science

With the constant demand for innovation, Nvidia's recruitment efforts focus on computer science experts capable of pushing the boundaries of what's possible.

Internship Program

Opening Doors to Future Innovators

Nvidia's internship program is designed to nurture the next generation of technology leaders, offering hands-on experience in a culture that celebrates creativity and teamwork.

Benefits and Culture

Interns at Nvidia enjoy a plethora of benefits, from competitive stipends to mentorship opportunities, all within an environment that values growth and learning.

Opportunities for Students

Whether you're an undergraduate, a master's student, or a Ph.D. candidate, Nvidia's internships provide a real-world glimpse into the tech industry, offering valuable experience in various technology fields.

Pathways to Full-Time Employment

Many interns have transitioned into full-time positions, marking the start of successful careers at Nvidia. The internship program is more than a stepping stone into the company; it’s an investment in the professional development of interns. The goal is to ensure that interns are well-equipped for future challenges.

Nvidia Careers: More Than Just a Job

Nvidia offers more than just a job to its employees; it provides a front-row seat on the journey into the future of technology. Nvidia stands as a pillar of innovation with its vast opportunities in hardware, graphics, gaming, machine learning, and computer science. Nvidia careers serve as a launching pad for talented workers who aim to redefine the technological landscape. Whether through full-time positions or internships, joining Nvidia means contributing to a legacy of breakthroughs and becoming part of a global community dedicated to pushing the boundaries of what's possible.
Learn more about NVIDIA Corporation
Size
22,473 employees
Market Cap
$350.4 billion
Industry
Net Income
$4.3 billion
Founded
1993
5 Year Trend
+31.3%
Revenue
$16.6 billion
NASDAQ

Similar Jobs

More Jobs at NVIDIA Corporation

More Enterprise Technology Jobs

Find similar DL System Software Engineer - AI Platform jobs: