NVIDIA Corporation

Senior Solutions Architect, Generative AI

NVIDIA Corporation$184K — $356K *
Enterprise Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • BS, MS, or PhD in Computer Science, Engineering, Physics, Mathematics, or equivalent experience.
  • 6+ years in AI infrastructure, systems engineering, or related technical role.
  • Deep understanding of Linux systems and GPU architectures.
  • Hands-on with high-performance GPU networks in on-premises or cloud environments.
  • Experience debugging NCCL communication and performance issues.
  • Expertise profiling AI workloads and identifying performance bottlenecks.
  • Proficient in Python or shell scripting for automation and troubleshooting.

Responsibilities

  • Collaborate with customers to optimize GPU utilization and infrastructure cost.
  • Design and optimize large-scale AI clusters across various technologies.
  • Profile distributed workloads to identify performance bottlenecks.
  • Diagnose infrastructure issues across diverse network fabrics and systems.
  • Lead proof-of-concepts and performance studies for AI infrastructure.
  • Partner with cross-functional teams to secure design wins and innovative solutions.

Benefits

  • Remote work flexibility with occasional travel required (20%).
  • Eligibility for equity options.
  • Comprehensive benefits package offered.
Full Job Description
What You'll Be Doing:
  • Collaborating closely with customers to maximize GPU utilization and end-to-end workload throughput while improving infrastructure reliability and reducing infrastructure costs.
  • Designing and optimizing large-scale AI clusters across GPU compute, high-performance networking, storage, workload scheduling, orchestration, and observability.
  • Profiling distributed training and inference workloads to identify bottlenecks across GPUs, CPUs, memory, network fabrics, storage systems, and software stack.
  • Diagnosing complex infrastructure and distributed systems issues spanning InfiniBand and RoCE fabrics, cloud interconnects, RDMA, NCCL, NVLink, and NVSwitch.
  • Leading proof-of-concepts and performance studies for large-scale AI infrastructure, developing benchmarking tools, automation, runbooks, and technical collateral as needed.
  • Partnering with NVIDIA's engineering, product, and sales teams to secure design wins and drive innovative solutions based on customer requirements and field feedback.


What We Need To See:
  • BS, MS, or PhD in Computer Science, Electrical/Computer Engineering, Physics, Mathematics, or another Engineering field, or equivalent experience.
  • 6+ years of experience in AI infrastructure, systems engineering, high-performance computing, networking, site reliability engineering, or a related technical role.
  • Deep understanding of Linux systems, distributed computing, GPU architectures, and the hardware and software components of large-scale AI clusters.
  • Hands-on experience designing, deploying, operating, or troubleshooting high-performance GPU networks in on-premises or cloud environments using technologies such as InfiniBand, RoCE, or GPUDirect RDMA.
  • Experience debugging NCCL communication and distributed collective performance, including topology, transport, congestion, routing, and host-level configuration issues.
  • Experience profiling AI workloads and identifying performance bottlenecks across compute, networking, storage, and orchestration layers.
  • Experience with cluster schedulers and orchestration platforms such as Kubernetes and Slurm, along with containers and production monitoring systems.
  • Proficiency with Python, shell scripting, or similar languages for infrastructure automation, benchmarking, and systems troubleshooting.


Ways To Stand Out From The Crowd:
  • Experience architecting and operating large-scale production GPU clusters for distributed training or inference.
  • Deep expertise with NVIDIA infrastructure technologies such as DGX/HGX systems, NVLink, NVSwitch, NCCL, InfiniBand, and Spectrum-X.
  • Hands-on experience using tools and telemetry such as NCCL tests, DCGM, Nsight Systems, fabric counters, and host- or switch-level diagnostics to isolate performance and reliability issues.
  • Understanding of network topology, congestion control, collective communication patterns, and their impact on distributed AI workload performance.
  • Experience optimizing storage and data pipelines to sustain high-throughput training and inference workloads.


We make extensive use of conferencing tools, but occasional travel (20%) is required for local on-site visits to customers and conferences. We are open to remote work. We look forward to having you join our team!

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until August 3, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

About NVIDIA Corporation

Nvidia, a global leader in graphics, gaming, and AI technology, offers Nvidia careers and internship opportunities for those passionate about driving innovation in the tech industry. you'll find a company committed to growth, teamwork, and leadership in computer science and machine learning domains.

About Nvidia

A Pioneer in Technology and Innovation

Nvidia has cemented its reputation as a powerhouse in developing advanced graphics processing units (GPUs) and has significantly contributed to the gaming industry's evolution. Moreover, its foray into AI and machine learning has opened new frontiers in technology, making Nvidia a beacon of innovation and a desirable workplace for ambitious tech professionals.

Job Opportunities

Diverse Positions in a Dynamic Field

Nvidia is continuously on the lookout for talented individuals across various domains, including hardware and software engineering, product design, marketing, and sales. Employment opportunities at Nvidia are vast, catering to a wide range of expertise and career aspirations.

Employment in Hardware and Graphics

For those fascinated by the intricacies of hardware and graphics technology, Nvidia offers positions that sit at the forefront of gaming and computing advancements.

Growth in Machine Learning and AI

Nvidia's leadership in AI and machine learning has created numerous vacancies for specialists eager to contribute to groundbreaking projects.

Recruitment in Computer Science

With the constant demand for innovation, Nvidia's recruitment efforts focus on computer science experts capable of pushing the boundaries of what's possible.

Internship Program

Opening Doors to Future Innovators

Nvidia's internship program is designed to nurture the next generation of technology leaders, offering hands-on experience in a culture that celebrates creativity and teamwork.

Benefits and Culture

Interns at Nvidia enjoy a plethora of benefits, from competitive stipends to mentorship opportunities, all within an environment that values growth and learning.

Opportunities for Students

Whether you're an undergraduate, a master's student, or a Ph.D. candidate, Nvidia's internships provide a real-world glimpse into the tech industry, offering valuable experience in various technology fields.

Pathways to Full-Time Employment

Many interns have transitioned into full-time positions, marking the start of successful careers at Nvidia. The internship program is more than a stepping stone into the company; it’s an investment in the professional development of interns. The goal is to ensure that interns are well-equipped for future challenges.

Nvidia Careers: More Than Just a Job

Nvidia offers more than just a job to its employees; it provides a front-row seat on the journey into the future of technology. Nvidia stands as a pillar of innovation with its vast opportunities in hardware, graphics, gaming, machine learning, and computer science. Nvidia careers serve as a launching pad for talented workers who aim to redefine the technological landscape. Whether through full-time positions or internships, joining Nvidia means contributing to a legacy of breakthroughs and becoming part of a global community dedicated to pushing the boundaries of what's possible.
Learn more about NVIDIA Corporation
Size
22,473 employees
Market Cap
$350.4 billion
Industry
Net Income
$4.3 billion
Founded
1993
5 Year Trend
+31.3%
Revenue
$16.6 billion
NASDAQ

Similar Jobs

More Jobs at NVIDIA Corporation

More Enterprise Technology Jobs

Find similar Senior Solutions Architect, Generative AI jobs: