NVIDIA Corporation

Senior Product Architect, K8s-Based AI Infrastructure

NVIDIA Corporation$184K — $356K *
Information Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • 8+ years in architecting datacenter-scale HPC or AI infrastructure as Principal Architect or equivalent role.
  • Bachelor's degree in Computer Science or related field (or equivalent experience).
  • Strong expertise in large scale infrastructure management including systems, networks, and storage.
  • Extensive hands-on experience with DevOps tools such as Python, Ansible, Kubernetes, and data center deployments.
  • Familiar with AI workloads including agentic & RAG workflows and large-scale model training.
  • Excellent communication skills to convey complex technical concepts to varied audiences.
  • Passionate about technology trends in AI and infrastructure.

Responsibilities

  • Stay updated on AI Infrastructure trends and propose innovative product ideas.
  • Define comprehensive product architectures addressing performance and scalability.
  • Lead prototyping and validation of product designs, focusing on efficiency improvements.
  • Refine product designs through iterative feedback and performance testing.
  • Collaborate with cross-functional teams for seamless integration across ecosystems.
  • Work with customers and partners to create POCs and MVPs showcasing product vision.
  • Document product designs with technical specifications and user guides.
  • Create targeted content such as whitepapers and educational material for a diverse audience.

Benefits

  • Equity opportunities as part of the compensation package.
  • Access to professional development resources.
  • Work in a collaborative environment with cutting-edge technology.
  • Engage in a culture that encourages innovation and continuous learning.
  • Flexibility in work arrangements to support work-life balance.
Full Job Description
What you'll be doing:
  • Stay at the forefront of technology trends in AI Infrastructure & Agentic AI, proposing new product concepts
  • Define detailed product architectures, including performance, scalability, interoperability, and datacenter deployment requirements
  • Lead prototyping and testing processes to validate product design and functionality, with a focus on scale, diagnosing bottlenecks and driving innovations in performance
  • Iterate and refine designs based on feedback, testing results, and evolving requirements
  • Collaborate with internal hardware, software, security and systems teams to ensure flawless integration of networking, compute and storage ecosystems
  • Work closely with partners and customers to conceptualize ideal solutions, build proof-of-concepts (POCs) and minimum viable products (MVPs) that demonstrate your vision
  • Provide comprehensive documentation for product designs, including technical specifications and user guides
  • Develop targeted content such as whitepapers, blogs, and curriculum for customers, partners, and users


What we need to see:
  • 8+ years of experience architecting datacenter-scale HPC or AI infrastructure as a Principal Architect, Solutions Architect, Principal Engineer, or equivalent
  • Bachelors degree in computer science or related field (or equivalent experience).
  • Strong background in technologies that enable large scale infrastructure management of complex systems, networks, and storage
  • Extensive experience with DevOps solutions, including Python, Ansible, Container Runtimes, Kubernetes, and data center deployments
  • Familiarity with AI workloads, including agentic & RAG-based workflows, inference at scale, large scale training & fine-tuning, and model evaluation
  • Exceptional communication skills, with the ability to translate complex technical details for diverse audiences
  • A passion for staying updated with the latest technological advancements in AI and related fields


Ways to stand out from the crowd:
  • Prior first-hand experience on having built large scale AI infrastructure
  • Advanced certifications or publications in AI, deep learning, or related fields
  • Experience leading high-impact projects or initiatives in cutting-edge tech domains


Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until August 24, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

About NVIDIA Corporation

Nvidia, a global leader in graphics, gaming, and AI technology, offers Nvidia careers and internship opportunities for those passionate about driving innovation in the tech industry. you'll find a company committed to growth, teamwork, and leadership in computer science and machine learning domains.

About Nvidia

A Pioneer in Technology and Innovation

Nvidia has cemented its reputation as a powerhouse in developing advanced graphics processing units (GPUs) and has significantly contributed to the gaming industry's evolution. Moreover, its foray into AI and machine learning has opened new frontiers in technology, making Nvidia a beacon of innovation and a desirable workplace for ambitious tech professionals.

Job Opportunities

Diverse Positions in a Dynamic Field

Nvidia is continuously on the lookout for talented individuals across various domains, including hardware and software engineering, product design, marketing, and sales. Employment opportunities at Nvidia are vast, catering to a wide range of expertise and career aspirations.

Employment in Hardware and Graphics

For those fascinated by the intricacies of hardware and graphics technology, Nvidia offers positions that sit at the forefront of gaming and computing advancements.

Growth in Machine Learning and AI

Nvidia's leadership in AI and machine learning has created numerous vacancies for specialists eager to contribute to groundbreaking projects.

Recruitment in Computer Science

With the constant demand for innovation, Nvidia's recruitment efforts focus on computer science experts capable of pushing the boundaries of what's possible.

Internship Program

Opening Doors to Future Innovators

Nvidia's internship program is designed to nurture the next generation of technology leaders, offering hands-on experience in a culture that celebrates creativity and teamwork.

Benefits and Culture

Interns at Nvidia enjoy a plethora of benefits, from competitive stipends to mentorship opportunities, all within an environment that values growth and learning.

Opportunities for Students

Whether you're an undergraduate, a master's student, or a Ph.D. candidate, Nvidia's internships provide a real-world glimpse into the tech industry, offering valuable experience in various technology fields.

Pathways to Full-Time Employment

Many interns have transitioned into full-time positions, marking the start of successful careers at Nvidia. The internship program is more than a stepping stone into the company; it’s an investment in the professional development of interns. The goal is to ensure that interns are well-equipped for future challenges.

Nvidia Careers: More Than Just a Job

Nvidia offers more than just a job to its employees; it provides a front-row seat on the journey into the future of technology. Nvidia stands as a pillar of innovation with its vast opportunities in hardware, graphics, gaming, machine learning, and computer science. Nvidia careers serve as a launching pad for talented workers who aim to redefine the technological landscape. Whether through full-time positions or internships, joining Nvidia means contributing to a legacy of breakthroughs and becoming part of a global community dedicated to pushing the boundaries of what's possible.
Learn more about NVIDIA Corporation
Size
22,473 employees
Market Cap
$350.4 billion
Industry
Net Income
$4.3 billion
Founded
1993
5 Year Trend
+31.3%
Revenue
$16.6 billion
NASDAQ

Similar Jobs

More Jobs at NVIDIA Corporation

More Information Technology Jobs

Find similar Senior Product Architect, K8s-Based AI Infrastructure jobs: