NVIDIA Corporation

Engineering Manager, Local AI Agents

NVIDIA Corporation$224K — $431K *
Enterprise Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree in Computer Science, Computer Engineering, or equivalent experience.
  • 10+ years of software engineering experience, with 3+ years in a management role.
  • Proven track record in hiring and mentoring engineers while managing team dynamics.
  • Experience delivering complex software platforms from design to production.
  • Technical expertise in AI agents, model inference, and systems software.
  • Skilled in C++ or Python programming languages.
  • Ability to collaborate with cross-functional teams for clear decision-making.

Responsibilities

  • Lead architecture and implementation of AI agent runtimes on Windows and NVIDIA systems.
  • Guide prototyping, design reviews, and debugging for reliable software development.
  • Build core agent capabilities such as multi-agent coordination and policy-aware routing.
  • Manage CI/CD and regression systems related to software and hardware compatibility.
  • Collaborate with teams across various domains to establish robust production interfaces.
  • Recruit, develop, and guide engineers while fostering an inclusive team culture.

Benefits

  • Equity opportunities as part of compensation.
  • Comprehensive benefits package available.
  • Potential for career growth and professional development.
  • Work with leading technologies in AI and software development.
Full Job Description
We are looking for an Engineering Manager to build and lead the team developing local and hybrid AI agent technology. You will set technical direction, grow engineers, and deliver production software spanning agent runtimes, local inference, Windows integration, developer tools, and security controls. You will turn lessons from Hermes, OpenClaw, Perplexity, and domain-specific agents into platform capabilities that work across NVIDIA systems.

What you'll be doing:
  • Lead the architecture and implementation of local AI agent runtimes on Windows and NVIDIA RTX systems, with clear interfaces across models, tools, GPU software, operating-system services, and applications.
  • Guide hands-on development through prototypes, design and code reviews, performance analysis, and debugging; help the team turn research ideas into reliable C++ and Python software.
  • Build core agent capabilities including MCP and tool routing, persistent memory, skills, scheduling, multi-agent coordination, computer use, and policy-aware local or hybrid model routing.
  • Own CI/CD, evaluation, compatibility, and regression systems across Windows releases, drivers, GPUs, models, and agent frameworks; add telemetry and diagnostics that make failures reproducible.
  • Partner with AI research, GPU and driver, Windows platform, product security, Microsoft, OEM, ISV, and open-source teams to land durable interfaces and production integrations.
  • Hire and develop engineers, set a high technical bar, allocate capacity, and create an environment where the team can make sound decisions and deliver maintainable software.


What we need to see:
  • Bachelor's degree in Computer Science, Computer Engineering, or a related field, or equivalent experience in practice.
  • 10+ years of software engineering experience, including 3+ years managing engineers or leading a comparable technical organization.
  • Experience hiring and developing engineers, setting goals, providing useful feedback, and building an inclusive team environment.
  • A record of delivering complex software platforms or systems from architecture through production operation.
  • Technical fluency in AI agents, model inference, systems software, and local or hybrid deployment, with the judgment to guide architecture and execution.
  • Ability to align engineering, research, product, security, and external partners around clear decisions and measurable outcomes.
  • Proficiency with C++ or Python.


Ways to stand out from the crowd:
  • Hands-on experience with Windows internals, process isolation, virtualization, containers, or sandboxing.
  • Familiarity with OpenClaw, Hermes, LangChain or similar agent frameworks; MCP; memory, skills, multi-agent, or computer-use patterns.
  • Experience with TensorRT-LLM, Ollama, llama.cpp, vLLM, PyTorch, ONNX Runtime, Windows ML, model optimization, or quantization.
  • Experience with CUDA, GPU performance, local models on consumer hardware, or privacy-aware inference routing.
  • Experience contributing to open-source projects or working with Microsoft, OEMs, ISVs, and developer communities.


Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 224,000 USD - 356,500 USD for Level 3, and 272,000 USD - 431,250 USD for Level 4.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until August 28, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

About NVIDIA Corporation

Nvidia, a global leader in graphics, gaming, and AI technology, offers Nvidia careers and internship opportunities for those passionate about driving innovation in the tech industry. you'll find a company committed to growth, teamwork, and leadership in computer science and machine learning domains.

About Nvidia

A Pioneer in Technology and Innovation

Nvidia has cemented its reputation as a powerhouse in developing advanced graphics processing units (GPUs) and has significantly contributed to the gaming industry's evolution. Moreover, its foray into AI and machine learning has opened new frontiers in technology, making Nvidia a beacon of innovation and a desirable workplace for ambitious tech professionals.

Job Opportunities

Diverse Positions in a Dynamic Field

Nvidia is continuously on the lookout for talented individuals across various domains, including hardware and software engineering, product design, marketing, and sales. Employment opportunities at Nvidia are vast, catering to a wide range of expertise and career aspirations.

Employment in Hardware and Graphics

For those fascinated by the intricacies of hardware and graphics technology, Nvidia offers positions that sit at the forefront of gaming and computing advancements.

Growth in Machine Learning and AI

Nvidia's leadership in AI and machine learning has created numerous vacancies for specialists eager to contribute to groundbreaking projects.

Recruitment in Computer Science

With the constant demand for innovation, Nvidia's recruitment efforts focus on computer science experts capable of pushing the boundaries of what's possible.

Internship Program

Opening Doors to Future Innovators

Nvidia's internship program is designed to nurture the next generation of technology leaders, offering hands-on experience in a culture that celebrates creativity and teamwork.

Benefits and Culture

Interns at Nvidia enjoy a plethora of benefits, from competitive stipends to mentorship opportunities, all within an environment that values growth and learning.

Opportunities for Students

Whether you're an undergraduate, a master's student, or a Ph.D. candidate, Nvidia's internships provide a real-world glimpse into the tech industry, offering valuable experience in various technology fields.

Pathways to Full-Time Employment

Many interns have transitioned into full-time positions, marking the start of successful careers at Nvidia. The internship program is more than a stepping stone into the company; it’s an investment in the professional development of interns. The goal is to ensure that interns are well-equipped for future challenges.

Nvidia Careers: More Than Just a Job

Nvidia offers more than just a job to its employees; it provides a front-row seat on the journey into the future of technology. Nvidia stands as a pillar of innovation with its vast opportunities in hardware, graphics, gaming, machine learning, and computer science. Nvidia careers serve as a launching pad for talented workers who aim to redefine the technological landscape. Whether through full-time positions or internships, joining Nvidia means contributing to a legacy of breakthroughs and becoming part of a global community dedicated to pushing the boundaries of what's possible.
Learn more about NVIDIA Corporation
Size
22,473 employees
Market Cap
$350.4 billion
Industry
Net Income
$4.3 billion
Founded
1993
5 Year Trend
+31.3%
Revenue
$16.6 billion
NASDAQ

Similar Jobs

More Jobs at NVIDIA Corporation

More Enterprise Technology Jobs

Find similar Engineering Manager, Local AI Agents jobs: