NVIDIA Corporation

Senior Staff Software Engineer - Enterprise AI Platform

NVIDIA Corporation$200K — $322K *
Enterprise Technology
11 - 15 years of experience
Job Overview by Ladders

Qualifications

  • BS or MS in Computer Science, Engineering, or related field (or equivalent experience)
  • 12+ years building distributed systems, infrastructure, or developer platforms at scale
  • Hands-on experience building agents on a harness, exposing them as APIs, and shipping them with CI/CD
  • Experience deploying and operating long-running services on container orchestration platforms
  • Experience with the building blocks of scalable systems: messaging, caching, and durable storage
  • Proficiency in Python, Go, Rust, or similar.

Responsibilities

  • Design agent blueprints with interfaces for authorization, sandbox, memory, observability, and skills.
  • Build a runtime safety harness with a policy engine to check all actions before execution.
  • Enable composing and orchestrating agents with skills as units and multi-agent orchestration.
  • Broker credentials for multi-agent systems with least-privilege scoping.
  • Provide checkpoint and recovery mechanisms for agents after crashes or restarts.
  • Instrument observability and evaluation to improve agents based on real-time data.

Benefits

  • Equity and comprehensive benefits package.
  • Opportunity to work on a cutting-edge platform that impacts multiple engineering teams.
  • Participation in the on-call rotation to ensure platform reliability.
  • Work in a collaborative environment with top-tier talent in AI and engineering.
Full Job Description
We're building the platform that lets long-running autonomous agents operate safely inside NVIDIA's enterprise. These are not assistants on a developer's laptop. They are fleets of agents deployed in the cloud, running continuously at scale on shared accelerated compute. They take on real work across enterprise systems, so people get far more done than they could before. This role defines the constructs that agents are built from: the blueprints they start from, the tools, skills, and plugins that power them against enterprise data, the runtime safety harness that keeps them in bounds, and the connections into credential management, sandbox, memory, and observability. The team designs and ships these building blocks so that agent developers across the company can stand up a new agent, wire it in, and run it for days or weeks. Security and safe execution come out of the box, not something each team has to get right on its own.

Today an agent runs inside a single harness. Claude, Codex, and open-source agent harnesses each work differently underneath, with their own execution model, tool interface, and telemetry shape. The platform smooths over those differences, so a single skill, safety policy, or trace works the same no matter which harness is running. We want to enable agents that act on a person's behalf, governed and secure, continuously evaluated and self-improving. These agents coordinate and hand work off to each other, with identity and policy following every hop. They route and tune themselves across harnesses from live eval signals, and get better from their own production telemetry instead of waiting on a human to retrain them. Have you run agents on a harness like Claude or Codex and hit the walls that show up when they run for real, for days, against live systems - and wanted them to learn from it on their own? We're building the platform that solves those problems once, for every team.

What you'll be doing:

The day-to-day is designing and building the platform that agent builders across NVIDIA depend on, from engineering teams to functions like finance, legal, and HR:
  • Design agent blueprints with clean interfaces for authorization, sandbox, memory, observability, and skills, so a new agent inherits its enterprise integrations from the platform.
  • Build the runtime safety harness: a policy engine that checks every action before it runs, rate and budget caps, circuit breakers, approval gates, action allow-lists, and a kill switch that works even when an agent goes rogue.
  • Enable composing and orchestrating agents: skills as first-class units with declarative manifests, multi-agent orchestration for delegation and handoff, and support for headless, long-running, autonomous agents.
  • Broker credentials so multi-agent systems can authenticate and authorize without ever touching secrets, with least-privilege scoping on every token.
  • Provide checkpoint and recovery so an agent resumes cleanly after a crash or restart.
  • Instrument observability and evaluation that span harnesses: decision-level traces with correlation IDs, what the agent saw and chose and why, cost anomaly alerts that catch looping, and quality scoring across skills, whole agents and products. Then close the loop: turn those signals into insights that make the agents better.

Since teams across NVIDIA depend on this platform in production, the whole team shares in keeping it healthy and reliable, including taking part in an on-call rotation.

What we need to see:
  • BS or MS in Computer Science, Engineering, or related field (or equivalent experience)
  • 12+ years building distributed systems, infrastructure, or developer platforms at scale
  • Hands-on experience building agents on a harness, exposing them as APIs, and shipping them with CI/CD
  • Experience deploying and operating long-running services on container orchestration platforms
  • Experience with the building blocks of scalable systems: messaging, caching, and durable storage
  • Proficiency in Python, Go, Rust, or similar


Ways to stand out from the crowd:
  • Built a safety or policy engine that enforces rules on agent actions at runtime, with approval gates and kill switches
  • Designed evaluation and feedback loops for agent behavior, tied to versioned skills or blueprints. Built self-evolving loops where agents improve from their own eval and production signals, on the latest agent harnesses - the closed-loop, self-improving side you want to attract
  • Applied security fundamentals like threat modeling, authentication and authorization, least privilege, secrets management, and token exchange
  • Designed AI data platform components like ingestion pipelines, vector stores, and retrieval APIs
  • Shipped platform building blocks adopted by multiple engineering teams. Led complex technical projects like migrations or greenfield platform builds, aligning teams and writing clear design docs


Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 200,000 USD - 322,000 USD.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until September 13, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

About NVIDIA Corporation

Nvidia, a global leader in graphics, gaming, and AI technology, offers Nvidia careers and internship opportunities for those passionate about driving innovation in the tech industry. you'll find a company committed to growth, teamwork, and leadership in computer science and machine learning domains.

About Nvidia

A Pioneer in Technology and Innovation

Nvidia has cemented its reputation as a powerhouse in developing advanced graphics processing units (GPUs) and has significantly contributed to the gaming industry's evolution. Moreover, its foray into AI and machine learning has opened new frontiers in technology, making Nvidia a beacon of innovation and a desirable workplace for ambitious tech professionals.

Job Opportunities

Diverse Positions in a Dynamic Field

Nvidia is continuously on the lookout for talented individuals across various domains, including hardware and software engineering, product design, marketing, and sales. Employment opportunities at Nvidia are vast, catering to a wide range of expertise and career aspirations.

Employment in Hardware and Graphics

For those fascinated by the intricacies of hardware and graphics technology, Nvidia offers positions that sit at the forefront of gaming and computing advancements.

Growth in Machine Learning and AI

Nvidia's leadership in AI and machine learning has created numerous vacancies for specialists eager to contribute to groundbreaking projects.

Recruitment in Computer Science

With the constant demand for innovation, Nvidia's recruitment efforts focus on computer science experts capable of pushing the boundaries of what's possible.

Internship Program

Opening Doors to Future Innovators

Nvidia's internship program is designed to nurture the next generation of technology leaders, offering hands-on experience in a culture that celebrates creativity and teamwork.

Benefits and Culture

Interns at Nvidia enjoy a plethora of benefits, from competitive stipends to mentorship opportunities, all within an environment that values growth and learning.

Opportunities for Students

Whether you're an undergraduate, a master's student, or a Ph.D. candidate, Nvidia's internships provide a real-world glimpse into the tech industry, offering valuable experience in various technology fields.

Pathways to Full-Time Employment

Many interns have transitioned into full-time positions, marking the start of successful careers at Nvidia. The internship program is more than a stepping stone into the company; it’s an investment in the professional development of interns. The goal is to ensure that interns are well-equipped for future challenges.

Nvidia Careers: More Than Just a Job

Nvidia offers more than just a job to its employees; it provides a front-row seat on the journey into the future of technology. Nvidia stands as a pillar of innovation with its vast opportunities in hardware, graphics, gaming, machine learning, and computer science. Nvidia careers serve as a launching pad for talented workers who aim to redefine the technological landscape. Whether through full-time positions or internships, joining Nvidia means contributing to a legacy of breakthroughs and becoming part of a global community dedicated to pushing the boundaries of what's possible.
Learn more about NVIDIA Corporation
Size
22,473 employees
Market Cap
$350.4 billion
Industry
Net Income
$4.3 billion
Founded
1993
5 Year Trend
+31.3%
Revenue
$16.6 billion
NASDAQ

Similar Jobs

More Jobs at NVIDIA Corporation

More Enterprise Technology Jobs

Find similar Senior Staff Software Engineer - Enterprise AI Platform jobs: