Demand for inference is growing rapidly, driven by reasoning models, coding agents, parallel subagents, and long-horizon tool use. These workloads are increasing the complexity of how AI systems must be evaluated, simulated, and optimized across different accelerator platforms. We are looking for an AI-native engineer who can combine a strong understanding of model architectures with performance analysis across GPU and LPU systems. You will use agentic methods to streamline simulation, evaluation, and critical engineering workflows for the LPU organization, helping NVIDIA develop a deeper understanding of emerging AI workloads and how they map to future hardware.
What you will be doing:- Building agentic systems that automate simulation, evaluation, performance analysis, and reporting.
- Developing tools that configure experiments, run evaluations, analyze results, identify regressions, and recommend follow-up work.
- Analyzing the inference characteristics of LLMs, reasoning models, coding agents, multimodal models, and agentic harnesses.
- Building and validating performance models for GPU, LPU, and heterogeneous GPU-LPU systems.
- Collaborating with inference, hardware, runtime, compiler, evaluation, and product teams to improve simulation quality and accelerate engineering decisions.
- Automating critical LPU workflows such as benchmarking, workload characterization, capacity planning, and release qualification.
What we need to see:- Strong experience building AI agents or AI-backed engineering systems.
- Familiarity with modern model architectures and AI inference workloads.
- Experience evaluating AI models or agents and analyzing performance.
- Experience with simulation, profiling, benchmarking, or performance modelling.
- Strong Python skills and experience building reliable engineering tools.
- MS in Computer Science, Engineering, or a related field, or equivalent experience.
- 5+ years of relevant software development experience.
- 2 years of experience building AI agents or building AI-backed engineering systems.
Ways to stand out from the crowd:- Experience using coding agents such as Codex, Claude Code, or similar tools to automate technical workflows.
- Knowledge of GPU or accelerator architecture, distributed inference, or high-performance computing.
- Open-source projects demonstrating agentic AI, evaluation, or performance-engineering applications.
- A rigorous analytical approach to experimentation, data collection, and validation.
Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 152,000 USD - 241,500 USD for Level 3, and 184,000 USD - 287,500 USD for Level 4.
You will also be eligible for equity and benefits.
Applications for this job will be accepted at least until August 16, 2026.
This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
