Generative AI is becoming a central force in real-time sensing, simulation, and robotics - and this role will play a pivotal part in bringing those capabilities into Holoscan. Emerging multimodal foundation models (VLMs, video-language models, neural fields) are becoming essential for real-time perception. This role will extend Holoscan's core mission by enabling GPU-resident generative methods that accelerate development, improve simulation fidelity, and unlock new possibilities for real-time perception. As part of this groundbreaking Holoscan SDK team is at the forefront of this transformation! We are designing APIs, building GPU-accelerated software pipelines, and collaborating with research and industry partners to deliver the foundation for tomorrow's real-time AI platforms.
What You'll Be Doing:- Architect the next generation of Holoscan SDK by developing intuitive, scalable APIs for real-time sensor, imaging, and multimodal data processing-balancing developer usability with peak GPU performance.
- Prototype GPU-accelerated algorithms for computer vision, imaging, sensor fusion, and low-latency rendering-translating research into production-grade software.
- Build and optimize core GPU libraries for accelerated I/O, streaming, decoding, and visualization, employing CUDA, Vulkan, and GPU-resident data paths.
- Contribute to real-time visualization frameworks for medical, robotic, or industrial applications-integrating Vulkan, OpenGL, or Omniverse/RTX-based rendering back-ends.
- Benchmark performance rigorously, profiling and optimizing across the full pipeline (Sensor AI Render Display, Sensor AI Robotic Control).
- Combine generative models with the Holoscan Sensor Bridge (HSB), Isaac Sim, ISAAC Lab and Omniverse to create real-time AI-powered virtual sensors that behave like real hardware-enabling development and testing long before physical sensors exist.
- Prototype and optimize neural field (NeRF/SDF/Gaussian) operators for real-time scene reconstruction, view synthesis, and 3D perception-directly within Holoscan's streaming architecture.
- Integrate and optimize vision-language and multimodal foundation models for real-time, GPU-resident sensor pipelines
What we need to see:- A strong communicator and collaborator able to work across multiple domains-from AI and compute to graphics and visualization.
- Dynamic programming expertise in C++ (modern standards), plus proven Python skills for prototyping and tooling.
- Deep passion for real-time AI, computer vision, and sensor-driven systems-plus a passion for high-performance visualization and rendering.
- Familiarity with multimodal or vision-language models and an understanding of how to adapt them to streaming or real-time workloads is a strong plus.
- Success designing APIs and frameworks that stand the test of scale and that developers love to use!
- 8+ years of experience building and shipping complex, high-performance imaging, sensor, or rendering software.
- Familiarity with GPU processing and rendering pipelines, synchronization, GPU memory management, and multi-GPU rendering is a plus.
- Master's/PhD or equivalent experience in Computer Science, Applied Math, Electrical or Computer Engineering, or related fields.
Ways to Stand Out from the Crowd:- Experience adapting VLMs or multimodal foundation models to real-time sensor or video pipelines.
- Background integrating real-time GPU-accelerated processing and visualization pipelines (e.g., CUDA Vulkan interop),
- Hands-on expertise with CUDA C/C++ and deep knowledge of GPU architecture and parallel programming paradigms.
- Knowledge of Omniverse Kit, or other GPU rendering frameworks for real-time visualization.
- Acute understanding of low-latency streaming pipelines for multimodal sensor fusion
Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5.
You will also be eligible for equity and benefits.
Applications for this job will be accepted at least until May 18, 2026.
This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
