As a Senior Software Engineer, NIM Tools, you will have the remarkable opportunity to build a groundbreaking model customization and deployment lifecycle platform from inception. This isn't just another feature team-you will be defining the structure for a new product surface accessed by ISVs and CSPs internationally. Your work will empower customers to take models from selection through fine-tuning, evaluation, deployment, and compliance flawlessly.
What you'll be doing:- Compose and build the fine-tuning handoff pipeline, including LoRA adapter repackaging, re-quantization, and re-validation into NIM.
- Develop the evaluation harness, ensuring models meet our high standards.
- Implement the observability and attestation layer to produce auditable compliance artifacts.
- Work in close partnership with ISVs and CSPs to roll out NVIDIA NIMs on a large scale.
- Define and improve durable platform APIs, steering clear of one-off integrations.
- Ensure flawless completion of projects through strict attention to detail and proven methodologies.
What we need to see:- Bachelor's degree in Computer Science, Engineering, or equivalent experience.
- Experience in utilizing model customization tools: LoRA, QLoRA, supervised fine-tuning (SFT), reinforcement learning (RL), preference optimization (e.g., DPO), and retrieval-augmented generation (RAG)
- 7+ years of experience with LLM serving infrastructure (vLLM, TRT-LLM, or equivalent).
- Deep understanding of model quantization and fine-tuning workflows.
- Demonstrated history of developing robust platform APIs.
- Strong collaborative skills and experience working in cross-functional teams.
- Outstanding problem-solving skills and meticulous attention to detail.
Ways to stand out from the crowd:- Experience with large-scale deployment of AI models.
- Familiarity with compliance and audit processes for AI models.
- Contributions to open-source AI projects.
- Strong publication record in relevant fields.
- Excellent communication skills and a passion for mentorship.
With competitive salaries and a generous benefits package, we are widely considered to be one of the technology world's most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us and, due to unprecedented growth, our exclusive engineering teams are rapidly growing. If you're a creative and autonomous engineer with a real passion for technology, we want to hear from you.
Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5.
You will also be eligible for equity and benefits.
Applications for this job will be accepted at least until August 30, 2026.
This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
