The Role
Owns observability/monitoring, utilization analysis, demand insight, capacity forecasting, scaling triggers, and recommendations for NVIDIA AI infrastructure and workloads.
Who You Are
Responsibilities
• Implement and maintain monitoring using DCGM, Prometheus, Grafana, and related telemetry sources.
• Define service health, GPU, fabric, storage, queue, workload, and utilization measures.
• Build dashboards, alerts, thresholds, and operational views for platform teams and leaders.
• Analyze utilization, queue depth, workload demand, bottlenecks, and capacity trends.
• Develop forecasts, scaling triggers, and evidence-based capacity recommendations.
• Partner with platform operations, FDE, architecture, finance, and customer teams on demand and growth planning.
• Validate monitoring coverage during deployment and maintain baselines through the lifecycle.
• Improve data quality and automate recurring performance and capacity reporting.
Required Professional Experience
• Experience in infrastructure monitoring, observability, performance analysis, or capacity management.
• Hands-on experience with Prometheus, Grafana, or comparable monitoring platforms.
• Experience analyzing time-series data and translating trends into operational recommendations.
• Working knowledge of Linux, containers, GPU infrastructure, and distributed platforms.
Preferred Qualifications
• Experience with NVIDIA DCGM and GPU telemetry.
• Experience with Run:ai Scheduler, Kubernetes scheduling, queue analysis, or AI workload demand.
• Experience with Python, APIs, data analytics, and dashboard automation.
Required Skills
NVIDIA DCGM | Prometheus | Grafana | GPU Monitoring | Observability | Capacity Planning | Utilization Analysis | Performance Analysis | Forecasting | Scaling Triggers | Dashboard Development
Travel Requirements
Limited nationwide travel may be required; percentage to be confirmed.
The compensation range for the position in the U.S. is - $115,080 to $218,520 based on a full-time schedule. Your actual compensation may vary depending on your geography, job-related skills and experience. For part time roles, the compensation will be adjusted appropriately. The pay or salary range will not be below any applicable state, city or local minimum wage requirement. There is a different applicable compensation range for the following work locations:
California (San Francisco Bay Area): $138,120 to $262,320
California (All Other): $126,600 to $240,480
Colorado: $115,080 to $218,520
Massachusetts $115,080 to $240,480
New York City: $138,120 to $262,320
Washington: $126,600 to $240,480
Washington DC: $126,600 to $240,480
This position will be eligible for Kyndryl's discretionary annual bonus program, based on performance and subject to the terms of Kyndryl's applicable plans. You may also receive a comprehensive benefits package which includes medical and dental coverage, disability, retirement benefits, paid leave, and paid time off.
Note: If this is a sales commission eligible role, you will be eligible to participate in a sales commission plan in lieu of the annual discretionary bonus program.
Applications will be accepted on a rolling basis.
