The Role
Accountable for operational visibility and capacity planning across the full service stack. Gives leadership early warning of reliability and capacity risk and the evidence needed to optimize costly AI infrastructure and plan expansion.
Key responsibilities· Design a common telemetry model spanning power, cooling, compute, GPU, NVLink, network, storage, Kubernetes, scheduler, workload, and service layers.
· Implement and maintain DCGM or equivalent GPU telemetry, Prometheus, Grafana, vendor management telemetry, log pipelines, and enterprise observability integration.
· Monitor health, ECC conditions, throttling, thermals, link state, retransmissions, congestion, queue depth, storage latency, workload demand, and service SLOs.
· Build topology-aware dashboards, alerts, dependency views, baseline reports, and operational or executive scorecards.
· Baseline idle, steady-state, peak, degraded, and recovery conditions and correlate GPU utilization with CPU, memory, network, storage, queue, and application demand.
· Define evidence-based thresholds and reduce false positives through tuning, suppression, routing, and contextual enrichment.
· Forecast GPUs, fabric ports, storage bandwidth, rack power, cooling, scheduler demand, and expansion triggers.
· Identify stranded capacity, bottlenecks, noisy-neighbor conditions, low utilization, and workload-placement inefficiency and recommend corrective action..
Kyndryl currently does not require employees to be fully vaccinated against COVID-19, however, if you are hired to work at a client, customer, or partner location, you may be required to show proof ofvaccinationto align with their respective COVID-19vaccinationpolicies. Those who believe they are eligible may apply for a medical or religious accommodation prior to the start of employment.
Who You Are
Required Qualifications· 4+ years in observability, performance engineering, capacity management, SRE, or infrastructure analytics.
· Hands-on Prometheus, Grafana, time-series data, APIs, dashboarding, and alert engineering.
· Ability to translate telemetry into operational, performance, and investment recommendations.
Preferred Skills
· NVIDIA DCGM, NVIDIA Run:ai, NCCL performance, UFM, and Spectrum-X or InfiniBand telemetry.
· NVIDIA GPU utilization and workload-efficiency analysis, topology-aware monitoring, and AI capacity modeling.
· Cloud observability, HPC performance engineering, network telemetry, storage analytics, or enterprise capacity management.
· OpenTelemetry, Elastic, Splunk, Datadog, Dynatrace, VictoriaMetrics, Thanos, or comparable platforms.
· Slurm accounting, Kubernetes metrics, FinOps, or infrastructure demand forecasting.
· SRE, observability platform, or cloud-native credentials.
Travel RequirementsLimited nationwide travel may be required; percentage to be confirmed.
The compensation range for the position in the U.S. is - $115,080 to $218,520 based on a full-time schedule.Your actual compensation may vary depending on your geography, job-related skills and experience. For part time roles, the compensation will be adjusted appropriately. The pay or salary range will not be below any applicable state, city or local minimum wage requirement. There is a different applicable compensation range for the following work locations:
California (San Francisco Bay Area): $138,120 to $262,320
California (All Other): $126,600 to $240,480
Colorado: $115,080 to $218,520
Massachusetts $115,080 to $240,480
New York City: $138,120 to $262,320
Washington: $126,600 to $240,480
Washington DC: $126,600 to $240,480
This position will be eligible for Kyndryls discretionary annual bonus program, based on performance and subject to the terms of Kyndryls applicable plans. You may also receive a comprehensive benefits package which includes medical and dental coverage, disability, retirement benefits, paid leave, and paid time off.
Note: If this is a sales commission eligible role, you will be eligible to participate in a sales commission plan in lieu of the annual discretionary bonus program.
Applications will be accepted on a rolling basis.