GPU Performance and Benchmarking Engineer

Vultr

$140K — $150K *
US-AnywhereRemote in United States
Consumer Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 3-7 years in GPU performance engineering, benchmarking, or HPC
  • Hands-on experience with profiling tools like NVIDIA Nsight
  • Strong understanding of AI/ML workload characteristics
  • Experience tuning across GPU, CUDA, and framework layers
  • Familiarity with major GPU platforms (e.g., NVIDIA, AMD)
  • Proficient in Python for scripting and data analysis
  • Basic Linux understanding and knowledge of server hardware
  • Familiarity with high-speed networking concepts and their performance impact
  • Strong analytical skills for translating data into recommendations
  • Excellent written communication for reporting and documentation

Responsibilities

  • Design and execute performance benchmarks for AI workloads
  • Profile GPU workloads to find bottlenecks
  • Tune workload parameters to maximize throughput
  • Establish performance baselines across GPU platforms
  • Develop automation tools for repeatable performance validation
  • Analyze benchmark results and provide actionable recommendations
  • Validate GPU performance before production deployment
  • Collaborate with engineers to correlate performance with system health
  • Evaluate emerging GPU architectures for performance impact
  • Document benchmarking methodologies and best practices

Benefits

  • Opportunity to impact the future of Cloud Infrastructure
  • Work within a high-growth technology company
  • Be part of a visible and crucial role in the team
  • Join a fast-growing, innovative environment
  • Collaborate with experienced engineering teams
Full Job Description
Join Vultr

Vultr is seeking a highly skilled and experienced GPU Performance and Benchmarking Engineer to drive performance validation and optimization of GPU infrastructure through rigorous benchmarking and systematic tuning of AI workloads. The ideal candidate is deep hands-on experience with GPU performance analysis, AI/ML workload characterization, and identifying and applying the parameters that maximize training and inference throughput. This is a highly visible role in a high-growth technology company, which will require strong analytical skills, familiarity with GPU profiling tools, and the ability to translate benchmark results into actionable tuning recommendations. This is your opportunity to join our fast growing team and leave your mark on Vultr and the future of Cloud Infrastructure.

Key Responsibilities
  • Design and execute performance benchmarks for AI training and inference workloads
  • Profile and characterize GPU workloads to identify performance bottlenecks and optimization opportunities
  • Systematically tune workload parameters (batch size, precision, parallelism, memory, etc.) to maximize throughput
  • Establish and maintain performance baselines and success criteria across GPU platforms
  • Develop benchmarking tools, scripts, and automation for repeatable performance validation
  • Analyze and report benchmark results with actionable recommendations for engineering teams
  • Validate performance of new GPU hardware platforms before production deployment
  • Collaborate with GPU Engineers and Fabric Engineers to correlate performance with system-level health
  • Track and evaluate emerging GPU architectures and software releases for performance impact
  • Document benchmarking methodologies, tuning playbooks, and performance best practices


Qualifications
  • 3-7 years of experience in GPU performance engineering, benchmarking, or HPC
  • Hands-on experience with GPU profiling and benchmarking tools (e.g., NVIDIA Nsight, DCGM, nccl-tests, MLPerf, GPU-Burn)
  • Strong understanding of AI/ML workload performance characteristics (training vs. inference, batch sizing, precision modes)
  • Experience tuning performance parameters across GPU, CUDA, and framework layers
  • Familiarity with major GPU platforms (NVIDIA, AMD) and their performance tooling
  • Proficiency in Python for benchmark scripting and data analysis
  • Basic understanding of Linux systems and server hardware
  • Familiarity with high-speed networking concepts (InfiniBand, RoCE, NCCL) and their impact on distributed performance
  • Strong analytical skills with the ability to translate data into clear recommendations
  • Excellent written communication skills for performance reports and documentation


Compensation

$140,000 - $150,000

Final compensation will vary depending on years of experience, background/skill set, location, and applicable laws.

Similar Jobs

More Jobs at Vultr

More Consumer Technology Jobs

Find similar GPU Performance and Benchmarking Engineer jobs: