About the RoleWe're looking for an
ML Performance Engineer to join our MLOps team. You will validate new clusters by running large-scale training and inference workloads, help improve our managed Kubernetes and Slurm platforms through hands-on use, and produce performance benchmarks for customers and the broader market.
What You'll Do- Validate new cluster deployments by running large-scale training and inference workloads before customer handoff
- Identify, reproduce, and diagnose performance and reliability issues, working with infrastructure and platform teams to resolve them
- Use our managed Kubernetes and Slurm platforms the way our customers do, and provide feedback that improves them
- Run model benchmarks across training and inference, both for internal and external use
- Build tooling and repeatable workflows for validation and benchmarking
- Stay current with distributed training and inference frameworks and their performance on AMD Instinct GPUs
- Work with larger MLOps team to help support customer clusters and workloads
Who You AreRequired Qualifications- Bachelor of Science in Computer Science, Computer Engineering, or a related technical field, or equivalent practical experience
- 3+ years of experience running ML workloads on GPU clusters
- Hands-on experience with distributed training using frameworks such as PyTorch FSDP, Megatron-LM, DeepSpeed, or torchtitan
- Working knowledge of Slurm and Kubernetes from a user and workload perspective
- Experience profiling and optimizing GPU workloads, including collective communication performance
- Strong Python skills and solid Linux fundamentals
- Clear written communication of performance findings to engineering and non-technical audiences
What We Offer- 100% paid Medical, Dental, and Vision insurance for Employees
- Company Health Savings Account Contributions
- 100% paid Short Term and Long Term Disability Insurance for Employees
- Life and Voluntary Supplemental Insurance Options
- Other Insurance Options, such as Pet & Legal Insurance
- Various Supplementary Health Benefits, such as discounted Virtual Healthcare Appointments and Serious Illness Support
- Flexible Spending Account
- Employee Assistance Program
