HPC/ GPU Cluster Architect

SF Compute

• $130K — $160K *
US-AnywhereRemote in San Francisco, CA
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years of hands-on experience designing and scaling HPC or GPU compute clusters in production.
  • Strong understanding of server hardware fundamentals, including GPUs, NICs, PCIe, memory, thermals, and power.
  • Proficient in debugging performance and reliability issues across hardware, OS, drivers, and networking layers.
  • Passionate about automating fleet operations and embracing infrastructure-as-code.
  • Skilled in creating and maintaining operational documentation and runbooks.
  • Ability to mentor junior engineers and contribute positively to team culture.
  • Willingness to travel domestically when required.

Responsibilities

  • Participate in on-call rotation to address cluster issues promptly.
  • Deploy new GPU clusters and environments globally.
  • Troubleshoot and resolve performance and reliability issues across multiple layers.
  • Implement automation strategies for provisioning, monitoring, and remediation.
  • Contribute to the development of operational documentation and runbooks.
  • Mentor junior engineers and help shape team culture.
  • Collaborate with customers to understand their needs and improve services.

Benefits

  • Generous equity grant for team members.
  • Visa sponsorships available for work permits.
  • 401(k) retirement matching up to 4%.
  • Comprehensive medical, dental, and vision insurance with 100% premium coverage.
  • Unlimited paid time off plus 10+ observed holidays.
  • Paid parental leave for biological, adoptive, and foster parents.
  • Daily lunch coverage for employees.
  • Unlimited budget for office books.
Full Job Description
About the Role

GPU clusters are some of the most performant computers on the planet. Even smaller clusters by today's standards would have ranked in the TOP500 five years ago. Our infrastructure team is responsible for architecting and deploying new clusters around the world and keeping them running smoothly. You'll participate in on-call rotation, deploy new environments, fix issues when they arise, and lean into automation to enable deployments at scale. We're a small but ambitious team so you'll be an early contributor helping to shape culture, mentor junior engineers, and learn from our customers.

About You
  • You will have 5+ years of experience with hands-on designing, architecting and scaling at least one HPC or GPU compute cluster in production (ideally >1,000 GPUs, but not required)
  • You deeply understand server hardware fundamentals, including GPUs, NICs, PCIe, memory, thermals, and power
  • You're comfortable debugging performance and reliability issues across hardware, OS, drivers, and networking layers; full-stack.
  • The idea of automating fleet operations (provisioning, monitoring, remediation) excites you - you embrace infrastructure-as-code
  • You appreciate, value, and generate strong operational documentation and runbooks
  • You have the ability and willingness to mentor junior engineers and contribute to team culture
  • You're open to domestic travel when required


Some Nice to Haves
  • Familiarity with data center operations including power, cooling, and colo/vendor engagements
  • Strong Linux systems administration experience, including kernel drivers, RDMA stack tuning, and performance analysis
  • Experience with schedulers and orchestration systems such as Slurm and Kubernetes
  • Exposure to virtualization technologies (KVM, QEMU, libvirt)
  • Experience utilizing telemetry pipelines for predictive hardware failure detection
  • Experience troubleshooting high-speed fabrics such as InfiniBand and/or RoCEv2 Ethernet
Benefits

Generous equity grant

Team members are offered a competitive salary along with equity in the company

Visa Sponsorships

Yes, we sponsor visas and work permits

Retirement matching

We match 401(k) plans up to 4%

Medical, dental & vision

We offer competitive medical, dental, vision insurance for employees and dependents and cover 100% of premiums

Time off

We offer unlimited paid time off as well as 10+ observed holidays

Parental leave

We offer biological, adoptive, and foster parents paid time off to spend quality time with family

Daily lunch

We cover lunch daily for employees

Unlimited office book budget

You can buy as many books for the office as you want

Similar Jobs

More Jobs at SF Compute

More Information Technology Jobs

Find similar HPC/ GPU Cluster Architect jobs: