Lead AI Infrastructure Engineer

Avride

• $135K — $160K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years of experience with C++
  • Experience with PyTorch
  • Strong understanding of GPU functionality
  • Proven ability to diagnose and resolve performance issues
  • Experience in building distributed infrastructure
  • Programming knowledge in multi-threaded environments

Responsibilities

  • Optimize the GPU inference framework with a focus on performance
  • Assume ownership of broader ML infrastructure within ML pipelines
  • Collaborate closely with the applied ML team on neural model architecture

Benefits

  • Opportunity to influence ML infrastructure across the company
  • Engagement in cutting-edge machine learning projects
  • Work in a collaborative environment with skilled ML teams
Full Job Description
About the role

We're looking for a software engineer with a leadership mindset and deep ML infrastructure experience. You will decide and influence the ML infrastructure layer across the company. The biggest challenge we're facing at the moment is the effectiveness of GPU inference - both for onboard applications with near real-time guarantees and for offboard cases that target high throughput and deterministic execution. It is the first priority within this role.
What you'll do
  • At first, you will take on the GPU inference framework, focusing on performance
  • Later, the role assumes responsibility and ownership for broader ML infrastructure scattered across ML pipelines
  • Close collaboration with the applied ML team responsible for defining the neural model's architecture
What you'll need
  • Experience with PyTorch
  • Understanding of how GPUs work
  • Experience in diagnosing and resolving performance issues
  • Strong record of building infrastructure including distributed systems
  • 5+ years of experience with C++
  • Programming experience in multi-threaded environments - multiple processes, threads, timers, and interrupts


#LI-MS1

Candidates are required to be authorized to work in the U.S. The employer is not offering relocation, sponsorship, and remote work options are not available.

Similar Jobs

More Jobs at Avride

More Information Technology Jobs

Find similar Lead AI Infrastructure Engineer jobs: