About the roleWe're looking for a software engineer with a leadership mindset and deep ML infrastructure experience. You will decide and influence the ML infrastructure layer across the company. The biggest challenge we're facing at the moment is the effectiveness of GPU inference - both for onboard applications with near real-time guarantees and for offboard cases that target high throughput and deterministic execution. It is the first priority within this role.
What you'll do- At first, you will take on the GPU inference framework, focusing on performance
- Later, the role assumes responsibility and ownership for broader ML infrastructure scattered across ML pipelines
- Close collaboration with the applied ML team responsible for defining the neural model's architecture
What you'll need- Experience with PyTorch
- Understanding of how GPUs work
- Experience in diagnosing and resolving performance issues
- Strong record of building infrastructure including distributed systems
- 5+ years of experience with C++
- Programming experience in multi-threaded environments - multiple processes, threads, timers, and interrupts
Candidates are required to be authorized to work in the U.S. The employer is not offering relocation sponsorship, and remote work options are not available.
