Software Engineer: ML Optimization

Generalist AI, Inc

$120K — $160K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 5-7 years of experience in machine learning and optimization
  • Proficiency in transformer and diffusion architectures
  • Strong background in CUDA, Python, and libraries like numpy and torch
  • Familiarity with hardware acceleration and GPU optimization techniques
  • Ability to identify and resolve performance bottlenecks across various system layers

Responsibilities

  • Owning the optimization of training and inference stacks
  • Implementing ML and hardware changes for significant performance improvements
  • Evaluating and enhancing GPU performance for machine learning tasks
  • Investigating and resolving bottlenecks in CPU and network performance
  • Conducting analyses of efficiency across software components

Benefits

  • Opportunities for professional development
  • Access to cutting-edge technology and tools
  • Collaborative and dynamic team environment
  • Potential for significant impact in a growing field
Full Job Description
About the Role

We internally call this team MBMB (More Big More Better). You will own optimizations on both the training and on-robot inference stacks. We are still in a regime of step-function, not incremental, gains.

You'll be responsible for:
  • Making GPUs go brrrrr
  • Implementing ML, hardware, and software changes that lead to step-function gains
  • Optimizing both the inference and training stacks


You might thrive in this role if you:
  • Are proficient and stay current with the latest ML techniques for training and inference optimizations in transformer and diffusion based architectures
  • Will chase ML optimizations anywhere: From the CUDA kernels, to ML architecture, to frontend or backend network bottlenecks, CPU bottlenecks, NVLink and comms, to torch, numpy, and Python inefficiencies.

Similar Jobs

More Jobs at Generalist AI, Inc

More Information Technology Jobs

Find similar Software Engineer: ML Optimization jobs: