ML Runtime and Kernel Engineer - Core ML

Cerebras Systems

• $125K — $150K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's, Master's, PhD, or equivalent experience in Computer Science, Computer Engineering, Electrical Engineering, or a related field.
  • Experience developing high-performance systems software or machine learning systems.
  • Strong programming skills in C++ and Python.
  • Understanding of parallel programming, memory management, and performance optimization.
  • Proven ability to debug complex software across multiple system layers.
  • Familiarity with modern ML architectures and frameworks like PyTorch or JAX.
  • Ability to collaborate effectively with researchers to translate algorithmic requirements.

Responsibilities

  • Design and implement runtime components and performant kernels for Core ML algorithms.
  • Translate research prototypes into efficient implementations on Cerebras platform and compare them on GPUs when applicable.
  • Profile and debug performance across various layers like ML framework and kernel.
  • Optimize computation, memory movement, and concurrency for large-scale training and low-latency inference.
  • Develop benchmarks and automated tests for functionality, performance, and correctness.
  • Collaborate closely with researchers and engineers to evaluate design alternatives.
  • Contribute to software architecture by identifying limitations and suggesting improvements.

Benefits

  • Collaborative environment with leading ML researchers and engineers.
  • Opportunity to work on cutting-edge technology with unique hardware capabilities.
  • Engagement in high-impact projects that transform research into high-performance applications.
  • Support for professional development and continuous learning in a fast-evolving field.
Full Job Description
About The Role

The Core ML team develops novel machine learning algorithms that take advantage of the unique capabilities of the Cerebras Wafer-Scale Engine. Our work spans efficient LLM training and inference, parallel and diffusion-based generation, sparsity, scaling laws, and training dynamics.

We are looking for an engineer to bridge the gap between promising research ideas and efficient execution on Cerebras systems. You will work across ML frameworks, compilers, runtimes, and low-level kernels to implement new algorithmic capabilities, diagnose performance bottlenecks, and turn research prototypes into robust, high-performance demonstrations.

Depending on your background, your work may emphasize runtime capabilities such as token orchestration, scheduling, communication, and distributed execution; low-level kernel development for novel ML operations; or a combination of both.

Responsibilities
  • Design and implement runtime components and high-performance kernels required by novel Core ML algorithms.
  • Translate research prototypes into efficient implementations for the Cerebras platform, including reference implementations and comparisons on GPUs where useful.
  • Profile and debug performance across the ML framework, compiler, runtime, communication, and kernel layers.
  • Optimize computation, memory movement, communication, and concurrency for large-scale training and low-latency inference.
  • Develop benchmarks, instrumentation, and automated tests that validate functionality, performance, and numerical correctness.
  • Collaborate closely with Core ML researchers and compiler, runtime, kernel, and inference engineers to evaluate design alternatives and deliver end-to-end capabilities.
  • Contribute to software architecture and roadmap decisions by identifying recurring limitations and high-leverage platform improvements.

Skills & Qualifications
  • Bachelor's, Master's, PhD, or equivalent practical experience in Computer Science, Computer Engineering, Electrical Engineering, or a related field.
  • Experience developing high-performance systems software, ML systems, runtimes, compilers, or computational kernels.
  • Strong programming skills in C++ and Python.
  • Solid understanding of parallel programming, memory management, concurrency, data structures, and performance optimization.
  • Proven ability to debug and profile complex software across multiple layers of a system.
  • Familiarity with modern machine learning architectures and frameworks such as PyTorch or JAX.
  • Ability to work effectively with researchers and translate evolving algorithmic requirements into reliable software.

Preferred Skills & Qualifications
  • Experience with CUDA, Triton, low-level assembly, accelerator programming, or a C-like domain-specific language.
  • Experience with compiler internals, distributed runtimes, custom hardware interfaces, or HPC systems.
  • Understanding of machine learning fundamentals and ML systems, with the ability to reason about how algorithmic choices affect accuracy, systems implementation and performance.
  • Familiarity with LLM training or inference, including attention, KV-cache management, parallel generation, or distributed execution.
  • Experience developing software in an industrial or academic research environment where requirements evolve through experimentation.
  • Contributions to significant open-source systems, ML frameworks, compilers, or kernel libraries.

Similar Jobs

More Jobs at Cerebras Systems

More Information Technology Jobs

Find similar ML Runtime and Kernel Engineer - Core ML jobs: