Senior ML Compiler Engineer

femtoAI

$130K — $180K *
Enterprise Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 4+ years in compilers, systems, or performance engineering
  • Masters or PhD in relevant field
  • Expertise in ML compiler frameworks like MLIR or TVM
  • Experience with optimization techniques (scheduling, memory, tiling)
  • Skill in designing complex compiler systems
  • Strong understanding of performance metrics across compute and memory

Responsibilities

  • Design and implement compiler architecture and transformation pipelines
  • Lead development of complex compiler passes for memory allocation and reuse
  • Create optimization strategies for scheduling and memory management
  • Develop cost models and optimization heuristics
  • Explore advanced optimization techniques such as ILP
  • Debug system-level issues to ensure performance and correctness
  • Collaborate with hardware teams on execution models and abstractions

Benefits

  • 401(k)
  • Medical insurance
  • Vision insurance
  • Dental insurance
  • Commuter benefits
  • Disability insurance
  • Paid maternity leave
  • Paid paternity leave
  • Child care support
Full Job Description
Job Description
You will design and build core components of our ML compiler, owning critical parts of the transformation and optimization pipeline.

Your work will directly determine whether models fit within hardware constraints and achieve real-time performance.

What You'll Do
  • Design and implement compiler architecture across:
    • IR design and transformation pipelines
    • Optimization strategies for scheduling, tiling, and memory reuse
  • Lead development of complex compiler passes such as:
    • Global memory allocation and liveness-driven reuse
    • Cross-operator fusion and graph partitioning
    • Hardware-aware scheduling strategies
  • Develop cost models and optimization heuristics
  • Explore advanced techniques:
    • Constraint-based optimization (e.g., ILP/MILP/CP)
    • Scheduling optimization
  • Drive debugging of system-level issues (correctness, performance, HW mismatches)
  • Collaborate with hardware teams on co-design of abstractions and execution models

Requirements

Required qualifications and experience:

  • 4+ years of experience in compilers, systems, or performance engineering
  • Masters or PhD in Computer Science, Electrical Engineering, Math, or a related field
  • Deep experience with at least one:
    • ML compiler frameworks (MLIR, TVM, XLA, etc.)
    • Low-level optimization (scheduling, memory, tiling)
  • Proven ability to design non-trivial compiler systems or passes
  • Strong intuition for performance across compute, memory, and data movement
  • Comfort working with hardware constraints


Nice to have:

  • Experience with constraint solvers (MILP, ILP, CP)
  • Background in accelerator architectures or embedded systems
  • Experience optimizing ML workloads for latency/power
  • Familiarity with DSP or real-time signal processing


Benefits

  • 401(k)
  • Medical insurance
  • Vision insurance
  • Dental insurance
  • Commuter benefits
  • Disability insurance
  • Paid maternity leave
  • Paid paternity leave
  • Child care support

Similar Jobs

More Enterprise Technology Jobs

Find similar Senior ML Compiler Engineer jobs: