Compiler Optimization Engineer

Lemurian Labs

$90K — $130K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • BS in Computer Science, Computer Engineering, or equivalent experience
  • 4+ years of compiler experience focused on IR design or optimization passes
  • Expertise in graph-level optimization techniques like fusion and layout transformations
  • 4+ years of C/C++ programming experience
  • Strong communication skills for technical documentation

Responsibilities

  • Design and maintain the graph optimization layer of the AI compiler
  • Implement graph-level transformations such as operator fusion and constant folding
  • Evolve the intermediate representation (IR) to enhance optimization opportunities
  • Analyze performance data to identify optimization gaps
  • Collaborate with front end and code generation teams for optimal IR interfaces
  • Propose new optimization strategies based on model design and hardware advancements
  • Contribute to testing and validation to ensure optimization accuracy

Benefits

  • Own a critical optimization layer with measurable impact on AI model performance
  • Tackle complex graph-level problems across various hardware and model architectures
  • Collaborate with a team that values infrastructure and optimization as crafts
  • Competitive benefits including medical/dental/vision and retirement savings
Full Job Description
About the Role

We're looking for a Graph Optimization Compiler Engineer to own the middle tier of our AI compiler stack - the layer where high-level model graphs are transformed, simplified, and made ready for efficient code generation. You'll design and implement the optimization passes that make the difference between a model that runs and a model that flies.

This role sits between our compiler front end and code generation backend. You'll work on graph-level transformations - fusion, layout optimization, dead code elimination, constant folding, and more - with a direct line of sight to the performance outcomes your work produces. If you think in data flow graphs and optimization passes, and you want that thinking to power the next generation of AI infrastructure, we'd love to talk.
What You'll Do
  • Design, develop, and maintain the graph optimization layer of our heterogeneous AI compiler
  • Implement and extend graph-level transformation passes including operator fusion, layout propagation, dead code elimination, constant folding, and algebraic simplification
  • Define and evolve our intermediate representation (IR) to support new optimization opportunities as ML model architectures advance
  • Analyze performance data to identify optimization gaps and drive measurable improvements in throughput and latency
  • Collaborate with front end and code generation teams to ensure clean IR interfaces and well-structured optimization pipelines
  • Propose and prototype new optimization strategies in response to advances in model design and hardware capabilities
  • Contribute to testing and validation infrastructure to ensure optimization correctness across model types and hardware targets
Requirements
Essential Skills and Experience
  • BS degree in Computer Science, Computer Engineering, or equivalent practical experience
  • 4+ years of experience working with compilers, with a focus on intermediate representation design or optimization passes
  • Deep knowledge of graph-level compiler optimization techniques - fusion, tiling, layout transformations, and related methods
  • 4+ years of experience with C/C++
  • Strong written and verbal communication skills; ability to write clear and concise technical documentation
Preferred Skills and Experience
  • Master's or PhD in Computer Science, Computer Engineering, or equivalent
  • Experience with polyhedral models or affine analysis for loop and tensor optimization
  • Familiarity with hardware memory hierarchies and how layout decisions impact performance on GPUs or accelerators
  • Experience working with MLIR, XLA, or similar graph-level IR frameworks
  • Experience with ML framework internals - PyTorch eager/compile mode, JAX/XLA, or TensorRT
  • Strong understanding of ML model architectures and their computational patterns (attention, convolution, normalization, etc.)
  • Knowledge of quantization, sparsity, or other model-level optimization techniques
  • Contributions to open-source compiler or ML infrastructure projects
Why Join Lemurian Labs
  • Own a critical layer of our compiler stack where optimization decisions have direct, measurable impact on model performance
  • Work on the hardest graph-level problems in AI infrastructure - across diverse hardware targets and model architectures
  • Collaborate with a team that treats infrastructure as a canvas and optimization as a craft
  • Competitive compensation including equity, medical/dental/vision, retirement savings, and wellness benefits


Compensation depends on experience and geographic location and will be narrowed during the interview process. Additional benefits include equity, company bonus opportunities, medical, dental, and vision coverage, a retirement savings plan, and supplemental wellness benefits.

Similar Jobs

More Jobs at Lemurian Labs

More Information Technology Jobs

Find similar Compiler Optimization Engineer jobs: