Software Engineer, ML Infrastructure

Ideogram

$90K — $130K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 1-4 years in large-scale production infrastructure development.
  • Experience with Kubernetes/GCP and distributed systems for GPU/TPU workloads.
  • Proficient in Linux environments for support and troubleshooting.
  • Skilled in scaling workers for ML training or inference.
  • Solid understanding of ML models on GPU architecture.

Responsibilities

  • Build and optimize distributed training infrastructure for AI models.
  • Enhance inference pipelines for high user engagement and responsiveness.
  • Troubleshoot complex issues in ML infrastructure and deployments.
  • Collaborate with teams to ensure high-quality software solutions.
  • Communicate technical concepts effectively to diverse stakeholders.

Benefits

  • Competitive compensation and equity reflecting your contributions.
  • Four weeks of vacation for work-life balance.
  • Comprehensive health, vision, and dental benefits from day one.
  • RRSP/401(k) plan with an employer match for financial security.
  • Access to advanced tools and technology to enhance productivity.
  • In-office perks in Toronto for convenience and team bonding.
  • Freedom to explore new ideas and conduct experiments.
  • A culture emphasizing mentorship and continuous learning.
Full Job Description
About The Role

As a Software Engineer, ML Infrastructure at Ideogram, you'll build the systems that power training and serving for our generative AI models at scale. You'll work across the stack, from designing distributed training infrastructure to optimizing inference pipelines that serve millions of users, with a relentless focus on reliability, speed, and efficiency. We're looking for someone who combines deep systems expertise with a builder's mindset, strong technical ownership, and the ability to move fast in an evolving AI landscape.

What We're Looking For

Technical Excellence
  • 1-4 years developing and shipping large-scale production infrastructure.
  • Experience designing large, highly available distributed systems with Kubernetes/GCP, and GPU/TPU workloads on those clusters.
  • Experience in deploying, supporting, and troubleshooting in complex Linux-based computing environments.
  • Experience in worker scaling for training or inference workloads.
  • Fundamental knowledge in ML models and how they run on GPUs.

Ownership and Collaboration
  • Deep sense of ownership - proactively identifies opportunities, suggests improvements, and acts on them.
  • The grit and adaptability to solve complex technical challenges that evolve day to day.
  • Can explain technical concepts to both engineers and non-technical stakeholders
  • Pushes for quality through constructive code review and collaboration
  • Bachelor's degree in Computer Science, Engineering, related field, or equivalent practical experience


Our Culture

We're a team of exceptionally talented, curious builders who love solving tough problems and turning bold ideas into reality. We move fast, collaborate deeply, and operate without unnecessary hierarchy, because we believe the best ideas can come from anyone.

Everyone at Ideogram rolls up their sleeves to make our products and our customers successful. We thrive on curiosity, creativity, and shared ownership. We believe that small, dedicated teams working together with trust and purpose can move faster, think bigger, and create amazing things.

Ideogram is committed to welcoming everyone - regardless of gender identity, orientation, or expression. Our mission is to create belonging and remove barriers so everyone can create boldly.

What We Offer

Competitive compensation and equity designed to recognize the value and impact of your contributions to Ideogram's success.
4 weeks of vacation to recharge and explore.
Comprehensive health, vision, and dental coverage starting on day one.
RRSP/401(k) with employer match up to 4% to invest in your future from the moment you join.
Top-of-the-line tools and tech to fuel your creativity and productivity.
Toronto HQ perks: Steps from Union Station and the PATH, with daily in-office lunches and dinners.
Autonomy to explore and experiment - whether you're testing new ideas, running large-scale experiments, or diving into research, you'll have access to compute/resources you need when there's a clear business or creative use case. We encourage curiosity and bold thinking.
A culture of learning and growth, where curiosity is encouraged and mentorship is part of the journey.

Similar Jobs

More Jobs at Ideogram

More Information Technology Jobs

Find similar Software Engineer, ML Infrastructure jobs: