Snowflake Computing

Intermediate/ Senior Software Engineer - Cortex LLM Training Platform

Snowflake Computing$140K — $170K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 3+ years (Intermediate) | 6+ years (Senior) building and shipping production ML systems
  • Strong foundation in distributed systems and infrastructure, with experience in Kubernetes
  • Familiarity with GPU and LLM infrastructure, including PyTorch, DeepSpeed/FSDP, Ray, CUDA/NCCL, vLLM
  • Demonstrated ability to enhance system reliability, throughput, and cost efficiency
  • Bachelor's in Computer Science or related field, MS/PhD preferred
  • (Bonus) Hands-on experience with LLM post-training/modeling.

Responsibilities

  • Design and build across the entire stack from public training APIs/SDK to GPU data plane
  • Scale distributed systems for serverless GPU compute with fault tolerance
  • Enhance end-to-end performance at scale, keeping training and inference fast
  • Productionize research components in collaboration with Snowflake Research
  • Ensure responsiveness of the data plane under heavy concurrent loads.

Benefits

  • Opportunity to work on cutting-edge ML infrastructure
  • Chance to collaborate with leading researchers in the field
  • Culture that values innovation and challenges conventional thinking
  • Growth-oriented environment as the company scales
  • Ability to impact enterprise-scale solutions for clients.
Full Job Description
Senior Software Engineer - Cortex Training

The Snowflake ML Platform team's mission is to let customers run their most demanding ML/AI workloads inside Snowflake. Cortex Training is our LLM post-training platform: it turns scarce, expensive GPU capacity into a simple, composable service, so customers can adapt open-weight foundation models to their own business problems while we handle the hard distributed-systems parts, including scheduling, orchestration, multi-node training and inference, fault tolerance, and throughput.

The platform already runs post-training at scale. Under the hood, it decouples GPU computation from the training loop and exposes it as primitive APIs that compose into everything from SFT to full RL workflows. You'll work alongside a team that ships fast & sweats reliability and the researchers behind DeepSpeed. We're looking for an engineer who thrives in the ML infrastructure layer and brings a solid understanding of LLMs and post-training to help us scale and grow it.

YOU WILL:
  • Design and build across the full stack - from the public training APIs and SDK through the control plane to the GPU data plane.
  • Scale the distributed systems that make GPU compute serverless - multi-tenant scheduling, placement, and capacity-aware routing across regional GPU pools, with fault tolerance built in.
  • Drive end-to-end performance at scale - keep the training, inference, and RL loops fast and the data plane responsive under heavy concurrent load, with GPUs kept saturated.
  • Productionize research building blocks - partner with Snowflake Research to turn state-of-the-art training and inference techniques into reliable, composable components customers can run at enterprise scale.
QUALIFICATIONS:
  • 3 + years (Intermediate) | 6+ years (Senior) building and shipping production ML systems
  • Strong distributed systems and infrastructure foundation - designing scalable, fault-tolerant services and operating them on Kubernetes in production.
  • Familiarity with GPU and LLM infrastructure - e.g., PyTorch, DeepSpeed/FSDP, Ray, CUDA/NCCL, vLLM; able to debug across the data, infrastructure, and GPU layers.
  • Demonstrated ability to harden complex systems for reliability, throughput, and cost efficiency.
  • BS in Computer Science or a related field (MS/PhD a plus).
  • (Bonus) Hands-on LLM post-training / modeling experience - the strongest candidates pair deep infra skills with real post-training intuition.

Snowflake is growing fast, and we're scaling our team to help enable and accelerate our growth. We are looking for people who share our values, challenge ordinary thinking, and push the pace of innovation while building a future for themselves and Snowflake.

How do you want to make your impact?

About Snowflake Computing

Snowflake is a cloud-based data-warehousing company that was founded in 2012. The company provides a data platform that allows customers to store and analyze data using cloud-based infrastructure. Snowflake's platform is designed to be highly scalable and flexible, allowing customers to easily add or remove computing resources as needed. The company's customers include a wide range of businesses, from startups to Fortune 500 companies. Snowflake has received significant funding from investors and has been recognized as one of the fastest-growing companies in the United States.
Learn more about Snowflake Computing
Size
2,037 employees
Market Cap
$44.9 billion
Industry
Net Income
-$539.1 million
Founded
2012
Revenue
$592 million
NASDAQ

Similar Jobs

More Jobs at Snowflake Computing

More Information Technology Jobs

Find similar Intermediate/ Senior Software Engineer - Cortex LLM Training Platform jobs: