Software Engineer, Platform & Inference

Chai Discovery, Inc

$130K — $180K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree in Computer Science or related field or equivalent experience
  • 5+ years of experience building production systems with modern tools
  • Expertise in infrastructure observability, alerting, and incident response
  • Experience with both 0-to-1 buildouts and 1-to-n scale-ups
  • Ability to anticipate and strategize around infrastructure challenges

Responsibilities

  • Build and maintain compute and infrastructure systems for product surface
  • Collaborate with product engineers, researchers, and commercial teams
  • Scale AI/ML systems into production environments
  • Translate scientific requirements into actionable engineering tasks
  • Predict and address challenges preventing platform adoption by biopharma organizations

Benefits

  • Opportunity to work on cutting-edge technology that transforms drug discovery
  • Collaborate with renowned leaders in AI and biology
  • Fast-paced environment with distributed ownership of projects
  • Supportive and mission-driven company culture
  • Opportunities for continuous learning and career growth
Full Job Description
About the role

Platform engineers make Chai's models fast, cheap, and reliable at scale, and enable the outer loop that accelerates research: the infrastructure and software abstractions used to train, eval, and understand models.

You'll own the serving stack that turns our frontier models into a product scientists depend on: latency, throughput, GPU efficiency, batching, and autoscaling across a large multi-cloud GPU fleet. You'll also contribute to the work that enables turning raw models into product-ready pipelines, and the experiment and observability tooling that lets a researcher ship faster.

You've built high-performance services that developers love, moved ML systems into production at scale, and can see around corners before they become outages.

You'll work closely with the researchers who train the models, the product engineers who build on them, and the commercial team deploying them to the world's largest pharma companies.

About you

We index on systems judgment, ownership, and the scars that come from having run production infrastructure before. We're looking for engineers who get obsessed with hard problems and don't give up easily. We look for:
  • 4+ years building production systems, with real depth in performance, distributed systems, or ML serving
  • Experience optimizing model inference: GPU utilization, batching, quantization, caching, or kernel-level work
  • A platform mindset: you like building the tools and abstractions that make other engineers and researchers faster
  • End-to-end ownership of 24/7 systems, including observability, alerting, and incident response
  • Experience across both 0-to-1 buildouts and 1-to-n scale-ups, with an always-evolving playbook you bring wherever you go
  • The instinct to treat cost and efficiency as first-class constraints, not afterthoughts

A background in biology is not required. What makes the difference is technical excellence, curiosity about the domain, and grit.
We offer

The opportunity to work at the leading edge of AI research, with world-class people, on a mission that matters. We protect & promote a culture of high velocity and ownership. We offer highly competitive compensation.

Similar Jobs

More Information Technology Jobs

Find similar Software Engineer, Platform & Inference jobs: