Infra Engineer - API

Medal

$120K — $160K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • Proven experience scaling a high-traffic, low-latency API in production environments (gaming, video streaming, payments, hyperscalers).
  • Extensive knowledge of Kubernetes, particularly in multi-region deployments.
  • Understanding of Service Level Objectives (SLOs) and capacity planning methodologies.
  • Demonstrated end-to-end ownership of systems and infrastructure.

Responsibilities

  • Manage the video streaming protocol for efficient client-server communication.
  • Oversee the entire runtime layer of the API, including session management and inference orchestration.
  • Expand Kubernetes infrastructure across multiple global regions.
  • Devise and implement strategies to scale GPU resources significantly.
  • Enhance inference latency and throughput by managing performance-related tasks.
  • Collaborate with product engineering to ensure reliable and observable developer experiences.

Benefits

  • Competitive salary and meaningful equity
  • Comprehensive medical, dental, and vision coverage
  • 401(k) plan
  • Wellhub membership for fitness and wellness
  • Mental health support from Spring Health and Headspace
  • Fertility and maternal health benefits
  • Paid parental leave
  • Generous PTO with paid holidays and sick leave
  • Daily meals and commuter benefits in the NYC office
  • Stipend for learning and development opportunities
Full Job Description
The Role

We're hiring an Infra Engineer to own General Intuition's API.

Our research team builds frontier models - agents that reason about space and time, world models, video understanding. Your job is to turn those models into a production API that developers love: low-latency, highly available, billing-grade reliable, and able to scale from our first hundred users to tens of thousands of concurrent ones.

You'll work directly with the founding team. You'll own the API end to end: the client libraries developers integrate with, how we receive frames from clients and stream actions back, how requests route to the right GPU, how sessions spin up and tear down, how k8s clusters get stood up in new regions, and how our GPU fleet scales.

This is a true generalist infrastructure role. We are not looking for a pure API person or a pure GPU person - we are looking for someone who is exceptional at both, and who wants to own the entire surface end-to-end.

Key Responsibilities
  • Own the video streaming protocol. Orchestrating how we receive frames from clients and route them to servers as efficiently as possible.
  • Own the runtime layer of our API. Stateful request routing, GPU session lifecycle, inference orchestration - the whole runtime stack.
  • Scale our k8s footprint across regions. Lead new regional deployments.
  • Own the GPU hosting strategy. Move us from dozens of GPUs today to potentially thousands (and beyond) without breaking the bank or the latency budget.
  • Drive latency and throughput. Own the inference-performance backlog
  • Partner with product engineering. Work closely on developer-facing reliability, observability, metering, and billing-grade uptime.
Qualifications

You almost certainly have:
  • A track record of personally scaling a high-traffic, low-latency API in production, whether at a gaming company, a video streaming company, a payments company, or a hyperscaler.
  • Deep k8s experience, including multi-region deployments.
  • Comfort with SLOs and capacity planning.
  • Strong ownership instinct - you've taken systems end-to-end, not just contributed to them.

Bonus points for any of:
  • Experience deploying streaming video or audio inference models (the dream hire).
  • Experience with low-latency game streaming or video streaming infra.
  • Experience scaling GPU fleets across providers (GCP, Coreweave, Lambda, etc.).
  • Experience with frontier model inference (LLMs, world models, multimodal).
  • Experience with on-device / edge inference (ExecuTorch, Core ML, etc.).

Our stack
  • GPUs: GCP today, Coreweave as we scale.
  • Orchestration: Kubernetes, multi-region.
  • Models: In-house frontier research - agents, world models, video understanding.
  • API surface: Client libraries in TypeScript, Python, Rust, and C
  • In-office, 5 days/week. NYC, Stockholm, London, Paris, or Geneva.


Benefits
  • Competitive salary and meaningful equity
  • Comprehensive medical, dental, and vision coverage
  • 401(k)
  • Wellhub membership for fitness and wellness
  • Mental health support through Spring Health and Headspace
  • Fertility and maternal health benefits
  • Paid parental leave
  • Generous PTO, 11 paid company holidays, and paid sick time
  • Daily meals and commuter benefits at our NYC HQ
  • Learning and development stipend

Benefits vary by country and employment type.

Similar Jobs

More Jobs at Medal

More Information Technology Jobs

Find similar Infra Engineer - API jobs: