Founding Engineer - LLM Infra & Platform

Pax Historia

$150K — $180K *
Enterprise Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Experience with systems engineering and architectural design.
  • Knowledge of AI models and their deployment.
  • Strong analytical skills and an obsession with detail.
  • Ability to track performance metrics and optimize processes.
  • Fast learner with a foundation in technical problem-solving.

Responsibilities

  • Manage and optimize the flow of requests to AI providers.
  • Ensure the reliability of 37+ AI models handling over 30 billion tokens monthly.
  • Reduce costs and latency for over 60,000 daily active users.
  • Implement effective caching and monitoring systems.
  • Develop routing strategies for efficient data handling.

Benefits

  • Opportunity to join a small, dynamic team as a founding engineer.
  • Involvement in critical system architecture affecting millions of users.
  • Meaningful equity compensation reflecting ownership in the company.
  • Visa sponsorship available for qualified candidates.
Full Job Description
Role

Every game on Pax Historia depends on our ability to send huge numbers of requests across many AI providers and get the right response back quickly, reliably, and cheaply.

We're hiring an engineer to own that system. You'll work on provider reliability, structured outputs, caching, routing, and monitoring. At the end of the day, you will need to:
  • Ensure that the 37+ models on our site reliably handle our 30 billion+ monthly tokens.
  • Reduce costs and latency for our 60k+ daily active users wherever possible.

You will not be in charge of model-training. We do not run model inference ourselves.

If you're obsessed with detail, data oriented, and have a strong tendency to verify everything, then this might be a great fit for you. We don't expect you to have done this exact job before, but we are expecting you to be a fast learner with extremely strong fundamentals.

Logistics

You'll be our 7th team member. We work in-person in San Francisco, 5+ days/week. We are open to sponsoring visas.

Comp will include meaningful equity to reflect your responsibility as a founding engineer.

Similar Jobs

More Jobs at Pax Historia

More Enterprise Technology Jobs

Find similar Founding Engineer - LLM Infra & Platform jobs: