AI Orchestration Engineer

Biorce

$120K — $145K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years in backend or infrastructure engineering
  • Experience with production distributed systems
  • Proficient in Python or similar language
  • Knowledge of cloud infrastructure (GCP, AWS)
  • Familiar with containerization and orchestration tools (like Kubernetes)
  • API and service boundary design experience
  • Understanding of security fundamentals (authN/authZ, secrets management)
  • CI/CD pipeline experience

Responsibilities

  • Build the core orchestration layer for AI agents
  • Enhance reliability, latency, and cost-efficiency of agent execution
  • Develop and maintain a platform SDK for AI engineering teams
  • Implement multi-tenant isolation, quota management, and security measures
  • Collaborate with AI Scientists and Engineers to expose APIs for model capabilities
  • Establish and manage CI/CD pipelines for deploying agents
  • Design gateways for routing, rate limiting, and cost tracking

Benefits

  • Opportunity to contribute to a growing Healthtech AI company
  • Dynamic, collaborative work environment with diverse teams
  • Work alongside skilled professionals dedicated to impactful solutions
  • Comprehensive private health coverage for overall well-being
  • Hybrid work model for a healthy work-life balance
  • Company events for team bonding and celebration
  • Provided with a MacBook for enhanced productivity
  • Pet-friendly office environment
Full Job Description
About the role

We're looking for a curious and pragmatic Platform Engineer to join our growing AI Open Source team in Austin, Texas. You'll help build the orchestration layer and SDK that every other AI team at the company depends on - durable, multi-tenant, and fast to iterate against. Your work sits underneath an AI-powered product that is transforming how clinical trials are run, so reliability and security aren't afterthoughts, they're core to the job.

You'll partner closely with our Platform Architect, AI Scientists, and embedded AI Engineers, giving you visibility into how the whole AI stack fits together. This is an exciting opportunity to join a fast-paced biotech AI startup at an early stage of its growth, as we continue expanding our US presence.

Key Responsibilities

  • Help build the core orchestration layer that powers our AI agents in production
  • Contribute to the reliability, latency, and cost of agent execution at scale
  • Build and maintain a platform SDK used across every AI engineering team
  • Implement multi-tenant isolation, quota management, and security boundaries
  • Partner with AI Scientists and AI Engineers to expose model and evaluation capabilities through platform APIs
  • Build and maintain CI/CD pipelines for agent deployment
  • Help design API and model gateways for routing, rate limiting, and cost attribution
  • Collaborate with our broader platform team to extend and harden shared infrastructure
  • Participate in on-call rotation and incident response for production systems


Required Experience & Skills

  • 5+ years of experience in backend or infrastructure engineering
  • Experience building and operating distributed systems in production
  • Strong proficiency in Python or a comparable language
  • Experience with cloud infrastructure (e.g., GCP, AWS)
  • Familiarity with containerization and orchestration (e.g., Kubernetes)
  • Experience designing APIs and service boundaries
  • Solid understanding of security fundamentals (authN/authZ, secrets management)
  • Experience working with CI/CD pipelines
  • Familiarity with open-source agentic AI libraries and/or durable-execution orchestrators


Nice-to-Have Skills

  • Experience building or operating agentic AI systems
  • Experience in a regulated industry (healthcare, biotech, fintech)
  • Contributions to open-source infrastructure projects
  • Experience mentoring engineers or leading technical initiatives


Who We're Looking For

  • Someone who enjoys building foundational systems that other engineers rely on
  • A pragmatic problem-solver who balances speed with long-term maintainability
  • Someone comfortable operating in ambiguity at an early-stage startup
  • A collaborative teammate who communicates clearly across disciplines


Why Join Us?

  • The opportunity to help build the talent engine behind a fast-growing Healthtech AI company.
  • A dynamic work environment with an international team, where collaboration and diversity thrive.
  • Work alongside top talent, united by a shared purpose and committed to making a real impact.
  • Comprehensive private health coverage to ensure your physical and mental well-being.
  • Hybrid work model offering flexibility to balance your professional and personal life.
  • Company events to celebrate achievements and enjoy time together.
  • Get equipped with a MacBook to enhance your productivity and work experience.
  • Our office is pet-friendly! You'll likely be greeted by a few wagging tails upon arrival.


Similar Jobs

More Jobs at Biorce

More Information Technology Jobs

Find similar AI Orchestration Engineer jobs: