AI Orchestration Architect

Biorce

$135K — $160K *
Enterprise Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • 8+ years in backend or infrastructure engineering with architecture-level ownership
  • 1-2 years experience building AI/agentic platforms in production
  • Proven track record of designing and operating distributed systems
  • Strong proficiency in Python or a similar language
  • Deep knowledge of cloud infrastructure (GCP, AWS)
  • Experience with containerization and orchestration tools like Kubernetes
  • Expertise in designing APIs and service boundaries at scale
  • Solid grasp of security fundamentals like authentication and secrets management

Responsibilities

  • Set technical architecture for orchestration layer powering AI agents
  • Ensure reliability, latency, and cost efficiency of agent execution
  • Design and evolve a platform SDK for AI engineering teams
  • Define security boundaries, quota management, and multi-tenant isolation
  • Collaborate to expose model capabilities through platform APIs
  • Establish standards for CI/CD pipelines for agent deployment
  • Design API gateways for routing, rate limiting, and cost attribution

Benefits

  • Comprehensive private health coverage for physical and mental well-being
  • Hybrid work model for flexibility
  • Opportunities for social engagement through company events
  • Provision of a MacBook to enhance productivity
  • Pet-friendly office environment
Full Job Description
About the role

We're looking for a curious and pragmatic Platform Architect to join our growing AI Open Source team in Austin, Texas. You'll set the technical direction for the orchestration layer and SDK that every other AI team at the company depends on - durable, multi-tenant, and fast to iterate against. Your work sits underneath an AI-powered product that is transforming how clinical trials are run, so reliability and security aren't afterthoughts, they're core to the job.

You'll partner closely with our AI Scientists and embedded AI Engineers, and mentor the Platform Engineers building alongside you, giving you visibility and influence over how the whole AI stack fits together. This is an exciting opportunity to join a fast-paced biotech AI startup at an early stage of its growth, as we continue expanding our US presence.

Key Responsibilities

  • Set the technical architecture for the orchestration layer that powers our AI agents in production
  • Own the reliability, latency, and cost of agent execution at scale
  • Design and evolve a platform SDK used across every AI engineering team
  • Define multi-tenant isolation, quota management, and security boundaries
  • Partner with AI Scientists and AI Engineers to expose model and evaluation capabilities through platform APIs
  • Set standards for CI/CD pipelines used for agent deployment
  • Design API and model gateways for routing, rate limiting, and cost attribution
  • Collaborate with our broader platform team to extend and harden shared infrastructure
  • Mentor Platform Engineers and review key architectural decisions
  • Participate in on-call rotation and incident response for production systems


Required Experience & Skills

  • 8+ years of experience in backend or infrastructure engineering, including architecture-level ownership
  • At least 1-2 years of that experience specifically building or operating AI/agentic platforms in production
  • Track record of designing and operating distributed systems in production
  • Strong proficiency in Python or a comparable language
  • Deep experience with cloud infrastructure (e.g., GCP, AWS)
  • Familiarity with containerization and orchestration (e.g., Kubernetes)
  • Experience designing APIs and service boundaries at an organizational scale
  • Solid understanding of security fundamentals (authN/authZ, secrets management)
  • Experience setting technical direction and standards for a team
  • Familiarity with open-source agentic AI libraries and/or durable-execution orchestrators


Nice-to-Have Skills

  • Experience building or operating agentic AI systems
  • Experience in a regulated industry (healthcare, biotech, fintech)
  • Contributions to open-source infrastructure projects
  • Experience mentoring engineers or leading technical initiatives


Who We're Looking For

  • Someone who enjoys building foundational systems that other engineers rely on
  • A pragmatic problem-solver who balances speed with long-term maintainability
  • Someone comfortable operating in ambiguity at an early-stage startup
  • A collaborative teammate who communicates clearly across disciplines


Why Join Us?

  • The opportunity to help build the talent engine behind a fast-growing Healthtech AI company.
  • A dynamic work environment with an international team, where collaboration and diversity thrive.
  • Work alongside top talent, united by a shared purpose and committed to making a real impact.
  • Comprehensive private health coverage to ensure your physical and mental well-being.
  • Hybrid work model offering flexibility to balance your professional and personal life.
  • Company events to celebrate achievements and enjoy time together.
  • Get equipped with a MacBook to enhance your productivity and work experience.
  • Our office is pet-friendly! You'll likely be greeted by a few wagging tails upon arrival.


Similar Jobs

More Jobs at Biorce

More Enterprise Technology Jobs

Find similar AI Orchestration Architect jobs: