Athelas

AI Agents Operations Associate

Athelas$70K — $95K *
Healthcare
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years of operational experience with a focus on QA/testing or related fields
  • Strong communication skills, both written and verbal
  • Attention to detail and ability to recognize patterns
  • Experience in fast-paced, ambiguous environments
  • Proactive attitude with a strong sense of ownership

Responsibilities

  • Test end-to-end voice agent call flows to ensure usability
  • Identify and document bugs and edge cases in agent performance
  • Log and prioritize issues by severity level for resolution
  • Validate successful agent actions within downstream healthcare systems
  • Embed with customer teams to understand and improve workflows
  • Collaborate with engineering and product teams to provide structured feedback
  • Support QA process scalability across internal and external teams

Benefits

  • Opportunity for rapid career advancement to Implementation Manager
  • Hands-on experience with live AI systems in healthcare
  • Direct interaction with customers and operations teams
  • High degree of ownership early in your career
  • Involvement in scaling AI technology across large healthcare environments
Full Job Description
About the Role

We're looking for an AI Agents Operations Associate to join our team on the frontlines of deploying and improving our voice agents.

This is a hands-on, forward-deployed role where you'll:
  • Test and QA live AI agents
  • Work directly with real patient call flows
  • Embed within customer operations when needed
  • Help ensure our agents perform reliably in high-stakes healthcare environments

You won't just be observing - you'll be actively shaping how AI systems behave in production.

This role is designed as a launchpad into an Implementation Manager role within ~6 months, for candidates who demonstrate strong ownership and execution.

This full-time position requires working 5 days a week in our Mountain View, CA office.

What You'll Do
Agent Testing & QA
  • Test end-to-end call flows (scheduling, rescheduling, cancellations, intake, etc.)
  • Identify bugs, edge cases, and breakdowns in agent behavior
  • Log, categorize, and prioritize issues across severity levels (critical / major / minor)
  • Validate that agent actions are correctly reflected in downstream systems (e.g., EHR)
Forward Deployment (Customer-Facing)
  • Embed with customer front desk / call center teams when needed
  • Operate as a live scheduler to deeply understand workflows
  • Act as a bridge between customer operations and engineering
  • Surface real-world insights to improve agent performance
Operational Excellence & QA Scaling
  • Support QA processes across internal and offshore teams
  • Review call transcripts, recordings, and agent decisions at scale
  • Help define and refine QA frameworks, rubrics, and best practices
  • Ensure consistency and quality across all testing workflows
Cross-Functional Collaboration
  • Partner closely with engineering, product, and operations teams
  • Provide structured feedback to improve agent logic and performance
  • Help iterate quickly on deployments in fast-moving environments


What We're Looking For
  • Highly detail-oriented with strong pattern recognition
  • Comfortable working in ambiguous, fast-changing environments
  • Strong communication skills (written + verbal)
  • Ability to break down real-world workflows and edge cases
  • Excited about AI and its real-world applications
  • Willingness to be onsite and occasionally embedded with customers
  • Scrappy, proactive, and willing to take ownership

Nice to Have
  • Experience in operations, QA, support, or healthcare environments
  • Exposure to call center workflows or customer support systems
  • Familiarity with structured testing or QA processes

Why This Role is Unique
  • Work on real AI systems in production - not demos or prototypes
  • Direct exposure to customers and live environments
  • High ownership early in your career
  • Clear path to Implementation Manager in ~6 months
  • Be part of scaling AI across large healthcare systems


The Opportunity

This is not a traditional entry-level role.

You'll be working at the intersection of:
  • AI systems
  • Healthcare operations
  • Real-world deployment

If you're excited about building, testing, and scaling AI in production environments, this role will give you unmatched exposure and growth.

About Athelas

Industry
Founded
2016

Similar Jobs

More Jobs at Athelas

More Healthcare Jobs

Find similar AI Agents Operations Associate jobs: