5+ years in QA, SDET, Test Engineering, or product engineering with a strong testing focus
Hands-on experience with a modern e2e framework, preferably Playwright
Comfortable with TypeScript / JavaScript for test suite extension and bug reporting
Experience in testing complex, distributed systems such as APIs and real-time services
Regularly use AI coding agents like Claude Code or Cursor
Self-directed approach to identify issues without waiting for specifications
Strong written communication skills, especially for bug reports and test plans
Empathy for customers and a proactive approach to outcomes.
Responsibilities
Build and deploy real assistants using Vapi and test with main provider integrations
Get accustomed to the e2e test framework and create Playwright tests
File bugs and analyze the weakest coverage areas
Own release testing for a major product area and gain engineers' trust
Enhance automated coverage in your area
Collaborate with engineers on testing strategies for new features
Utilize AI coding agents to boost test scenario throughput and regression coverage
Benefits
Competitive salary and equity ownership
Comprehensive medical, dental, and vision coverage
Quarterly off-site gatherings for team bonding
Flexible time off policy
Catered meals, transportation benefits, gym access, and a $10k annual learning and development budget
Full Job Description
What You'll Do:
First 30 Days:
Build and deploy real assistants on Vapi, run live calls and simulations across our main provider integrations (LLMs, STT, TTS, telephony), and break the product in at least a few interesting ways.
Get up and running in our existing e2e test framework and ship your first Playwright tests against the dashboard.
File bugs that engineers fix, and develop a working point of view on where our coverage is weakest.
By 60 Days:
Own release testing for at least one major product area (assistant builder, simulations, monitoring, knowledge base, or versioning), and earn engineers' trust to gate it.
Meaningfully improve automated coverage in your area.
Partner with engineers on test strategy for new features before they ship.
Use AI coding agents to multiply your throughput on test scenarios and regression coverage.
By 90 Days:
Operate as a full peer to engineers on the team, owning QA across the product surface without handholding.
Extend our testing practices and contribute patterns the rest of the team picks up.
Be involved in new features from the start, with the automation suite meaningfully larger on your watch.
Who You Are:
Must-Haves
5+ years in QA, SDET, Test Engineering, or product engineering with a strong testing focus.
Hands-on with at least one modern e2e framework - Playwright preferred; Cypress, Selenium, or equivalent are fine.
Comfortable reading and writing TypeScript / JavaScript well enough to extend our test suite and file bugs with a hypothesis attached.
Track record testing complex, distributed systems with real failure modes - APIs, integrations, real-time behavior, anything where "correct" isn't a fixed string.
Daily use of AI coding agents (Claude Code, Cursor, or similar) with opinions about where they help and where they don't.
Self-directed: you read the PR, open the product, and start finding what's broken without waiting for a spec.
Strong written communication, especially in bug reports and test plans.
Customer empathy and a bias for action: you ship, you own outcomes, and you care what users actually experience.
Nice-to-Haves
Background in voice AI, conversational AI, LLM applications, or telephony.
Experience with LLM evals or testing non-deterministic systems.
Worked on a developer-facing product - APIs, SDKs, dashboards - where the audience is technical.
Early-stage startup experience; comfortable with ambiguity and shifting priorities.
Open-source contributions or public writing on testing, evals, or QA practice.
What We Offer:
Real stake: Competitive salary and excellent equity ownership.
Comprehensive health coverage: medical, dental, and vision plans.
Team love: We love hanging out, and we do quarterly off-sites.
Flexible time off: take what you need.
More: catered meals, transportation, gym, and a $10k annual L&D budget.
