AI Engineer, Internal Systems

Wispr Flow

$125K — $150K *
US-AnywhereRemote in San Francisco, CA
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Experience building internal tools adopted by engineering teams with measurable impact.
  • Deep familiarity with agentic coding tools; able to articulate strengths and weaknesses.
  • Proven track record in developing evaluation or verification infrastructure (test harnesses, CI systems, etc.).
  • Hands-on capability across application code and infrastructure, including unfamiliar systems.
  • Empirical approach to work; able to identify and resolve subtle failure modes in ambiguous situations.

Responsibilities

  • Build verification loops for agents to determine completion of tasks.
  • Create robust testing environments and derive durable evaluation signals from failures.
  • Enhance delivery of context, instructions, skills, and memory to improve agent performance.
  • Operate and assess the agent fleet as a production system, measuring quality and impact.

Benefits

  • Sponsorship for H1B, O1, EB1, L1, STEM OPT, and more available depending on role.
  • Commitment to a fair and accessible interview process with accommodations offered.
Full Job Description
About the role

Our agents already write code and respond to incidents around the clock, but they can't yet tell when they're done, so every loop still ends with a human checking. You'd be the first to build the verification and evaluation layer that lets them finish with confidence.

What you'll do
  • Build end-to-end verification loops that let agents determine when their work is actually complete
  • Create fast, reliable testing environments and turn failures and human feedback into durable evaluation signals
  • Improve how context, instructions, skills, and memory are delivered to agents-and measure what makes them perform better
  • Operate the agent fleet as a production system and measure its quality, adoption, and impact


You may be a fit if
  • You've built internal tools that other engineers adopted, and you can explain how you measured their impact
  • You use agentic coding tools deeply and have specific opinions about where they succeed and fail
  • You've built evaluation or verification infrastructure such as test harnesses, CI systems, eval pipelines, or benchmarks
  • You can work hands-on across application code, infrastructure, and unfamiliar systems
  • You are empirical about your own work, attentive to subtle failure modes, and comfortable owning ambiguous problems

Prior experience in voice, model training, or our product domains is not required.

Get to know us
  • Our Series B
  • Advancing HCI
  • Introducing Wispr Advanced Interfaces Lab
  • Technical challenges behind Flow


Logistics

We sponsor H1B, O1, EB1, L1, STEM OPT, and more. We can't guarantee sponsorship for every role, but if we make you an offer we'll make every reasonable effort, with help from our immigration law firm.

We strongly encourage you to apply even if you don't meet every qualification. The strongest candidates we meet rarely do, so don't exclude yourself prematurely. We're rethinking how humans interact with AI, and doing that well demands diversity of perspective and experience.

We're committed to a fair and accessible interview process. If you need any accommodations or adjustments, please let us know.

Similar Jobs

More Jobs at Wispr Flow

More Information Technology Jobs

Find similar AI Engineer, Internal Systems jobs: