About this roleWe generate audio data for the world's leading speech and audio labs. Data only matters if it makes a customer's model measurably better, and finding out whether it does is your job. As a Forward Deployed Engineer, Production, you'll own the loop between a customer's model, our research team, and our data production. In a typical week you'll run an ablation on Monday, see a signal on Tuesday, change how we collect data on Wednesday, and ship a recommendation that makes it to the customer by Friday. You'll be shipping something on the order of days, not weeks.
This role is for someone who is equally comfortable in a codebase, translating customer requirements into how we produce data, and in the details of how we ship product features to yield data that improves our customers' models. You'll care about why a model regressed, and also about which recording setup, product experience, or automated QA step caused it.
In this role, you will- Run the daily experiment loop. Turn customer questions into fast, rigorous experiments, get results in days, and iterate until the answer is clear enough to act on.
- Design ablations and benchmarks that change decisions. Work with our research engineers to isolate what drives model behavior. Then translate the results into concrete changes in what we collect, how we collect it, and how we filter and weight it.
- Develop operational intuition for data quality. Get close to how our data is produced, including recording conditions, contributor pools, annotation, and QA, so you can trace model outcomes back to operational causes and fix them at the source.
- Build the tooling that makes speed possible. Ship the eval harnesses, pipelines, and analysis tools that make the next experiment faster than the last, across every customer.
- Close the loop with the model improvement lifecycle. Make sure what you learn changes what we produce, so our data keeps improving the models that depend on it.
- Shape how we work. Help define our experimentation practices, engineering culture, and roadmap as the team grows.
Your background looks like- AI-native coding experience with a track record of fast, impact-driven experiments and product features across the stack.
- Strong problem-solving skills and the ability to work independently or as part of a collaborative team.
- Ability to translate open-ended research questions into concrete experiments and clear recommendations.
- Excellent communication skills, with the ability to explain technical findings to both researchers and non-technical stakeholders.
- Desire to thrive in a fast-paced, dynamic environment and adapt quickly as the audio AI field evolves.
- Excited to join our team in-person in San Francisco.
Bonus points if you have- At least 3 years of relevant engineering or product experience (product engineering, ML engineering, or applied research)
- Degree in computer science, electrical engineering, or a related technical field, or equivalent practical experience.
- Experience working with audio or speech models, or with audio/signal data more broadly.
- Familiarity with machine learning research workflows - training, fine-tuning, evaluation, and metrics.
- Experience working directly with technical or enterprise customers.
Benefits- Unlimited PTO.
- Top-notch health, dental, and vision coverage with 100% coverage for most plans.
- FSA & HSA access.
- 401k access.
- Meals 2x daily through DoorDash + snacks and beverages available at the office.
- Unlimited company-sponsored Barry's classes.
VisasWe sponsor international candidates across a range of visa types, including H-1B transfers, H-1B1, O-1, E-3, and TN, and we support STEM OPT. While we can't guarantee any individual outcome, we've successfully sponsored teammates from all over the world.
