Otter.ai

Staff Machine Learning Engineer

Otter.ai$278K — $330K *
Information Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's or Master's degree in Computer Science or a related field, with 10+ years of industry experience; PhD preferred.
  • Deep expertise in building and fine-tuning large language or foundation models, particularly in ASR and NLP systems.
  • Strong command of modern ML research, with a focus on practical application in production settings.
  • Extensive experience deploying, scaling, and operating ML systems in production environments.
  • Proficient in handling large-scale speech and conversational datasets, focusing on quality and preprocessing.
  • Excellent cross-functional collaboration skills with the ability to drive end-to-end outcomes.
  • Proven ability to lead technical projects independently and make architectural decisions.

Responsibilities

  • Architect, build, and evolve large-scale SID/ASR/NLP systems for critical product features.
  • Lead design and implementation of training and inference strategies for large models using PyTorch and/or JAX.
  • Improve model architectures, decoding strategies, and loss functions based on production and research insights.
  • Own the ML system lifecycle from research to production deployment and maintenance.
  • Collaborate with product and infrastructure teams to translate research into scalable systems.
  • Drive system performance improvements using real-world conversational data.
  • Set the technical direction for ML pipelines, evaluation frameworks, and deployment in a cloud environment.

Benefits

  • Diverse and inclusive work environment with a commitment to equality.
  • Opportunities for collaboration with industry veterans and innovators.
  • Growth potential in a rapidly evolving AI sector.
  • Access to cutting-edge technology and resources for professional development.
Full Job Description
The OpportunityDo you want to lead projects to build and deploy cutting-edge AI technology to help people get unparalleled value from meetings and conversations? Join our core AI team responsible for ML and work alongside industry-veteran scientists and engineers. As a Staff Machine Learning Engineer, you'll bring your strong software engineering mindset to machine learning in order to scale and optimize our ML systems-creating and transforming innovative research into production-ready features that power Otter's summarization and conversational intelligence products.

Your Impact
  • Architect, build, and evolve large-scale SID / ASR / NLP / LLM systems that power mission-critical product experiences including summarization, chat, and speech understanding across millions of conversations.
  • Lead the design and implementation of training, fine-tuning, post-training, and inference strategies for large language and speech models using PyTorch and/or JAX, making principled trade-offs across quality, latency, cost, and reliability.
  • Design and improve model architectures, loss functions, decoding strategies, and training techniques for speech and language models, informed by both research and production constraints.
  • Own end-to-end ML system lifecycles, from research prototyping through production deployment, monitoring, iteration, and long-term maintenance.
  • Partner deeply with product, and infrastructure teams to develop and translate cutting-edge research into scalable, production-grade systems that deliver measurable user and business impact.
  • Drive system-level improvements in model performance, robustness, observability, and operational excellence using real-world conversational data at scale.
  • Set technical direction and best practices for ML infrastructure, data pipelines, evaluation frameworks, and deployment workflows in a cloud environment.
  • Identify and resolve complex, ambiguous problems in model behavior, data quality, scaling, and system interactions, often before they surface as user-visible issues.
  • Mentor and elevate other engineers, influencing team standards, reviewing designs, and contributing to a culture of strong technical decision-making and execution.
  • Influence applied research and technical roadmaps by identifying promising speech and multimodal modeling approaches, and driving their validation and adoption into production systems

We're Looking for Someone Who
  • Holds a Bachelor's or Master's degree in Computer Science or a related field with 10+ years of relevant industry experience; PhD is preferred.
  • Has deep, hands-on experience building and fine-tuning large language or foundation models, with production experience in ASR, TTS, multimodal, or modern LLM/NLP systems, and a strong understanding of model failure modes and trade-offs.
  • Demonstrates strong command of modern ML research, with the ability to critically evaluate new papers and drive innovation by identifying what is production-worthy versus experimental.
  • Has extensive experience deploying, scaling, monitoring, and operating ML systems in production across training, inference, and serving infrastructure, including model versioning, rollback strategies, and performance regression detection while balancing cost, latency, and reliability constraints.
  • Is comfortable working with large-scale speech and conversational datasets, including data preprocessing, augmentation, quality analysis, and labeling strategies to support model training and evaluation.
  • Is highly effective at cross-functional collaboration, working end-to-end with product, infra, research, and data teams to deliver outcomes, not just models.
  • Can lead technical projects independently, driving clarity in ambiguous problem spaces and making sound architectural decisions.
  • Has experience with or strong interest in agentic systems, tool-use frameworks, or multi-model orchestration.
  • Has demonstrated ability to influence beyond their immediate team, shaping technical direction, standards, or long-term strategy.
  • Experience with personalization, recommendation systems, or user modeling is a plus

Salary range

Salary Range: $278,000 to $330,000 USD per year.

This salary range represents the low and high end of the estimated salary range for this position. The actual base salary offered for the role is dependent based on several factors. Our base salary is just one component of our comprehensive total rewards package.
#LI-Hybrid

About Otter.ai

Otter.ai is an AI-powered transcription service that uses machine learning algorithms to transcribe audio and video recordings. The platform is used by businesses, journalists, and other professionals to transcribe interviews, meetings, and other recordings. Otter.ai's platform is designed to be easy to use and offers a range of features, including real-time transcription and collaboration tools.
Learn more about Otter.ai
Size
100 employees
Industry

Similar Jobs

More Jobs at Otter.ai

More Information Technology Jobs

Find similar Staff Machine Learning Engineer jobs: