Dr First

Ambient Listening Engineer

Dr First$140K — $160K *
US-AnywhereRemote in United States
Healthcare
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years in software engineering with end-to-end production experience.
  • Experience with real-time audio/data pipelines (e.g., WebRTC, Kafka).
  • Proficiency in speech-to-text, NLP, or applied machine learning models.
  • Strong backend skills in Python, Go, or Java; able to work across stacks.
  • Hands-on builder preferred over theoretical design; quick prototype focus.
  • Experience in small, agile teams with overlapping roles.
  • Familiarity with cloud services (AWS, Azure, GCP) and Docker/Kubernetes.

Responsibilities

  • Design and maintain real-time audio capture and streaming pipelines.
  • Integrate and fine-tune ASR, diarization, and noise-suppression models.
  • Develop services/APIs to convert audio into structured clinical outputs.
  • Collaborate with cross-functional teams to rapidly prototype solutions.
  • Monitor and improve pipeline reliability and performance metrics.
  • Ensure compliance with privacy regulations like HIPAA.
  • Evaluate and integrate third-party speech/LLM models.

Benefits

  • Medical, dental, and vision insurance.
  • 401K with 50% company match after 3 months, 3-year vesting.
  • Generous HSA contributions for eligible HDHP employees.
  • 100% company-paid short/long-term disability and life insurance.
  • 18 days accrued PTO annually, increasing with service.
  • Continuing Education funding up to $1500 per year after 1 year.
  • Employee Assistance Program.
Full Job Description
Position Overview

DrFirst is seeking an Ambient Listening Engineer to join our Provider Solutions, eRx Retail team. You will build the technology that lets ambient AI quietly and reliably capture, transcribe, and structure spoken conversations, whether a provider-patient encounter or another clinical interaction, so information moves seamlessly to where it is needed. You will work at the intersection of real-time audio pipelines, speech and language models, and clinical workflow, with a bias toward shipping working software and iterating quickly alongside a small, tight-knit team. This role suits a developer who excels at hands-on implementation and thrives in a close-knit, collaborative environment.

What you will work on
  • Design, build, and maintain real-time and near-real-time ambient audio capture and streaming pipelines, from device and microphone input through transcription and downstream processing.
  • Integrate and fine-tune speech-to-text (ASR), speaker diarization, and noise-suppression models to maximize accuracy in noisy, multi-speaker clinical environments.
  • Build the services and APIs that turn raw ambient audio into structured, actionable output such as clinical notes, summaries, or discrete data elements for downstream systems.
  • Partner closely with product, clinical informatics, and design to translate ambiguous workflow problems into working prototypes quickly.
  • Own reliability, latency, and accuracy metrics for the ambient listening pipeline; instrument, monitor, and continuously improve them in production.
  • Implement privacy- and security-conscious handling of audio and derived data, in line with HIPAA and other applicable regulatory requirements.
  • Evaluate and integrate third-party and open-source speech and LLM models where they accelerate the roadmap, balancing build-vs-buy tradeoffs.
  • Participate in code reviews, design discussions, and the on-call rotation for the services you own.
Qualifications

Required Qualifications

  • 5+ years of professional software engineering experience, with a track record of shipping and operating production systems end to end.
  • Hands-on experience with real-time or streaming audio and data pipelines (e.g., WebRTC, gRPC streaming, Kafka, or similar).
  • Practical experience with speech-to-text, NLP, or applied machine learning models, whether integrating third-party APIs (e.g., Whisper, Deepgram, Azure Speech) or fine-tuning your own.
  • Strong backend engineering skills in a language such as Python, Go, or Java, and comfort working across the stack when needed.
  • A demonstrated preference for hands-on building over pure architecture or process; you would rather prototype and learn than spend weeks in design docs.
  • Experience working in a small, fast-moving team where roles overlap and everyone pitches in outside a narrow job description.
  • Familiarity with cloud infrastructure (AWS, Azure, or GCP) and containerized deployment (Docker, Kubernetes).
  • Clear written and verbal communication, and comfort collaborating directly with clinical or non-technical stakeholders.

Preferred Qualifications

  • Experience in healthcare technology, clinical documentation, or ambient/voice AI products specifically.
  • Familiarity with HIPAA, SOC 2, or other healthcare and security compliance frameworks.
  • Experience with LLM-based summarization or structured data extraction from unstructured text.
  • Background in audio signal processing or acoustics.
Physical Requirements
  • 90% Desk work
  • 10% Remote travel to client sites, conferences, or internal team meetings

#LI-GF1 #LI-Remote

Benefits
  • Competitive compensation, with a base salary of $140,000 - $160,000 (Exact compensation may vary based on skills and experience)
  • Eligible for a Discretionary Performance-based bonus
  • Medical, dental, and vision insurance
  • 401K eligible after 3 months of employment, with 50% company match up to first 5% of salary contributed to the plan with a 3-year vesting schedule
  • HSA for eligible employees enrolled in the HDHP, with a generous company contribution up to $500 for individual coverage and $1000 for family coverage per year
  • 100% company paid short and long-term disability, AD&D, and group life insurance
  • Accrued annual paid time off (PTO) of 18 days for the first 3 years of service, increasing thereafter and 7 paid holiday days
  • Employee Assistance Program
  • Continuing Education funds up to $1500 annually for eligible programs after 1 year of service
  • Voluntary benefits including FSA, Hospital indemnity, Accident and Critical Illness insurances

About Dr First

Dr First is a healthcare technology company that provides a variety of solutions to healthcare providers and patients. The company's products include electronic prescribing, medication management, and telehealth solutions. Dr First's solutions are designed to improve patient outcomes, reduce costs, and increase efficiency in healthcare delivery. The company serves a variety of healthcare providers, including hospitals, clinics, and pharmacies.
Learn more about Dr First
Size
500 employees
Industry
Founded
2000

Similar Jobs

More Jobs at Dr First

More Healthcare Jobs

Find similar Ambient Listening Engineer jobs: