Senior Machine Learning Engineer, Multimodal AI

Hike Medical

$130K — $180K *
Healthcare
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 5-7 years of experience in building production AI systems with a focus on LLMs and OCR.
  • Proven success in deploying applied AI products instead of merely prototyping.
  • Strong grasp of modern LLM workflows and their optimization.
  • Experience with document intelligence processes, including data extraction and classification.
  • Hands-on experience in voice or conversational AI systems, particularly in automation and transcripts.
  • Proficient in Python, with familiarity in production-level coding and backend services.
  • Experience with deploying AI in cloud environments like AWS, especially in serverless architectures.

Responsibilities

  • Build and enhance multimodal AI pipelines that convert various healthcare documents into structured data.
  • Design extraction and classification systems powered by LLMs for clinical workflows.
  • Refine document intelligence systems, focusing on OCR and low-quality input recovery.
  • Create voice AI solutions for patient interactions and workflow automation.
  • Develop evaluation benchmarks for assessing extraction quality and workflow accuracy.
  • Determine the most effective system (LLMs, deterministic logic) for each project task.
  • Collaborate with product teams to identify automation opportunities and implement solutions.
  • Optimize performance in terms of cost, latency, and reliability across AI model infrastructure.

Benefits

  • Flexible working environment with options for remote work.
  • Opportunity to work on high-impact projects that shape healthcare compliance.
  • Collaboration with a diverse team of experts in AI and healthcare.
  • Professional development opportunities in a fast-evolving field.
  • Work-life balance initiatives.
Full Job Description
The Role
As a Senior Machine Learning Engineer, you will build the intelligence layer that automates complex healthcare compliance and document procurement workflows. You will own systems that turn noisy, unstructured inputs such as faxes, phone transcripts, and operational data into reliable structured facts, decisions, and downstream actions.
This is not a pure research role. It is a product and systems role for someone who knows how to turn modern foundation models into dependable production infrastructure. You should be excited by messy real-world data, ambiguous edge cases, and high-leverage workflow automation. You will work across LLMs, OCR pipelines, voice AI, evaluation systems, and backend production infrastructure to help automate the DME process end to end.
What You'll Work On
  • Build and improve multimodal AI pipelines that process healthcare documents, OCR output, transcripts, and workflow context into structured facts and decisions.
  • Design LLM-powered extraction, classification, validation, and routing systems for operational and clinical workflows.
  • Improve document intelligence systems across OCR, schema extraction, confidence scoring, error handling, and low-quality input recovery.
  • Develop voice AI workflows for patient and provider outreach, transcript understanding, post-call extraction, and follow-up automation.
  • Create evaluation harnesses, benchmarks, and regression tests for extraction quality, hallucination prevention, workflow accuracy, and model changes.
  • Decide when to use LLMs, deterministic logic, retrieval, human review, or hybrid systems to maximize quality and reliability.
  • Partner with product and engineering to identify the highest-leverage automation opportunities and translate them into shipped systems.
  • Optimize cost, latency, and reliability across model providers and infrastructure layers.
  • Work closely with backend engineers to deploy AI systems into our AWS and serverless environment with strong observability and operational rigor.


Technical Requirements
  • Strong experience building production AI systems around LLMs, OCR, and unstructured data workflows.
  • Proven track record shipping applied AI products, not just prototyping models offline.
  • Deep familiarity with modern LLM workflows including prompting, structured outputs, tool use, retries, fallbacks, guardrails, and model evaluation.
  • Experience with document intelligence systems such as OCR pipelines, document extraction, classification, post-processing, and confidence-based review flows.
  • Experience with voice or conversational AI, or adjacent systems involving transcripts, call automation, and conversational extraction.
  • Strong proficiency in Python and comfort working in production codebases with APIs, queues, and backend services.
  • Experience deploying and operating AI systems in AWS or similar cloud environments, including serverless or event-driven architectures.
  • Strong instincts around evaluation, benchmarking, monitoring, and quality assurance for real-world AI systems.
  • Ability to work across structured and unstructured data and design systems that are robust to noisy, incomplete, and ambiguous inputs.


Nice to Have
  • Experience in healthcare, claims, revenue cycle, or regulated operational environments.
  • Experience with human-in-the-loop workflow design and review tooling.
  • Familiarity with telephony vendors, speech systems, or conversational agent infrastructure.
  • Experience comparing and routing across model providers such as OpenAI, Anthropic, Bedrock, or equivalent.
  • Experience designing internal tools or operational systems used directly by workflow teams.
  • Background in machine learning, applied NLP, information extraction, or related fields.

Similar Jobs

More Jobs at Hike Medical

More Healthcare Jobs

Find similar Senior Machine Learning Engineer, Multimodal AI jobs: