The
Data Scientist role focuses on turning clinical conversations into accurate, useful documentation, with deep emphasis on building and evaluating the model and agent workflows (the "harness") that make these solutions reliable. The role blends applied data science, large language model (LLM) evaluation, prompt and workflow engineering, and hands-on collaboration with product and clinical stakeholders to move ideas from prototype to trustworthy, production-ready capability.
Key Responsibilities:- Partner with the product team in an exploratory, iterative fashion to design and prototype an ambient listening and documentation solution for the Home Infusion and Ambulatory Infusion space.
- Apply foundational and large language models to transform clinical audio and conversation into accurate, structured, and clinically useful documentation.
- Design, build, and refine the agentic harness (prompts, workflows, tool orchestration, and guardrails) that drives reliable ambient documentation.
- Develop rigorous evaluation frameworks to measure documentation accuracy, completeness, and clinical soundness, including gold-standard datasets, human review, error-mode analysis, and ongoing quality monitoring.
- Rapidly prototype and test approaches, using evaluation results to guide iteration and inform product direction.
- Collaborate with product, engineering, and clinical stakeholders to translate exploratory findings into production-ready capabilities.
- Contribute to responsible AI practices, including appropriate handling of sensitive healthcare data and attention to safety in clinical documentation.
- Perform other job duties as assigned.
Required Qualifications: - Bachelor's degree in a related field or equivalent work experience
- 2 - 4 years related work experience
Preferred Qualifications: - Healthcare industry experience, especially with healthcare data.
- Experience applying large language models or foundational models to speech, conversation, or documentation tasks.
- Experience with cloud technologies, including modern API orchestrators
- Experience designing evaluation methodologies for AI/ML or LLM systems (accuracy metrics, human review, annotation, error analysis).
- Experience with ambient documentation, speech-to-text, or clinical documentation workflows.
- Familiarity with infusion, home health, or ambulatory clinical workflows.
- Experience building agentic workflows, prompt engineering, or tool-orchestrated LLM applications.
- Proficiency in Python, and experience prototyping and iterating quickly alongside a product team.
Job Expectations:- Willing to work additional or irregular hours as needed
- Must work in accordance with applicable security policies and procedures to safeguard company and client information
- Must be able to sit and view a computer screen for extended periods of time
#LI-TC1
#LI-Onsite
Here are some of the exciting benefits full-time teammates are eligible to receive at WellSky:
- Excellent medical with Rx, dental, and vision benefits
- Mental Health support through EAP
- Generous paid time off, plus 13 paid holidays
- 100% vested 401(K) retirement plans
- Educational assistance up to $2500 per year
