LocationNew York, New York
Shift:Day (United States of America)
Description:Position Summary The Data Scientist is responsible for the evaluation of deployed interventions across the healthcare system. They will design evaluation methods to assess the performance and impact of decision support systems, both process interventions and AI powered solutions. This role works closely with stakeholders to ensure models are safe, interpretable, and aligned with organizational goals.
Essential Job Duties - Engineer high-quality metrics (process, performance, and/or outcome) for validation and impact evaluations.
- Design novel retrospective, prospective, quasi-experimental, and experimental evaluation methods.
- Conduct error analysis, fairness checks, and bias detection
- Monitor model and/or intervention performance in production and respond to drift
- Translate stakeholder needs into measurable evaluation requirements
- Document evaluation decisions and maintain reproducible workflows
- Collaborate across teams to ensure evaluations drive meaningful decision making
- Performs other special projects and duties as assigned.
Required Qualifications - Bachelor's or Master's degree in a quantitative field (or equivalent experience)
- Strong Python/R programming and SQL skills
- 3+ years of experience with evaluation design and ML model validation
- Working knowledge of HIPAA and PHI handling requirements
- Strong documentation practices and commitment to reproducibility
Preferred Qualifications- Experience with prospective experimental design methods.
- Experience developing novel measures from complex EHR data elements and workflows
- Strong experience analyzing and deriving insights from complex healthcare data, including EHR and claims.
Please note that all roles require on-site presence (variable by role). Therefore, all employees should live within a commutable distance to NYP.
NYP will not reimburse for travel expenses.
Salary Range:$74,000-$111,000/Annual
It all begins with you. Our amazing compensation packages start with competitive base pay and include recognition for your experience, education, and licensure. Then we add our amazing benefits, countless opportunities for personal and professional growth and a dynamic environment that embraces every person. Join our team and discover where amazing works.
