Role OverviewWe are looking for
licensed physicians currently practicing in the United States to support the evaluation and improvement of advanced AI systems in healthcare.
The role involves reviewing AI-generated clinical content for
medical accuracy, safety, completeness, and relevance, including diagnoses, treatment plans, summaries, and other case-based outputs. You will apply real-world clinical judgment to identify errors, unsafe recommendations, missing information, and weak reasoning, helping improve the quality and reliability of medical AI systems.
CONTRACT: Contractor assignment, 12 weeks
COMMITMENT: Part-time or Full-time (20-40h/week)
LOCATIONS: Remote - USA
PROCESS: The selection will be made based on an online questionnaire and resume/education/certification
NOTES: Candidates must be fully licensed and actively practicing medicine in the US.
Key Responsibilities- Review AI-generated medical content for accuracy, safety, and completeness.
- Evaluate diagnoses, treatment plans, case summaries, and clinical reasoning.
- Identify inaccurate, unsafe, misleading, or incomplete medical outputs.
- Apply evidence-based medical standards and professional clinical judgment.
- Provide structured expert feedback to improve model quality.
- Follow detailed evaluation and annotation guidelines.
- Complete structured questionnaires and reviews using web-based tools.
- Collaborate with clinical and AI teams on quality improvement.
Requirements- Medical Doctor (MD) or equivalent medical qualification such as MBBS, MBChB, or equivalent.
- Fully licensed to practice medicine in the United States.
- Currently actively practicing medicine in the US.
- At least 1 year of post-residency clinical practice experience as a physician.
- Strong general clinical judgment; no specific specialty is required.
