Psychometrician, Office of Assessment and Evaluation (PhD) (Phoenix) Posting Number req26602
Department COM Phx Biomedical Informatics
Department Website Link College of Medicine-Phoenix Medical Sub-Speciality Location Greater Phoenix Area
Address 475 N. 5th Street, Phoenix, AZ 85004 USA
Position Highlights The Office of Assessment and Evaluation (OAE) at the University of Arizona College of Medicine - Phoenix is currently seeking a psychometrician to join our team. In this role, the psychometrician will lead psychometric activities related to examinations and assessments, while advancing methods, processes and best practices in the measurement of medical knowledge, clinical skills and overall MD program evaluation.
The successful candidate will fulfill the responsibilities of a faculty member in the Department of Biomedical Informatics, actively participate in teaching, clinical service and/or scholarly work and must qualify for an appointment at the rank of assistant or associate professor. The successful candidate will meet the requirements of a career track faculty according to the College and University guidelines.
This career-track appointment is not eligible for tenure.
Visa sponsorship is not available for this positions. Duties & Responsibilities Reporting to the assistant dean of Assessment and Evaluation, the psychometrician will have the following primary responsibilities:
- Perform item analysis, item response theory (IRT) calibrations, scoring, equating, standard setting and validity and reliability studies across multiple assessments. These include, but are not limited to, knowledge-based and clinical assessments in both the pre-clerkship and clerkship phases of the MD program.
- Conduct comprehensive assessment data analyses to support continuous quality improvement and ensure compliance with accreditation standards, including those of the Liaison Committee on Medical Education (LCME). Analyses include, but are not limited to, descriptive and inferential statistics; retrospective and prospective analyses; and cross-sectional and longitudinal analyses of assessment and program data.
- Develop, maintain and continuously improve operational psychometric processes to enhance efficiency, accuracy and scalability.
- Collaborate with subject matter experts and exam developers in item writing, item review and the design, development and evaluation of assessments.
- Design and build robust infrastructure for assessment data architecture, enabling efficient querying, rapid data retrieval and timely, accurate responses to data requests.
- Collaborate on research and development initiatives within OAE and across the institution and disseminate findings to the broader medical education community through presentations and peer-reviewed publications.
- Provide expert consultation on research design, measurement, statistical methodologies and data systems.
- Develop and maintain a comprehensive dashboarding system for student assessment data to support real-time insights and data-informed decision-making.
- Other duties as assigned.
Minimum Qualifications - Hold a PhD in educational or psychological measurements, statistics or a related field from an accredited institution.
- Have a minimum of one to three years' of relevant experience.
Preferred Qualifications - Demonstrate proficiency in statistical analysis and IRT software, including (but not limited to) SAS and R.
- Have strong knowledge and applied experience in psychometric principles, including item response theory (e.g., item calibration, item evaluation, linking/equating, and IRT-based scoring), classical test theory and standard setting methodologies.
- Demonstrate outstanding interpersonal communication and professionalism skills.
Rank Associate Professor
Tenure Information Career-Track (CT)
FLSA Exempt
Full Time/Part Time Full Time
Number of Hours Worked per Week 40
Job FTE 1.0
Work Calendar Fiscal
Job Category Faculty
Benefits Eligible Yes - Full Benefits
Rate of Pay AAMC Public Schools for Rank and Specialty
Compensation Type salary at 1.0 full-time equivalency (FTE)
Type of criminal background check required: Name-based criminal background check (non-security sensitive)
Number of Vacancies 1
Target Hire Date Expected End Date Contact Information for Candidates Office of Human Resources, Talent Acquisition
[email protected]Open Date 7/23/2026
Open Until Filled Yes
Documents Needed to Apply Curriculum Vitae (CV), Cover Letter, and One Additional Document
Special Instructions to Applicant Application: The online application should be completed in its entirety. Blank or missed information may be considered an incomplete submission.
CV, cover letter and one additional document required for the position. One additional document will be professional reference contacts. Please include at least three professional references at your current rank or above, their contact information and the nature of your work with them.
Faculty selected for this teaching opportunity will be required to obtain faculty status within the appropriate academic department. This will include obtaining letters of recommendation and review by the appropriate College review committee.
