WHAT YOU'LL DO As a Psychometrician, you will be responsible for assembling, analyzing, and scoring Ascend Learning's assessment instruments across a wide range of educational programs-including nursing, allied health, emergency services, fitness, and other high-growth professions. You will apply psychological principles and statistical methods to ensure the reliability, validity, and fairness of our assessments, supporting product development and ensuring the accuracy of scores provided to clients. In addition to operational psychometric work, you will design and conduct efficacy studies, predictive validity research, and other investigations that enhance the use and impact of our assessments and learning products.
WHERE YOU'LL WORK This position offers flexibility of remote work within the United States. Occasional travel will be required.
HOW YOU'LL SPEND YOUR TIME- Perform psychometric and statistical analyses using Classical Test Theory (CTT) and Item Response Theory (IRT) and interpret results to inform decision-making
- Communicate complex psychometric concepts clearly and effectively - both orally and in writing - to diverse audiences, including non-technical stakeholders
- Collaborate with cross-functional teams to identify challenges and develop solutions related to product development and client services (internal and external)
- Analyze current and emerging measurement challenges, conduct research, and propose actionable solutions, and communicate findings in a clear and impactful manner
- Contribute to research initiatives aimed at enhancing the fairness, validity, and effectiveness of assessments and learning products
- Contribute to analyzing and reporting on state and national pass rates and retention
- Design and conduct efficacy evaluations of learning products and assessments
- Design and conduct predictive validity research
- Document and disseminate research findings through presentations, reports, or publications to support internal and external stakeholders
WHAT YOU'LL NEED- PhD or equivalent doctoral degree in educational research, measurement and statistics, or educational psychology is required. Candidates must have completed graduate-level coursework in measurement theory, test equating, and advanced statistical modeling (e.g., multivariate modeling, structural equation modeling)
- 3+ years of relevant work experience is required, with a preference for experience in certification or licensing exam development
- Experience conducting job task analyses to identify the knowledge, skills, and abilities required for competent performance in a profession
- Ability to lead or support standard-setting studies, including coordination with subject matter experts to establish defensible passing scores
- Demonstrated proficiency in SAS, R, and Python for data manipulation, statistical analysis, and psychometric modeling
- Experience conducting operational psychometric analyses (e.g., Rasch analysis, equating, item analysis, DIF) and producing technical documentation such as statistical summary reports, policy and procedure manuals, professional manuscripts, and presentations)
- Experience conducting psychometric research, including study design, data collection, data analysis, and dissemination of results
- Skill in conveying complex, technical, or quantitative information to non-technical audiences.
- Experience designing and conducting efficacy evaluations of learning products and assessments
- Experience designing and conducting predictive validity research
- Experience designing and conducting research on differences in student usage or performance across student demographic groups
- Strong written and verbal communication skills, with the ability to convey complex, technical, and quantitative information to non-technical audiences
- Excellent time management skills, including the ability to prioritize tasks, meet deadlines consistently, and maintain high attention to detail
- Basic proficiency in database management, including working with relational tables, developing data integrity protocols, and creating visualizations such as charts and graphics
- Experience in planning and facilitating exam-related meetings and workshops (e.g., job/practice analysis, standard-setting, item development) preferred
BENEFITS - Flexible and generous paid time off
- Competitive medical, dental, vision and life insurance
- 401(k) employer matching program
- Parental leave
- Wellness resources
- Charitable matching program
- On-site workout facilities (Leawood, Gilbert, Burlington)
- Community outreach groups
- Tuition reimbursement
