American Institute of Certified Public Accountants

Psychometrician

Education, Government & Non-Profit
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Ph.D. in Psychometrics, I/O Psychology, or related field required; entry-level candidates considered.
  • Experience in statistical/psychometric programming and machine learning preferred.
  • Familiarity with Natural Language Processing and LLM implementations is a plus.
  • 0-1 years of experience in psychometric analysis in high-stakes testing is acceptable.
  • Understanding of Item Response Theory and classical item statistics required.

Responsibilities

  • Prepare item analysis output for item development and program improvement.
  • Calibrate and maintain item banks using psychometric methods.
  • Perform calibration and scoring reviews for examinations.
  • Conduct quality control and ensure data integrity for scoring.
  • Support multiple psychometric analyses including DIF and scaling.
  • Design and implement research studies as needed.
  • Develop quarterly and annual technical reports.

Benefits

  • Flexible work-life balance support.
  • Healthcare and retirement options.
  • Paid time-off and parental leave available.
  • Employee assistance program for mental health.
  • Resources to support employee wellbeing and personalized benefits.
Full Job Description
About the Role:

You will work with the Psychometrics and Research team to perform large-scale calibrations, scoring, monitoring, program improvement and technical reporting for the Uniform CPA Examination. You will perform programming and data analysis in both operational and research contexts; work across areas within the Examinations Team to provide accurate deliverables; and help implement systems and procedural process improvement. You will report to the Director, Psychometrics & Research and this role is remote.

You Will:
  • Prepare item analysis output for item development and program improvement. Calibrate and maintain item banks using Item Response Theory methods and classical item statistics.
  • Perform calibration and scoring reviews
  • Conduct quality control and data integrity analyses for scoring and reporting; help with producing procedural and quality assurance documentation for external and internal partners
  • Support/conduct multiple psychometric analyses, including differential item functioning (DIF),dimensionality, scaling, equating, and speediness analyses.
  • Help design and implement research studies in response to planned and ad-hoc needs.
  • Help develop quarterly and annual technical reporting.


You Have:
  • Ph.D. in Psychometrics, I/O psychology, Quantitative Psychology, Educational Measurement or a related field
  • Entry-level candidates and recent graduates with relevant coursework, research, or internship experience will be considered.
  • Experience with statistical/psychometric programming, machine learning, Natural Language Processing, and/or LLM implementations in test development and psychometrics
  • 0 - 1 years of experience in psychometric analysis within high-stakes testing, certification, or licensure assessment environments

How We Support You:

We provide flexibility to help you achieve a good work-life balance. You'll be part of a global, diverse team who foster an environment of inclusion and belonging where you are valued for who you are and where you come from.

We offer benefit options in and out of the workplace, including healthcare, retirement, paid time-off, parental leave, an employee assistance program. We provide resources that support your mental health, and evolve our offerings to meet your needs. We care about our employees' welfare and focus our benefits package on the benefits which support your wellbeing. We also recognize that everyone has different priorities, so in addition to our core benefits to support your health we offer flexible options for you to choose benefits that are right for you, your family and your lifestyle.

We believe in non-stop learning and are committed to investing in learning opportunities that help you reach your full potential and support your continued development.

The Annual Salary Range for this role is: $80,000- $95,000

Please note, this is a standard range and exact compensation may vary based on experience and location. If you'd like to understand more on the salary range, please contact [email protected]

If you're interested in this role, please apply before 31 August 2026

While this role can work remotely in the US, please note that we are unable to employ individuals in the state of California.

About American Institute of Certified Public Accountants

The American Institute of Certified Public Accountants (AICPA) is the national professional organization of Certified Public Accountants (CPAs) in the United States, with more than 431,000 members worldwide. The AICPA sets ethical standards for the profession and U.S. auditing standards for private companies, nonprofit organizations, and federal, state, and local governments. It also develops and grades the Uniform CPA Examination.
Learn more about American Institute of Certified Public Accountants
Size
431 employees
Industry

Similar Jobs

More Jobs at American Institute of Certified Public Accountants

  • American Institute of Certified Public Accountants
    Psychometrician
    $80K — $95K *
    Durham, NC 27713 (Durham County)
    Education, Government & Non-Profit
    In-Person
  • American Institute of Certified Public Accountants
    Writer
    $73K — $94K *
    Durham, NC 27713 (Durham County)
    Media
    In-Person
  • American Institute of Certified Public Accountants
    Lead Manager - Pricing
    $88K — $125K *
    Durham, NC 27713 (Durham County)
    Finance & Insurance
    In-Person
  • American Institute of Certified Public Accountants
    User Interface & User Experience Manager
    $88K — $125K *
    Durham, NC 27713 (Durham County)
    Consumer Technology
    In-Person
  • American Institute of Certified Public Accountants
    Lead Manager - Pricing
    $88K — $125K *
    Durham, NC 27713 (Durham County)
    Retail & Consumer Goods
    In-Person

More Education, Government & Non-Profit Jobs

Find similar Psychometrician jobs: