Amazon

Psychometrician, AWS Training & Certification

Amazon$136K — $184K *
Education, Government & Non-Profit
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • PhD in a relevant field
  • 1+ year post-doctoral experience in high stakes certification programs
  • Ability to conduct job task analyses and standard setting studies
  • Familiarity with equating, item analysis, and automated test assembly
  • Experience using item response theory and generative AI tools
  • Proficient in programming languages R or Python

Responsibilities

  • Conduct Job Task Analysis (JTA) workshops and analyze post-JTA surveys to define certification test specifications
  • Facilitate standard setting studies to determine passing scores for exams
  • Run item analyses to assess the quality and performance of exam items
  • Utilize automated test assembly procedures for exam form creation
  • Collaborate with content development teams to optimize item bank trends
  • Support the development of a cloud-based analytics and reporting system
  • Communicate analysis results clearly to stakeholders through reports and presentations

Benefits

  • Health insurance (medical, dental, vision)
  • 401(k) matching
  • Paid time off and parental leave
  • Flexible Spending Accounts
  • Adoption and Surrogacy Reimbursement coverage
  • Comprehensive mental health support and resources
Full Job Description
The AWS Certification team is seeking a Psychometrician with experience working with criterion-referenced assessment programs to support a large global AWS Certification and Credentialing program. In this role, you will support all psychometric aspects of exam development and operation, including job analyses, standard setting, automated test assembly, item and test analyses, optimal item bank design, quality assurance, and project planning.

You will work closely with a team of psychometricians, subject matter experts, certification exam program managers, publishing, delivery, security, and product management teams to support ongoing analyses of exam and credential data. To be successful in this position, you must be highly motivated, creative, detail oriented, and a self-starter who is able to think big, execute, ensure high quality, yet stay focused on the details.

Key job responsibilities
• Conduct Job Task Analysis (JTA) workshops and post-JTA survey analyses to define the blueprint and test specifications for new certifications or updates to existing certifications
• Conduct standard setting studies to set the passing score for exams and credentials
• Run item analysis to evaluate quality and performance of exam items
• Use automated test assembly procedures to assemble forms or item pools
• Work with content development to track item bank trends and optimize the health of item banks
• Support the development of a cloud-based analytics and reporting system
• Partake in development and performance analysis of credentials
• Interpret and clearly communicate the results of analyses to stakeholders through written and oral reports
• Follow the accreditation standards set by ISO/IEC:[redacted]4 and the National Council for Certifying Agencies (NCCA) as they relate to valid psychometric practices
• Contribute to the development and execution of the strategic goals regarding the AWS certification and credentialing program.
• Consult with leadership, internal staff, external consultants, and industry leaders regarding advancement of current offerings

BASIC QUALIFICATIONS

- PhD

- At least 1 year post-doctoral direct experience working with high stakes certification or licensure programs

- Experience conducting job task analysis and standard setting

- Experience in equating, item analysis, and form assembly

- Experience using item response theory

- Experience using Generative AI tools

- Proficiency in R or Python languages

PREFERRED QUALIFICATIONS

- Experience in testing for global audiences

- Experience with different exam designs and delivery (e.g. LOFT, CAT)

- Experience using advanced AI methods (e.g., Machine Learning, Agentic AI)

- History of conference presentations and publications

- Experience with data forensics methods

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.

USA, OR, Portland - 136,000.00 - 184,000.00 USD annually

USA, TX, Austin - 136,000.00 - 184,000.00 USD annually

USA, VA, Arlington - 136,000.00 - 184,000.00 USD annually

USA, VA, Herndon - 136,000.00 - 184,000.00 USD annually

USA, WA, Bellevue - 136,000.00 - 184,000.00 USD annually

USA, WA, Seattle - 136,000.00 - 184,000.00 USD annually

About Amazon

Audible is a provider of spoken audio information and entertainment , on the Internet. They provide premium spoken audio content, such as audio versions of books and newspapers and radio programs, that is delivered over the Internet and played back on personal computers and hand-held electronic devices. The Audible service allows consumers to purchase and download their content from their Website, store it in digital files and play it back on personal computers and electronic devices. More than 15,000 hours of audio content are available on their Web site, including audio versions of books, periodicals and radio programs. Several manufacturers have agreed to support and promote the playback of their content on their hand-held audio-enabled electronic devices.

Amazon Careers

Joining Amazon presents an unparalleled opportunity to become part of a vibrant team pushing the boundaries of innovation and growth in the global marketplace. As a leader in e-commerce, technology, and logistics, Amazon offers a variety of job opportunities that cater to a range of skills and professional interests. Work You’ll Do At Amazon, every day is an opportunity to collaborate with the brightest minds in technology and business to redefine what’s possible. Whether you’re interested in software development, marketing, human resources, or customer service, Amazon has a position waiting for you. Transform the way the world shops and innovates with our diverse and inclusive team. Amazon is not just a company; it’s a community where you can drive real change and contribute to projects impacting millions globally. Lead with Innovation and Leadership Amazon is the perfect place to enhance your leadership and innovation skills. Our culture encourages pushing the envelope and imagining the unimaginable. Here, you will lead projects that challenge the status quo and define new industry standards. Work with a team that values diversity and is committed to creating an inclusive environment. Our leadership is focused on harnessing the collective power of unique perspectives to foster growth and innovation. Explore Amazon’s Employment Benefits Amazon’s commitment to its employees extends beyond just career growth. We offer competitive benefits, including health care, parental leave, and diversity training, ensuring that our team not only excels professionally but also enjoys well-being and security. Internship and Networking Opportunities Start your career with an Amazon internship and gain hands-on experience that matters. Our internships provide a gateway to full-time employment and an opportunity to network with professionals across various sectors of the company. Future-Proof Your Career With Amazon, your career path is filled with numerous opportunities for advancement. Our learning and development programs are designed to nurture your professional growth and keep you at the forefront of industry trends. Stay Connected Join Our Team Discover the job opportunities at Amazon that match your skills and interests. We are constantly on the lookout for passionate, curious, and innovative team players ready to make a difference. Keep Up to Date Stay ahead with career tips, insider perspectives, and industry-leading insights you can put to use today—all from the people who work here. Job Alert Emails Customize your subscription to receive job alerts, the latest news, and insider tips tailored to your preferences. Explore the exciting and rewarding career opportunities that await at Amazon. Amazon is more than just a company—it’s a platform for building a promising future. Whether you’re starting or looking to advance your career, Amazon offers the resources, support, and network you need to succeed. Join us, and be a part of our continuing mission to be Earth's most customer-centric company.
Learn more about Amazon
Size
1,608 employees
Market Cap
$832.6 billion
Industry
Net Income
$21.3 billion
Founded
1994
5 Year Trend
+28.1%
Revenue
$386 billion
NASDAQ

Similar Jobs

More Jobs at Amazon

More Education, Government & Non-Profit Jobs

Find similar Psychometrician, AWS Training & Certification jobs: