Evaluation and Research Director, USAFA

Yorktown Systems Group, Inc. • $90K — $120K *
US-AnywhereRemote in United States
Education, Government & Non-Profit
8 - 10 years of experience
Today
Be an Early Applicant
Job Overview by Ladders

Qualifications

  • 8+ years experience as an evaluation and/or research lead
  • Graduate degree in relevant fields such as Program Evaluation or Education Statistics
  • Training/certification in evaluation methodologies like ROI Institute or Kirkpatrick
  • Experience in assessment frameworks and data analysis
  • Familiarity with program evaluation standards and methods
  • Ability to provide results that inform policymakers and stakeholders
  • Strong organizational and analytical skills

Responsibilities

  • Lead and oversee Evaluation & Research team activities
  • Convert findings into future planning inputs
  • Analyze performance data to identify trends and strengths
  • Collaborate with stakeholders to align evaluation methodologies
  • Transform evaluation findings into actionable recommendations
  • Capture and organize training event feedback and performance data
  • Design and execute qualitative and quantitative research studies

Benefits

  • Flexible remote working options
  • Opportunity to work at a prestigious military academy
  • Engagement in meaningful work supporting military training
  • Comprehensive training and professional development
  • Strong focus on collaboration with leadership and instructional designers
  • Exposure to high-level data analysis and evaluation methodologies
Full Job Description


Job Title

Evaluation and Research Director, USAFA

Location

Colorado Springs, CO - Colorado Springs, CO 80903 US (Primary)
Remote, Virtual, US - AL US

Job Description

Summary:
Yorktown Systems Group, Inc. (YSG) is seeking a highly qualified Evaluation and Research Director to provide comprehensive Warfighter Training Support Services at the United States Air Force Academy (USAFA). The purpose of this position is to support the planning, development, execution, management, and evaluation of military training for approximately 4,200 cadets annually during both the academic year and summer training programs. This position will assist the USAFA in delivering a coherent, progressive, and operationally relevant 47-month cumulative military training continuum aligned with Department of the Air Force (DAF) readiness objectives, Joint Force expectations, and USAFA cadet development outcomes.

Specific duties may include, but are not limited to:
  • Serves as the lead and primary Evaluation and Research representative, providing management and oversight of the Evaluation & Research Team, as well as being the point of contact for all program Evaluation & Research activities/efforts.
  • Convert execution findings into future planning inputs
  • Aggregate and analyze performance data across events, cohorts, and training cycles within the Moodle/TUTOR VSP to identify trends, systemic strengths, and recurring performance gaps.
  • Work with USAFA leadership, instructional designers, and training support personnel to ensure evaluation methodologies, performance measures, and assessment requirements remain aligned with program objectives.
  • Convert evaluation findings, performance trends, and lessons learned into recommendations that support refinement of warfighter competencies, training effectiveness, learning outcomes, and program improvement initiatives.
  • Converts execution observations, metrics, and lessons learned into resource planning inputs that inform future assessments, refinement, and recommendations.
  • Capture observations, rubric results, AAR inputs, instructor feedback, participant performance data, and lessons learned during and after training events.
  • Collectively execute all program evaluation activities across the WTIS framework.
  • Apply Kirkpatrick's four-level training evaluation model within a repeatable process that integrates assessment tool development, disciplined data capture, structured AAR consolidation, and performance analysis within the required environment and tools.
  • Define and maintain the data structure and workflows required to capture, store, and export evaluation data in a manner that supports consistent analysis.
  • Conducts analytical review of existing and available Program of Instruction (POI), courseware, lesson materials, exercise scenarios, training schedules, TLOs, ELOs, primary tasks and objectives, evaluation criteria, recurring training events, historical planning products, and after-action inputs.
  • Use assessment data and other evaluation inputs to develop dashboard reporting, leadership briefings, annual program assessments, and evidence-based recommendations for program improvement.
  • Design and execute qualitative and quantitative research studies that assess cadet development, training effectiveness, and progression across the military training continuum.
  • Prepare executive-level reports, dashboards, briefings, and recommendations for USAFA leadership utilizing evaluation findings and performance trends.
  • Ensure evaluation methodologies, data collection activities, and reporting processes meet accepted standards for program evaluation, research integrity, and statistical validity


Job Requirements

Required Qualifications:
  • Must possess 8+ years experience as an evaluation and/or research lead.
  • Graduate degree in Program Evaluation, Education Statistics, Social Science, Research Methods, Organizational Development, or related field.
  • Training/certification in evaluation methodologies (e.g., ROI Institute, Kirkpatrick).
  • Experience supporting assessment frameworks, AAR methodology, rubric development, data analysis, trend reporting, and presentation of findings to stakeholders.
  • Experience evaluating programs/projects; creation of evaluation plans and logic models; developing data collection tools and procedures; facilitating data collection; conducting statistical analysis of data; writing evaluation reports and providing statistical analysis of programs of similar scale and duration.
  • Possess an in-depth and current understanding of program evaluation including the four major categories of standards (propriety, utility, feasibility, and accuracy) when conducting a program evaluation.
  • Ability to evaluate the implementation and effectiveness of key initiatives and programs through the use of quantitative and qualitative research methods, and to provide results that inform policymakers and stakeholders' decisions regarding program viability and improvement.
  • Ability to capture, conduct analysis, and organize collected.
  • Possess an in-depth and current understanding of research and evaluation methods and techniques.

Clearance: Must be able to obtain a SECRET security clearance.

Location: Colorado Springs, CO / Remote

Travel: Some travel will be required

Security Clearance

Eligible for Secret Security Clearance (1)

Travel

Some travel may be required

Job Type

Full-Time

Exemption Type

Exempt

Category

Contractors

About Yorktown Systems Group, Inc.

Yorktown Systems Group, Inc. Careers

Joining Yorktown Systems Group, Inc. presents an unparalleled opportunity to advance a career with a leader in innovation and leadership development. As a company committed to excellence, Yorktown Systems Group, Inc. offers a range of job opportunities that cater to diverse professional skills and ambitions. This is where career growth, professional development, and diversity training converge to empower each team member.

Explore Career Opportunities

Yorktown Systems Group, Inc. is actively hiring and continually seeks passionate, creative, and solution-driven professionals. Explore open positions that align with your skills and interests in a company where every position contributes to meaningful outcomes.

Innovation and Professional Growth

At Yorktown Systems Group, Inc., innovation isn't just a buzzword—it's the cornerstone of their operations. Employees are encouraged to lead with creativity and supported by unmatched opportunities for professional growth. The company's commitment to innovation and leadership ensures that every team member has the tools to succeed and lead in their field.

Internship and Employment Opportunities

For those starting their career journey, Yorktown Systems Group, Inc. offers robust internship programs designed to provide real-world experience and insights into the professional world. These opportunities are crafted to refine skills, enhance resumes, and build a network of professional contacts, setting a strong foundation for a flourishing career.

Benefits and Company Culture

Yorktown Systems Group, Inc. is renowned for its inclusive culture and comprehensive benefits package designed to support the well-being and continuous growth of its team members. The company values diversity and strives to create an environment where all employees feel valued and able to contribute their unique perspectives and skills.

Networking and Career Development

Networking within Yorktown Systems Group, Inc. opens doors to expansive career advancement opportunities. Employees are encouraged to engage in various networking events, leadership forums, and professional groups to enhance their career trajectory.

Preparing for Your Interview

When applying for a position at Yorktown Systems Group, Inc., candidates are advised to tailor their resumes to highlight relevant experience and skills. Preparation for the interview process is crucial; understanding the company’s operations, culture, and values will stand candidates in good stead during their interviews.

Join the Yorktown Systems Group, Inc. Team

Discover the array of job opportunities at Yorktown Systems Group, Inc. and become part of a team that values leadership, innovation, and diversity. Search for open positions that match your career interests and apply today. Join a group where your professional aspirations can be met with exciting challenges and substantial rewards.

Stay Connected with Yorktown Systems Group, Inc. Careers

Stay informed with the latest career tips, industry insights, and company updates directly from Yorktown Systems Group, Inc. Subscribe to receive personalized job alerts and insider information tailored to your career preferences. Explore what the future holds with Yorktown Systems Group, Inc. and prepare to elevate your professional journey.

SEARCH YORKTOWN SYSTEMS GROUP, INC. JOBS

READ CAREERS BLOG

JOB ALERT EMAILS

Personalize your subscription to receive job alerts, latest news, and insider tips tailored to your preferences. Discover the exciting and rewarding career opportunities awaiting at Yorktown Systems Group, Inc.
Learn more about Yorktown Systems Group, Inc.
Industry
Education, Government & Non-Profit
* Ladders Estimates

Similar Jobs

Ad banner background

Get Ready For Your
Next Interview

More Jobs at Yorktown Systems Group, Inc.

More Education, Government & Non-Profit Jobs

Find similar Evaluation and Research Director, USAFA jobs:

NationwideRemote