Oral Comprehensive Exams: Lessons on the Assessment of Student Achievement of Program Learning Outcomes at the U.S. Army War College

NGB Banner with White Knockout Text & Divider

In crisis? Seeking support is a sign of strength.
24/7 support is available:

988 Suicide & Crisis Lifeline: Call 988 or click here for live chat.

Veterans Crisis Line: Call 988 and press 1; text 838255; or click here for live chat.

NGB Warrior Resilience and Fitness (WRF) Division facilitates the Joint Suicide Prevention Program. The program
enhances suicide prevention-related policies and training, advances data collection and analysis, expands access to
community resources, and conducts strategic communication outreach aimed at reducing suicidal behavior across the
Army and Air National Guard. To learn more about WRF resources, click here.

DoD/VA RESOURCES

Defense Suicide Prevention Office (DSPO)
DSPO Risks and Warning Signs
DSPO Lethal Means Safety Resources
DSPO Leaders Suicide Prevention Messaging Guide
Department of Veterans Affairs (VA) Lethal Means Safety Resources
VA Mental Health and Wellness Mobile Apps
VA Confidential Self-Check Quiz

NATIONAL PROGRAMS

Project Safeguard
NG Cares

GOVERNANCE

CNGBI
CNGB DTM 0300.00

NON-CRISIS COUNSELING AND SUPPORT

Military OneSource
Vet Center Call Center
Substance Abuse and Mental Health Services Administration National Helpline
Psychological Health Resource Center Live Chat
inTransition Live Chat
Tragedy Assistance Program for Survivors
NG Family Assistance Centers
Vet Centers
Star Behavioral Health Providers
Substance Abuse and Mental Health Services Administration FIND Treatment
More
Give an Hour
Cohen Veterans Network
Face the Fight
Avalon Action Alliance
PsychArmor
Operation Mend
Travis Manion Foundation
Directors of Psychological Health (CAC enabled)
More

Video by Mike Tate

Oral Comprehensive Exams: Lessons on the Assessment of Student Achievement of Program Learning Outcomes at the U.S. Army War College

Air University Public Affairs

Dec. 7, 2023 | 14:28

Christopher Hickey, Ph.D., Brett Weigle, Ed.D., & Matthew Woessner, Ph.D.

Strategic guidance, including The Joint Chiefs of Staff Vision and Guidance for Professional Military Education and Talent Management and Department of Defense Instruction 1322.35, Military Education, has emphasized the importance of high-quality assessment of student learning and program effectiveness. Establishing an appropriate process and criteria for measuring adult educational success has long been a critical challenge for educators (Harnett and Willingham, 1980). Research suggests that comprehensive examinations have been helpful for assessment in at least one military education institution (Collins, Welch, and Martin, 2020). The U.S. Army War College resident education program administers an individual oral comprehensive exam as one of several means to assess student achievement of six Program Learning Outcomes (PLOs).

The presentation will first review the PLOs, how the examination seeks to assess their achievement, and critical lessons learned from the exam’s evolution intended to implement best practices in assessment, including authentic assessment (Wiggins 1989, 1998). It will then discuss findings from regression analysis and a review of student and faculty surveys to address four questions. First, what is the relationship between course grades and comprehensive exam grades? Second, what is the relative strength of the six PLOs in influencing comprehensive exam grades? Third, do the exam grades provide evidence that students in specialized programs experience better outcomes in achieving the PLOs? Fourth, is there evidence of changes in overall outcomes related to changes in the curriculum? Initial work suggests that course grades and comp exam grades are correlated, that the strategic communication PLO has the most substantial impact on comprehensive exam grades, and that there is evidence of greater achievement of program learning outcomes in some specialized programs. The findings may be limited by the degree of subjectivity inherent in grading. The lessons and findings will be helpful to institutions considering options to improve assessment practices.