Accounting for test reliability in student progression: the reliable change index

Daniel Zahra*, Craig Hedge, Francesca Pesola, Steven Burr

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Context: Developed by Jacobson and Truax, the reliable change index (RCI) provides a measure of whether the change in an individual's score over time is within or beyond that which might be accounted for by measurement variability. In combination with measures of whether an individual's final score is closer to those of one population or another, this provides useful individual-level information that can be used to supplement traditional analyses. 

Objectives: This article aims to highlight the potential of the RCI for use within medical education, particularly as a novel means of monitoring progress at the student level across successive test occasions or academic years. 

Methods: We provide an example of how the RCI can be applied informatively to assessment evaluation, and discuss its wider usage. 

Conclusions: The RCI approach can be used to identify and support failing students, as well as to determine best teaching and learning practices by identifying high-performing students. Furthermore, the individual-level nature of the RCI makes it well suited for educational research with small cohorts, as well as for tracking individual profiles within a larger cohort or addressing questions about individual performance that may be unanswerable at group level.

Original languageEnglish
Pages (from-to)738-745
Number of pages8
JournalMedical Education
Volume50
Issue number7
Early online date13 Jun 2016
DOIs
Publication statusPublished - 1 Jul 2016

Fingerprint

Dive into the research topics of 'Accounting for test reliability in student progression: the reliable change index'. Together they form a unique fingerprint.

Cite this