skip to main content skip to footer

Classical Test Theory as a First-Order Item Response Theory: Application to True-Score Prediction From a Possibly Nonparallel Test

Author(s):
Holland, Paul W.; Hoskens, Machteld
Publication Year:
2002
Report Number:
RR-02-20
Source:
ETS Research Report
Document Type:
Report
Page Count:
40
Subject/Key Words:
Test Theory, True Scores, Best Linear Predictors, Test Linking, Nonparallel Tests, Simulation, Rasch Model

Abstract

We give an account of Classical Test Theory (CTT) in terms of the more fundamental ideas of Item Response Theory (IRT). This approach views classical test theory as a very general version of IRT, and the commonly used IRT models as detailed elaborations of CTT for special purposes. We then use this approach to CTT to derive some general results regarding the prediction of the true-score of a test from an observed score on that test as well from an observed score on a different test. This leads us to a new view of linking tests that were not developed to be linked to each other. In addition, we propose true-score prediction analogues of the Dorans and Holland measures of the population sensitivity of test linking functions. We illustrate the accuracy of the first-order theory using simulated data from the Rasch model, and illustrate the effect of population differences using a set of real data.

Read More