Psychometric Evidence to Assess Expanded Test Use DIF IRT

Author(s):

Kim, Sooyeon; Chung, Seunghee

Publication Year:

2019

Report Number:

RM-19-07

Source:

ETS Research Memorandum

Document Type:

Report

Page Count:

26

Subject/Key Words:

Test Repurposing, Differential Item Functioning (DIF), Invariance of Linking, Subpopulation Invariance, Test Fairness, IRT True Score Equating

Abstract

Testing programs are often called upon to use their tests for multiple purposes. Alternate uses may include administering the test to groups different from the target population. Whenever the use of a test is expanded by administering it in other than the target population, fairness becomes a major concern. This study illustrates how the evaluation of two psychometric concepts—differential item functioning and linking invariance—can provide useful empirical evidence to assess this extended test use. Data from a large-scale language examination on which test takers were heterogeneous not only in their backgrounds (e.g., language, geographic region) but also in their performance levels were chosen as an example.

Read More

• Request Copy (specify title and report number, if any)
• https://www.ets.org/Media/Research/pdf/RM-19-07.pdf