Evaluating Anchor-Item Designs for Concurrent Calibration With the GGUM

Document Type

Article

Publication Date

2017

Keywords

concurrent calibration, anchor-item design, generalized graded unfolding model, Markov chain Monte Carlo

Digital Object Identifier (DOI)

https://doi.org/10.1177/0146621616673997

Abstract

Concurrent calibration using anchor items has proven to be an effective alternative to separate calibration and linking for developing large item banks, which are needed to support continuous testing. In principle, anchor-item designs and estimation methods that have proven effective with dominance item response theory (IRT) models, such as the 3PL model, should also lead to accurate parameter recovery with ideal point IRT models, but surprisingly little research has been devoted to this issue. This study, therefore, had two purposes: (a) to develop software for concurrent calibration with, what is now the most widely used ideal point model, the generalized graded unfolding model (GGUM); (b) to compare the efficacy of different GGUM anchor-item designs and develop empirically based guidelines for practitioners. A Monte Carlo study was conducted to compare the efficacy of three anchor-item designs in vertical and horizontal linking scenarios. The authors found that a block-interlaced design provided the best parameter recovery in nearly all conditions. The implications of these findings for concurrent calibration with the GGUM and practical recommendations for pretest designs involving ideal point computer adaptive testing (CAT) applications are discussed.

Was this content written or created while at USF?

Yes

Citation / Publisher Attribution

Applied Psychological Measurement, v. 41, issue 2, p. 83-96

Share

COinS