An IRT Approach to Constructing and Scoring Pairwise Preference Items Involving Stimuli on Different Dimensions: The Multi-Unidimensional Pairwise-Preference Model

Document Type

Article

Publication Date

5-2005

Keywords

IRT, pairwise preference, paired comparison, forced choice, ipsative, multidimensional IRT, personality assessment, faking

Digital Object Identifier (DOI)

https://doi.org/10.1177/0146621604273988

Abstract

This article proposes an item response theory (IRT) approach to constructing and scoring multidimensional pairwise preference items. Individual statements are administered and calibrated using a unidimensional single-stimulus model. Tests are created by combining multidimensional items with a small number of unidimensional pairings needed to identify the latent metric. Trait scores are then obtained using a multidimensional Bayes modal estimation procedure based on a mathematical model called MUPP, which is illustrated and tested here using Monte Carlo simulations. Simulation results show that the MUPP approach to test construction and scoring provides accurate parameter recovery in both one- and two-dimensional simulations, even with relatively few (say, 15%) unidimensional pairings. The implications of these results for constructing and scoring fake-resistant personality items are discussed.

Was this content written or created while at USF?

Yes

Citation / Publisher Attribution

Applied Psychological Measurement, v. 29, issue 3, p. 184-203

Share

COinS