Detecting Differential Item Functioning with Confirmatory Factor Analysis and Item Response Theory: Toward a Unified Strategy
Document Type
Article
Publication Date
11-2006
Keywords
item response theory, differential item functioning, mean and covariance structures, measurement equivalence, confirmatory factor analysis, thresholds, sample size, IRT, DIF, CFA, MACS
Digital Object Identifier (DOI)
https://doi.org/10.1037/0021-9010.91.6.1292
Abstract
In this article, the authors developed a common strategy for identifying differential item functioning (DIF) items that can be implemented in both the mean and covariance structures method (MACS) and item response theory (IRT). They proposed examining the loadings (discrimination) and the intercept (location) parameters simultaneously using the likelihood ratio test with a free-baseline model and Bonferroni corrected critical p values. They compared the relative efficacy of this approach with alternative implementations for various types and amounts of DIF, sample sizes, numbers of response categories, and amounts of impact (latent mean differences). Results indicated that the proposed strategy was considerably more effective than an alternative approach involving a constrained-baseline model. Both MACS and IRT performed similarly well in the majority of experimental conditions. As expected, MACS performed slightly worse in dichotomous conditions but better than IRT in polytomous cases where sample sizes were small. Also, contrary to popular belief, MACS performed well in conditions where DIF was simulated on item thresholds (item means), and its accuracy was not affected by impact.
Was this content written or created while at USF?
Yes
Citation / Publisher Attribution
Journal of Applied Psychology, v. 91, issue 6, p. 1292-1306
Scholar Commons Citation
Stark, Stephen; Chernyshenko, Oleksandr S.; and Drasgow, Fritz, "Detecting Differential Item Functioning with Confirmatory Factor Analysis and Item Response Theory: Toward a Unified Strategy" (2006). Psychology Faculty Publications. 1963.
https://digitalcommons.usf.edu/psy_facpub/1963
