Meta-Analysis for Integrating Study Outcomes: A Monte Carlo Study of its Susceptibility to Type I and Type II Errors
Document Type
Article
Publication Date
2-1987
Keywords
Type I & Type II error rates of Schmidt & Hunter meta analysis method vs U statistic for assessing homogeneity within sets of correlations
Digital Object Identifier (DOI)
https://doi.org/10.1037/0021-9010.72.1.3
Abstract
A Monte Carlo study was conducted to determine Types I and II error rates of the Schmidt and Hunter (S&H) meta-analysis method and the U statistic for assessing homogeneity within a set of correlations. One thousand samples of correlations were generated randomly to fill each of 450 cells of an 18 × 5 × 5 (Underlying Population Correlations × Numbers of Correlations Compared × Sample Size Per Correlation) design. To assess Type I error rates, correlations were drawn from the same population. To assess power, correlations were drawn from two different populations. As compared with U, which was uniformly robust, the Type I error rate for the S&H method was unacceptably high in many cells, particularly when the criterion for determining homogeneity was set at a highly conservative level. Power for the S&H method increased with increasing size of population differences, sample size per correlation, and in some cases, number of correlations compared. The U statistic did more poorly in most conditions in protecting from Type II errors.
Was this content written or created while at USF?
Yes
Citation / Publisher Attribution
Journal of Applied Psychology, v. 72, issue 1, p. 3-9
Scholar Commons Citation
Spector, Paul E. and Levine, Edward L., "Meta-Analysis for Integrating Study Outcomes: A Monte Carlo Study of its Susceptibility to Type I and Type II Errors" (1987). Psychology Faculty Publications. 643.
https://digitalcommons.usf.edu/psy_facpub/643
