Samples in Applied Psychology: Over a Decade of Research in Review
Document Type
Article
Publication Date
9-2011
Keywords
experimental design, methodology, sample size, statistical power, Journal of Applied Psychology, published articles
Digital Object Identifier (DOI)
https://doi.org/10.1037/a0023322
Abstract
This study examines sample characteristics of articles published in Journal of Applied Psychology (JAP) from 1995 to 2008. At the individual level, the overall median sample size over the period examined was approximately 173, which is generally adequate for detecting the average magnitude of effects of primary interest to researchers who publish in JAP. Samples using higher units of analyses (e.g., teams, departments/work units, and organizations) had lower median sample sizes (Mdn ≈ 65), yet were arguably robust given typical multilevel design choices of JAPauthors despite the practical constraints of collecting data at higher units of analysis. A substantial proportion of studies used student samples (~40%); surprisingly, median sample sizes for student samples were smaller than working adult samples. Samples were more commonly occupationally homogeneous (~70%) than occupationally heterogeneous. U.S. and English-speaking participants made up the vast majority of samples, whereas Middle Eastern, African, and Latin American samples were largely unrepresented. On the basis of study results, recommendations are provided for authors, editors, and readers, which converge on 3 themes: (a) appropriateness and match between sample characteristics and research questions, (b) careful consideration of statistical power, and (c) the increased popularity of quantitative synthesis. Implications are discussed in terms of theory building, generalizability of research findings, and statistical power to detect effects.
Was this content written or created while at USF?
No
Citation / Publisher Attribution
Journal of Applied Psychology, v. 96, issue 5, p. 1055-1064
Scholar Commons Citation
Shen, Winny; Kiger, Thomas B.; Davies, Stacy E.; Rasch, Rena L.; Simon, Kara M.; and Ones, Deniz S., "Samples in Applied Psychology: Over a Decade of Research in Review" (2011). Psychology Faculty Publications. 1914.
https://digitalcommons.usf.edu/psy_facpub/1914
