Degree Granting Department
Walter C. Borman, Ph.D.
Russell E. Johnson
Jennifer K. Bosson, Ph.D.
Edward L. Levine, Ph.D.
Joseph A. Vandello, Ph.D.
field study, intervention, Romania, assessment, job performance
Personnel selection validation studies are routinely conducted in contemporary organizations for selecting and placing employees. Although numerous studies have been conducted with the goal of identifying new predictors, less research was focused on the criterion side. In the current paper, across three studies and five samples, I examined the role played by rater motivation in validation studies. I proposed that rater motivation would impact criterion-related validity of various predictors, the reliability, and the variance of performance ratings. In Study 1, these hypotheses were tested in two samples with varied operationalizations of predictors and of rater motivation. In Study 2, I developed and tested a theoretically based brief intervention designed to increase rater motivation. Study 3 examined directly the link between rater motivation and accuracy.
The results suggest that rater motivation is important and should be considered in validation studies. Rater motivation impacted the criterion related validity of the predictors and the reliability of the ratings. Also, motivated raters showed higher convergence between subjective and objective ratings. The intervention resulted in increased response rates and more reliable ratings. Strengths, limitations and directions for future research are discussed.
Scholar Commons Citation
Ispas, Dan, "The Role of Rater Motivation in Personnel Selection Validation Studies" (2010). USF Tampa Graduate Theses and Dissertations.