Graduation Year

2010

Document Type

Dissertation

Degree

Ph.D.

Degree Granting Department

Economics

Major Professor

Walter C. Borman, Ph.D.

Co-Major Professor

Russell E. Johnson

Committee Member

Jennifer K. Bosson, Ph.D.

Committee Member

Edward L. Levine, Ph.D.

Committee Member

Joseph A. Vandello, Ph.D.

Keywords

field study, intervention, Romania, assessment, job performance

Abstract

Personnel selection validation studies are routinely conducted in contemporary organizations for selecting and placing employees. Although numerous studies have been conducted with the goal of identifying new predictors, less research was focused on the criterion side. In the current paper, across three studies and five samples, I examined the role played by rater motivation in validation studies. I proposed that rater motivation would impact criterion-related validity of various predictors, the reliability, and the variance of performance ratings. In Study 1, these hypotheses were tested in two samples with varied operationalizations of predictors and of rater motivation. In Study 2, I developed and tested a theoretically based brief intervention designed to increase rater motivation. Study 3 examined directly the link between rater motivation and accuracy.

The results suggest that rater motivation is important and should be considered in validation studies. Rater motivation impacted the criterion related validity of the predictors and the reliability of the ratings. Also, motivated raters showed higher convergence between subjective and objective ratings. The intervention resulted in increased response rates and more reliable ratings. Strengths, limitations and directions for future research are discussed.

Share

COinS