Hostname: page-component-76fb5796d-22dnz Total loading time: 0 Render date: 2024-04-26T22:21:56.074Z Has data issue: false hasContentIssue false

On the Relationship Between Job Performance and Ratings of Job Performance: What Do We Really Know?

Published online by Cambridge University Press:  07 January 2015

David J. Woehr*
Affiliation:
The University of Tennessee
*
E-mail: djw@utk.edu, Address: Department of Management, The University of Tennessee, 411 Stokely Management Center, Knoxville, TN 37796

Abstract

Image of the first page of this content. For PDF version, please use the ‘Save PDF’ preceeding this image.'
Type
Commentaries
Copyright
Copyright © Society for Industrial and Organizational Psychology 2008 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

*

Department of Management, The University of Tennessee

References

Austin, J. T., & Crepin, T. R. (2006). Problems of criteria in industrial and organizational psychology: Progress, problems, and prospects. In Bennett, W. Jr., Lance, C. E., & Woehr, D. J. (Eds.), Performance measurement: Current perspectives and future challenges. Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar
Borman, W. C. (1974). The rating of individuals in organizations: An alternative approach. Organizational Behavior and Human Performance, 12, 105124.10.1016/0030-5073(74)90040-3Google Scholar
Cooper, W. H. (1981). Ubiquitous halo. Psychological Bulletin, 90, 218244.Google Scholar
DeNisi, A. S., Cafferty, T., & Meglino, B. (1984). A cognitive view of the performance appraisal process: A model and research propositions. Organizational Behavior and Human Decision Processes, 33, 360396.10.1016/0030-5073(84)90029-1Google Scholar
Dipboye, R. L. (1990). Laboratory vs. field research in industrial and organizational psychology. International Review of Industrial and Organizational Psychology, 5, 134.Google Scholar
Feldman, J. M. (1981). Beyond attribution theory: Cognitive processes in performance appraisal. Journal of Applied Psychology, 66, 127148.Google Scholar
Funder, D. C. (1987). Errors and mistakes: Evaluating the accuracy of social judgment. Psychological Bulletin, 101, 7590.Google Scholar
Ilgen, D. R., Barnes-Farrell, J. L., & McKellin, D. B. (1993). Performance appraisal process research in the 1980s: What has it contributed to appraisals in use? Organizational Behavior and Human Decision Process, 54, 321368.10.1006/obhd.1993.1015Google Scholar
Landy, F. J., & Farr, J. L. (1980). Performance rating. Psychological Bulletin, 87, 72107.Google Scholar
LeBretton, J. M., Burgess, J. R. D., Kaiser, R. B., Atchley, E. K., & James, L. R. (2003). The restriction of variance hypothesis and interrater reliability and agreement: Are ratings from multiple sources really dissimilar? Orgnaizational Research Methods, 6, 80128.Google Scholar
Levy, P. E., & Williams, J. R. (2004). The social context of performance appraisal: A review and framework for the future. Journal of Management, 20, 881905.10.1016/j.jm.2004.06.005Google Scholar
Murphy, K. R. (2008). Explaining the weak relationship between job performance and ratings of job performance. Industrial and Organizational Psychology: Perspectives on Science and Practice, 1, 148160.Google Scholar
Murphy, K. R., & Balzer, W. K. (1989). Rater errors and rating accuracy. Journal of Applied Psychology, 74, 619624.10.1037/0021-9010.74.4.619Google Scholar
Murphy, K. R., & DeShon, R. (2000). Interrater correlations do not estimate the reliability of job performance ratings. Personnel Psychology, 53, 73900.Google Scholar
Roach, D. W., & Gupta, N. (1992). A realistic simulation for assessing the relationships among components of accuracy. Journal of Applied Psychology, 77, 196200.10.1037/0021-9010.77.2.196Google Scholar
Saal, F. E., Downey, R. G., & Lahey, M. A. (1980). Rating the ratings: Assessing the psychometric quality of rating data. Psychological Bulletin, 88, 413428.10.1037/0033-2909.88.2.413Google Scholar
Schmidt, F. L., Viswesvaran, C., & Ones, D. S. (2000). Reliability is not validity and validity is not reliability. Personnel Psychology, 53, 901912.10.1111/j.1744-6570.2000.tb02422.xGoogle Scholar
Sulsky, L. M., & Balzer, W. K. (1988). Meaning and measurement of performance rating accuracy: Some methodological and theoretical concerns. Journal of Applied Psychology, 73, 497506.10.1037/0021-9010.73.3.497Google Scholar
Viswesvaran, C., Ones, D. S., & Schmidt, F. L. (1996). Comparative analysis of the reliability of job performance ratings. Journal of Applied Psychology, 81, 557574.10.1037/0021-9010.81.5.557Google Scholar
Woehr, D. J., & Huffcutt, A. I. (1994). Rater training for performance appraisal: A quantitative review. Journal of Organizational and Occupational Psychology, 67, 189205.Google Scholar