Skip to main content Accessibility help

No New Terrain: Reliability and Construct Validity of Job Performance Ratings

  • Deniz S. Ones (a1), Chockalingam Viswesvaran (a2) and Frank L. Schmidt (a3)


  • An abstract is not available for this content so a preview has been provided below. Please use the Get access link above for information on how to access this content.


Corresponding author

E-mail:, Address: Department of Psychology, University of Minnesota, 75 East River Road, Minneapolis, MN 55455-0344


Hide All
Becker, B. E., & Huselid, M. A. (1992). Direct estimates of SD-sub(y) and the implications for utility analysis. Journal of Applied Psychology, 77, 227233.
Bommer, W. H., Johnson, J., Rich, G. A., Podsakoff, P. M., & MacKenzie, S. B. (1995). On the interchangeability of objective and subjective measures of employee performance: A meta-analysis. Personnel Psychology, 48, 587605.
Borman, W. C., Penner, L. A., Allen, T. D., & Motowidlo, S. J. (2001). Personality predictors of citizenship performance. International Journal of Selection and Assessment, 9, 5269.
Campbell, J. P., Gasser, M. B., & Oswald, F. L. (1996). The substantive nature of job performance variability. In Murphy, K. R. (Ed.), Individual differences and behavior in organizations (pp. 258299). San Francisco: Jossey-Bass.
Campbell, J. P., McHenry, J. J., & Wise, L. L. (1990). Modeling job performance in a population of jobs. Personnel Psychology, 43, 313333.
Cesare, S. J., Blankenship, M. H., & Giannetto, P. W. (1994). A dual focus of SD-sub(y) estimations: A test of the linearity assumption and multivariate application. Human Performance, 7, 235255.
Cronbach, L. J. (1947). Test “reliability”: Its meaning and determination. Psychometrika, 12, 116.
Harris, M. M., & Schaubroeck, J. (1988). A meta-analysis of self-supervisor, self-peer, and peer-supervisor ratings. Personnel Psychology, 41, 4362.
Heneman, R. L. (1986). The relationship between supervisory ratings and results-oriented measures of performance: A meta-analysis. Personnel Psychology, 39, 811826.
Le, H., Oh, I.-S., Shaffer, J. A., & Schmidt, F. L. (2007). Implications of methodological advances for the practice of personnel selection: How practitioners benefit from recent developments in meta-analysis. Academy of Management Perspectives, 21, 615.
Mount, M. K., Judge, T. A., Scullen, S. E., Sytsma, M. R., & Hezlett, S. A. (1998). Trait, rater and level effects in 360-degree performance ratings. Personnel Psychology, 51, 557576.
Murphy, K. R., (2008). Explaining the weak relationship between job performance and ratings of job performance. Industrial and Organizational Psychology: Perspectives on Science and Practice, 1, 148160.
Murphy, K. R., & DeShon, R. (2000). Interrater correlations do not estimate the reliability of job performance ratings. Personnel Psychology, 53, 873900.
Nathan, B. R., & Alexander, R. A. (1988). A comparison of criteria for test validation: A meta-analytic investigation. Personnel Psychology, 41, 517535.
Nunnally, J. C. (1978). Psychometric theory (2nd ed.). New York: McGraw-Hill.
Ones, D. S., Dilchert, S., Viswesvaran, C., & Judge, T. A. (2007). In support of personality assessment in organizational settings. Personnel Psychology, 60, 9951027.
Ones, D. S., Viswesvaran, C., & Dilchert, S. (2005a). Cognitive ability in personnel selection decisions. In Evers, A., Voskuijl, O., & Anderson, N. (Eds.), Handbook of selection (pp. 143173). Oxford, UK: Blackwell.
Ones, D. S., Viswesvaran, C., & Dilchert, S. (2005b). Personality at work: Raising awareness and correcting misconceptions. Human Performance, 18, 389404.
Ones, D. S., Viswesvaran, C., & Schmidt, F. L. (1993). Comprehensive meta-analysis of integrity test validities: Findings and implications for personnel selection and theories of job performance. Journal of Applied Psychology, 78, 679703.
Schmidt, F. L., & Hunter, J. E. (1996). Measurement error in psychological research: Lessons from 26 research scenarios. Psychological Methods, 1, 199223.
Schmidt, F. L., & Hunter, J. E. (1999). Theory testing and measurement error. Intelligence, 27, 183198.
Schmidt, F. L., Le, H., & Ilies, R. (2003). Beyond alpha: An empirical examination of the effects of different sources of measurement error on reliability estimates for measures of individual-differences constructs. Psychological Methods, 8, 206224.
Schmidt, F. L., Viswesvaran, C., & Ones, D. S. (2000). Reliability is not validity and validity is not reliability. Personnel Psychology, 53, 901912.
Thorndike, R. L. (1949). Personnel selection: Test and measurement techniques. New York: Wiley.
Viswesvaran, C. (2002). Absenteeism and measures of job performance: A meta-analysis. International Journal of Selection and Assessment, 10, 1217.
Viswesvaran, C., Ones, D. S., & Schmidt, F. L. (1996). Comparative analysis of the reliability of job performance ratings. Journal of Applied Psychology, 81, 557574.
Viswesvaran, C., Schmidt, F. L., & Ones, D. S. (2002). The moderating influence of job performance dimensions on convergence of supervisory and peer ratings of job performance: Unconfounding construct-level convergence and rating difficulty. Journal of Applied Psychology, 87, 345354.
Viswesvaran, C., Schmidt, F. L., & Ones, D. S. (2005). Is there a general factor in ratings of job performance? A meta-analytic framework for disentangling substantive and error influences. Journal of Applied Psychology, 90, 108131.

Related content

Powered by UNSILO

No New Terrain: Reliability and Construct Validity of Job Performance Ratings

  • Deniz S. Ones (a1), Chockalingam Viswesvaran (a2) and Frank L. Schmidt (a3)


Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed.