Hostname: page-component-7bb8b95d7b-qxsvm Total loading time: 0 Render date: 2024-09-26T19:26:39.073Z Has data issue: false hasContentIssue false

Integrating Traditional Perspectives on Error in Ratings: Capitalizing on Advances in Mixed-Effects Modeling

Published online by Cambridge University Press:  07 January 2015

Dan J. Putka*
Affiliation:
Human Resources Research Organization
Michael Ingerick
Affiliation:
Human Resources Research Organization
Rodney A. McCloy
Affiliation:
Human Resources Research Organization
*
E-mail: dputka@humrro.org, Address: Human Resources Research Organization, 66 Canal Center Plaza, Suite 400, Alexandria, VA 22314

Abstract

Image of the first page of this content. For PDF version, please use the ‘Save PDF’ preceeding this image.'
Type
Commentaries
Copyright
Copyright © Society for Industrial and Organizational Psychology 2008 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Bliese, P. D. (2002). Multilevel random coefficient modeling in organizational research. In Drasgow, F. & Schmitt, N. (Eds.), Measuring and analyzing behavior in organizations (pp. 401445). San Francisco: Jossey-Bass.Google Scholar
Bliese, P. D., & Hanges, P. J. (2004). Being both too liberal and too conservative: The perils of treating grouped data as thought they were independent. Organizational Research Methods, 7, 400417.Google Scholar
Cronbach, L. J., Gleser, G. C., Nanda, H., & Rajaratnam, N. (1972). The dependability of behavioral measurements: Theory of generalizability for scores and profiles. New York: John Wiley.Google Scholar
Lance, C. E., Baxter, D., & Mahan, R. P. (2006). Evaluation of alternative perspectives on source effects in multisource performance measures. In Bennett, W., Lance, C. E., & Woehr, D. J. (Eds.), Performance measurement: Current perspectives and future challenges (pp. 4976). Mahwah, NJ: Lawrence Erlbaum Associates, Inc.Google Scholar
Landy, F. J., & Farr, J. L. (1980). Performance rating. Psychological Bulletin, 87, 72107.Google Scholar
Littell, R. C., Milliken, G. A., Stroup, W. W., & Wolfinger, R. D. (1996). SAS system for mixed models. Cary, NC: SAS Institute Inc.Google Scholar
Lord, F. M., & Novick, M. R. (1968). Statistical theories of mental test scores. Reading, MA: Addison-Wesley.Google Scholar
McGraw, K. O., & Wong, S. P. (1996). Forming inferences about some intraclass correlation coefficients. Psychological Methods, 1, 3046.Google Scholar
Murphy, K. R. (2008). Explaining the weak relationship between job performance and ratings of job performance. Industrial and Organizational Psychology: Perspectives on Science and Practice, 1, 148160.10.1111/j.1754-9434.2008.00030.xGoogle Scholar
Murphy, K. R., & DeShon, R. (2000). Progress in psychometrics: Can industrial and organizational psychology catch up? Personnel Psychology, 53, 913924.Google Scholar
Schmidt, F. L., Viswesvaran, C., & Ones, D. S. (2000). Reliability is not validity and validity is not reliability. Personnel Psychology, 53, 901912.Google Scholar
Searle, S. R., Casella, G., & McCulloch, C. E. (1992). Variance components. New York: Wiley.Google Scholar
Snijders, T. A. B., & Bosker, R. J. (1994). Modeled variance in two-level models. Sociological methods & research, 22, 342363.Google Scholar
Spearman, C. (1910). Correlation calculated from faulty data. British Journal of Psychology, 3, 271295.Google Scholar
SPSS, Inc. (2005). Linear mixed-effect modeling in SPSS: An introduction to the mixed procedure (Technical Report LMEMWP-0305). Chicago, IL: Author.Google Scholar