Skip to main content Accessibility help
×
Home

Content Validation Is Useful for Many Things, but Validity Isn't One of Them

Published online by Cambridge University Press:  07 January 2015

Kevin R. Murphy
Affiliation:
Pennsylvania State University
Corresponding
E-mail address:

Abstract

Content-oriented validation strategies establish the validity of selection tests as predictors of performance by comparing the content of the tests with the content of the job. These comparisons turn out to have little if any bearing on the predictive validity of selection tests. There is little empirical support for the hypothesis that the match between job content and test content influences validity, and there are often structural factors in selection (e.g., positive correlations among selection tests) that strongly limit the possible influence of test content on validity. Comparisons between test content and job content have important implications for the acceptability of testing, the defensibility of tests in legal proceedings, and the transparency of test development and validation, but these comparisons have little if any bearing on validity.

Type
Focal Article
Copyright
Copyright © Society for Industrial and Organizational Psychology 2009

Access options

Get access to the full version of this content by using one of the access options below.

References

Anderson, N., Born, M. P. H., & Cunningham-Snell, N. (2001). Recruitment and selection: Applicant perspectives and outcomes. In Anderson, N., Ones, D. S., Senangil, H. K., & Viswesvaran, C. (Eds.), Handbook of industrial, work and organizational psychology: Personnel Psychology (Vol. 1, pp. 200218). London: Sage.CrossRefGoogle Scholar
Anderson, N., & Witvliet, C. (2008). Fairness reactions to personnel selection methods: An international comparison between the Netherlands, the United States, France, Spain, Portugal, and Singapore. International Journal of Selection and Assessment, 16, 113.CrossRefGoogle Scholar
Berry, C. M., Sackett, P. R., & Landers, R. N. (2007). Revisiting interview–cognitive ability relationships: Attending to specific range restriction mechanisms in meta-analysis. Personnel Psychology, 60, 837874.CrossRefGoogle Scholar
Binning, J. F. (2007). Validation strategies. In Rogelberg, S. G. (Ed.), Encyclopedia of industrial and organizational psychology (Vol. 2, pp. 859864). Thousand Oaks, CA: Sage.Google Scholar
Bobko, P., Roth, P. L., & Potosky, D. (1999). Derivation and implications of a meta-analytic matrix incorporating cognitive ability, alternative predictors, and job. Personnel Psychology, 60, 561589.CrossRefGoogle Scholar
Brown, K. G., Le, H., & Schmidt, F. L. (2006). Specific aptitude theory revisited: Is there incremental validity for training performance? International Journal of Selection and Assessment, 14, 87100.CrossRefGoogle Scholar
Carrier, M. R., Dalessio, A. T., & Brown, S. H. (1990). Correspondence between estimates of content and criterion-related validity values. Personnel Psychology, 43, 85100.CrossRefGoogle Scholar
Chan, D., Schmitt, N., Jennings, D., Clause, C., & Delbridge, K. (1998). Applicant perceptions of test fairness: Integrating justice and self-serving bias perspectives. International Journal of Selection and Assessment, 6, 232239.CrossRefGoogle Scholar
Conway, J. M., & Peneno, G. M. (1999). Comparing structured interview question types: Construct validity and applicant reactions. Journal of Business and Psychology, 13, 485506.CrossRefGoogle Scholar
Cortina, J. M., Goldstein, N. B., Payne, S. C., Davison, H. K., & Gilliland, S. W. (2000). The incremental validity of interview scores over and above cognitive ability and conscientiousness scores. Personnel Psychology, 53, 325351.CrossRefGoogle Scholar
Dalessio, A. T. & Silverhart, T. A. (1994). Combining biodata test and interview information. Predicting decisions and performance criteria. Personnel Psychology, 47, 303315.CrossRefGoogle Scholar
Dye, D. A., Reck, M., & McDaniel, M. A. (1993). The validity of job knowledge measures. International Journal of Selection and Assessment, 1, 153157.CrossRefGoogle Scholar
Dwight, S. A., & Alliger, G. M. (1997). Reaction to overt integrity test items. Educational and Psychological Measurement, 57, 937948.CrossRefGoogle Scholar
Earles, J. A., & Ree, M. J. (1992). The predictive validity of the ASVAB for training grades. Educational and Psychological Measurement, 52, 721725.CrossRefGoogle Scholar
Elkins, T. J., & Phillips, J. S. (2000). Job context, selection decision outcome, and perceived fairness of selection tests: Biodata as an illustrative case. Journal of Applied Psychology, 85, 479484.CrossRefGoogle ScholarPubMed
Fleishman, E. A., & Mumford, M. D. (1991). Evaluating classifications of job behavior: A construct validation of ability requirement scales. Personnel Psychology, 44, 523575.CrossRefGoogle Scholar
Fleishman, E. A., & Quaintance, M. K. (1984). Taxonomies of human performance: The description of human tasks. New York: Academic Press.Google Scholar
Gilliland, S. W. (1993). The perceived fairness of selection systems: An organizational justice perspective. Academy of Management Review, 18, 694734.CrossRefGoogle Scholar
Gilliland, S. W. (1994). Effects of procedural and distributive justice on reactions to a selection system. Journal of Applied Psychology, 79, 691701.CrossRefGoogle Scholar
Gilliland, S. W. (1995). Fairness from the applicant's perspective: Reactions to employee selection procedures. International Journal of Selection and Assessment, 3, 1119.CrossRefGoogle Scholar
Goldstein, I. L., & Zedeck, S. (1996). Content validation. In Barrett, R. (Ed.), Fair employment strategies in human resource management (pp. 2737). Westport, CT: Quorum Books.Google Scholar
Goldstein, I. L., Zedeck, S., & Schneider, B. (1993). An exploration of the job analysis-content validity process. In Schmitt, N. & Borman, W. C. (Eds.), Personnel selection in organizations. San Francisco: Jossey-Bass.Google Scholar
Guion, R. M. (1977). Content validity–The source of my discontent. Applied Psychological Measurement, 1, 110.CrossRefGoogle Scholar
Guion, R. M. (1978a). “Content validity” in moderation. Personal Psychology, 31, 205213.CrossRefGoogle Scholar
Guion, R. M. (1978b). Scoring content domain samples: The problem of fairness. Journal of Applied Psychology, 63, 499506.CrossRefGoogle Scholar
Guion, R. M. (1998). Assessment, measurement, and prediction for personnel selection. Mahwah, NJ: Erlbaum.Google Scholar
Hartigan, J. A., & Wigdor, A. K. (1989). Fairness in employment testing: Validity generalization, minority issues, and the General Aptitude Test Battery. Washington, DC: National Academy Press.Google Scholar
Hausknecht, J. P., Day, D. V., & Thomas, S. C. (2004). Applicant reactions to selection procedures: An updated model and meta-analysis. Personnel Psychology, 57, 639683.CrossRefGoogle Scholar
Himelfarb, R., & Perotti, R. (2004). Principle over politics?: The domestic policy of the George H. W. Bush presidency. New York: Greenwood.Google Scholar
Huffcutt, A. I., Roth, P. L., & McDaniel, M. A. (1996). A meta-analytic investigation of cognitive ability employment interview evaluations: Moderating characteristics and implications for incremental validity. Journal of Applied Psychology, 81, 459473.CrossRefGoogle Scholar
Hunter, J. E. (1982, June). What is the validity of a content valid test? Presented at meeting of International Personnel Management Association, Minneapolis.Google Scholar
Hunter, J. E. (1986). Cognitive ability, cognitive aptitudes, job knowledge and job performance. Journal of Vocational Behavior, 29, 340362.CrossRefGoogle Scholar
Hunter, J. E., & Hunter, R. F. (1984). Validity and utility of alternative predictors of job performance. Psychological Bulletin, 96, 7298.CrossRefGoogle Scholar
Jeanneret, P. R., & Strong, M. H. (2003). Linking O*NET job information to job requirement predictors: An O*NET application. Personnel Psychology, 56, 465492.CrossRefGoogle Scholar
Jensen, A. R. (1980). Bias in mental testing. New York: Free Press.Google Scholar
Jones, G. E., & Ree, M. J. (1998). Aptitude test score validity: No moderating effect due to job ability requirement differences. Educational and Psychological Measurement, 58, 284294.CrossRefGoogle Scholar
McDaniel, M. A., Morgeson, F. P., Finnegan, E. B., Campion, M. A., & Braverman, E. P. (2001). Use of situational judgment tests to predict job performance: A clarification of the literature. Journal of Applied Psychology, 86, 730740.CrossRefGoogle ScholarPubMed
Mosoco, S. (2000). Selection interview: A review of validity evidence, adverse impact and applicant reactions. International Journal of Selection and Assessment, 8, 237247.CrossRefGoogle Scholar
Murphy, K. R., & Davidshofer, C. O. (2005). Psychological testing: Principles and applications (6th ed.). Upper Saddle River, NJ: Prentice Hall.Google Scholar
Murphy, K. R., Dzieweczynski, J. L., & Yang, Z. (2009). Positive manifold limits the relevance of content-matching strategies for validating selection test batteries. Journal of Applied Psychology, 94, 1018–1031.CrossRefGoogle ScholarPubMed
Peterson, N. G., Wise, L. L., Arabian, J., & Hoffman, R. G. (2001). Synthetic validation and validity generalization when empirical validation is not possible. In Campbell, J. & Knapp, D. (Eds.), Exploring the upper limits of personnel selection and classification (pp. 411451). Mahwah, NJ: Erlbaum.Google Scholar
Potosky, D., Bobko, P., & Roth, P. L. (2005). Forming composites of cognitive ability and alternate measures to predict job performance and reduce adverse impact: Corrected estimated and realistic expectations, International Journal of Selection and Assessment, 13, 304315.CrossRefGoogle Scholar
Prediger, D. (1987). Validity of the new Armed Services Vocational Aptitude Battery job cluster scores in career planning. Career Development Quarterly, 36, 113125.CrossRefGoogle Scholar
Ree, M. J., & Carretta, T. R. (2002). G2k. Human Performance, 15, 323.Google Scholar
Ree, M. J., & Earles, J. A. (1991). Predicting training success: Not much more than g. Personnel Psychology, 44, 321332.CrossRefGoogle Scholar
Ree, M. J., & Earles, J. A. (1992). Intelligence is the best predictor of job performance. Current Directions in Psychological Science, 1, 8689.CrossRefGoogle Scholar
Ree, M. J., Earles, J. A., & Teachout, M. S. (1994). Predicting job performance: Not much more than g. Journal of Applied Psychology, 79, 518524.CrossRefGoogle Scholar
Reilly, R. R., & Chao, G. T. (1982). Validity and fairness of some alternate employee selection procedures. Personnel Psychology, 35, 167.CrossRefGoogle Scholar
Roth, P. L., Bobko, P., & McFarland, L. A. (2005). A meta-analysis of work sample test validity: Updating and integrating some classic literature. Personnel Psychology, 58 (4), 10091038.CrossRefGoogle Scholar
Ryan, A. M., & Huth, M. (2008). Not much more than platitudes? A critical look at applicant reaction research. Human Resource Management Review, 18, 119132.CrossRefGoogle Scholar
Ryan, A. M., & Ployhart, R. E. (2000). Applicants' perceptions of selection procedures and decisions: A critical review and agenda for the future. Journal of Management, 26, 565606.CrossRefGoogle Scholar
Sackett, P. R. (1987). Assessment centers and content validity: Some neglected issues. Personnel Psychology, 40, 1325.CrossRefGoogle Scholar
Schmidt, F. L., & Hunter, J. E. (1998). The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. Psychological Bulletin, 124, 262274.CrossRefGoogle Scholar
Schmitt, N., & Chan, D. (2004). An agenda for future research on applicant reactions to selection procedures: A construct-oriented approach. International Journal of Selection and Assessment, 12, 923.Google Scholar
Schmitt, N., Gooding, R. Z., Noe, R. D., & Kirsch, M. (1984). Meta-analyses of validity studies published between 1964 and 1982 and the investigation of study characteristics. Personnel Psychology, 37, 407422.CrossRefGoogle Scholar
Schmitt, N., Rogers, W., Chan, D., Sheppard, L., & Jennings, D. (1997). Adverse impact and predictive efficiency of various predictor combinations. Journal of Applied Psychology, 82, 719730.CrossRefGoogle Scholar
Society for Industrial and Organizational Psychology, Inc. (2003). Principles for the validation and use of personnel selection procedures (4th ed.). Bowling Green, OH: Author.Google Scholar
Society for Industrial and Organizational Psychology (1987). Principles for the validation and use of personnel selection procedures (3rd ed.). College Park, MD: Author.Google Scholar
Truxillo, D. M., Steiner, D. D., & Gilliland, S. W. (2004). The importance of organizational justice in personnel selection: Defining when selection fairness really matters. International Journal of Selection and Assessment, 13, 3953.CrossRefGoogle Scholar
Uniform Guidelines on Employee Selection Procedures. (1978). 29 C.F.R. 1607.Google Scholar

Full text views

Full text views reflects PDF downloads, PDFs sent to Google Drive, Dropbox and Kindle and HTML full text views.

Total number of HTML views: 0
Total number of PDF views: 164 *
View data table for this chart

* Views captured on Cambridge Core between September 2016 - 28th January 2021. This data will be updated every 24 hours.

Hostname: page-component-898fc554b-5qzh9 Total loading time: 0.32 Render date: 2021-01-28T06:33:28.305Z Query parameters: { "hasAccess": "0", "openAccess": "0", "isLogged": "0", "lang": "en" } Feature Flags: { "shouldUseShareProductTool": true, "shouldUseHypothesis": true, "isUnsiloEnabled": true, "metricsAbstractViews": false, "figures": false, "newCiteModal": false }

Send article to Kindle

To send this article to your Kindle, first ensure no-reply@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about sending to your Kindle. Find out more about sending to your Kindle.

Note you can select to send to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be sent to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Content Validation Is Useful for Many Things, but Validity Isn't One of Them
Available formats
×

Send article to Dropbox

To send this article to your Dropbox account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Dropbox.

Content Validation Is Useful for Many Things, but Validity Isn't One of Them
Available formats
×

Send article to Google Drive

To send this article to your Google Drive account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Google Drive.

Content Validation Is Useful for Many Things, but Validity Isn't One of Them
Available formats
×
×

Reply to: Submit a response


Your details


Conflicting interests

Do you have any conflicting interests? *