Skip to main content Accessibility help
×
Hostname: page-component-848d4c4894-sjtt6 Total loading time: 0 Render date: 2024-06-23T13:35:39.753Z Has data issue: false hasContentIssue false

3 - Internal and External Validity

Published online by Cambridge University Press:  05 June 2012

Rose McDermott
Affiliation:
Brown University
James N. Druckman
Affiliation:
Northwestern University, Illinois
Donald P. Greene
Affiliation:
Yale University, Connecticut
James H. Kuklinski
Affiliation:
University of Illinois, Urbana-Champaign
Arthur Lupia
Affiliation:
University of Michigan, Ann Arbor
Get access

Summary

One of the challenges in conducting interdisciplinary work, or in attempting to communicate across disciplinary boundaries, relates to the implicit norms that infuse different fields. Much like trying to speak across cultures, it often becomes frustrating to translate or make explicit differing assumptions underlying appropriate inferential methods and strategies. Status differentials often exacerbate these divergences, privileging one set of disciplinary norms over another, so that decisions about ideal methods do not always rest entirely on the appropriateness of a particular technique for a given project.

Such differences clearly affect the implementation of experimental methodology across the fields of psychology, economics, and political science. One of the areas in which these biases inflict misunderstanding surrounds issues related to internal and external validity. In political science, concerns with external validity often border on the monomaniacal, leading to the neglect, if not the complete dismissal, of attention to the important issues involved in internal validity. In psychology, the reverse emphasis predominates. In behavioral economics, the focus depends more on the primary function of the experiment. Because both internal and external validity remain important in assessing the quality, accuracy, and utility of any given experimental design, it facilitates optimal experimental design to concentrate on attempting to maximize both, but the nature of the enterprise often requires explicit consideration of the trade-offs between them.

Type
Chapter
Information
Publisher: Cambridge University Press
Print publication year: 2011

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Angrist, Joshua, Imbens, Guido, and Rubin, Donald. 1996. “Identification of Causal Effects Using Instrumental Variables.” Journal of the American Statistical Association 91: 444–55.CrossRefGoogle Scholar
Arceneaux, Kevin, Gerber, Alan, and Green, Donald. 2006. “Comparing Experimental and Matching Methods Using a Large-Scale Voter Mobilization Experiment.” Political Analysis 14: 37–62.CrossRefGoogle Scholar
Aronson, Elliott, Ellsworth, Phoebe C., Carlsmith, J. Merrill, and Gonzales, Marti Hope. 1990. Methods of Research in Social Psychology. 2nd ed. New York: McGraw-Hill.Google Scholar
Campbell, Donald T. 1957. “Factors Relevant to Validity of Experiments in Social Settings.” Psychological Bulletin 54: 297–312.CrossRefGoogle ScholarPubMed
Campbell, Donald T., and Stanley, Julian C.. 1966. Experimental and Quasi-Experimental Designs for Research. Chicago: Rand McNally.Google Scholar
Cohen, Dov, and Nisbett, Richard E.. 1994. “Self-Protection and the Culture of Honor: Explaining Southern Violence.” Personality and Social Psychology Bulletin 20: 551–67.CrossRefGoogle Scholar
Darley, John M., and Latane, Bibb. 1968. “Bystander Intervention in Emergencies: Diffusion of Responsibility.” Journal of Personality and Social Psychology 8: 377–83.CrossRefGoogle ScholarPubMed
Quervain, Dominique J.-F., Fischbacher, Urs, Treyer, Valerie, Schellhammer, Melanie, Schnyder, Ulrich, Buck, Alfred, and Fehr, Ernst. 2004. “The Neural Basis of Altruistic Punishment.” Science 305 (5688): 1254–58.CrossRefGoogle ScholarPubMed
Druckman, James N., Green, Donald P., Kuklinski, James H., and Lupia, Arthur. 2006. “The Growth and Development of Experimental Research in Political Science.” American Political Science Review 100: 627–35.CrossRefGoogle Scholar
Druckman, James N., and Lupia, Arthur. 2006. “Mind, Will and Choice.” In The Oxford Handbook on Contextual Political Analysis, eds. Tilly, Charles and Goodin, Robert E.. Oxford: Oxford University Press, 97–113.Google Scholar
Fehr, Ernst, and Fischbacher, Urs. 2003. “The Nature of Human Altruism.” Nature 425: 785–91.CrossRefGoogle ScholarPubMed
Fehr, Ernst, and Gächter, Simon. 2002. “Altruistic Punishment in Humans.” Nature 415: 137–40.CrossRefGoogle ScholarPubMed
Gerber, Alan, and Green, Donald P.. 2000. “The Effects of Canvassing, Telephone Calls, and Direct Mail on Voter Turnout: A Field Experiment.” American Political Science Review 94: 653–63.CrossRefGoogle Scholar
Gigerenzer, Gerd. 1996. “On Narrow Norms and Vague Heuristics: A Reply to Kahneman and Tversky.” Psychological Review 103: 592–96.CrossRefGoogle Scholar
Green, Donald P., and Gerber, Alan. 2002. “The Downstream Benefits of Experimentation.” Political Analysis 10: 394–402.CrossRefGoogle Scholar
Kiesler, Charles A., Collins, Barry E., and Miller, Norman. 1969. Attitude Change: A Critical Analysis of Theoretical Approaches. New York: Wiley.Google Scholar
McDermott, Rose. 2002. “Experimental Methodology in Political Science.” Political Analysis 10: 325–42.CrossRefGoogle Scholar
McDermott, Rose, and Cowden, Jonathan A.. 2001. “The Effects of Uncertainty and Sex in a Simulated Crisis Game.” International Interactions 27: 353–80.CrossRefGoogle Scholar
McDermott, Rose, Tingley, Dustin, Cowden, Jonathan A., Frazzetto, Giovanni, and Johnson, Dominic D. P.. 2009. “Monoamine Oxidase A Gene (MAOA) Predicts Behavioral Aggression Following Provocation.” Proceedings of the National Academy of Sciences 106: 2118–23.CrossRefGoogle ScholarPubMed
Miguel, Edward, Satyanath, Shanker, and Sergenti, Ernest. 2004. “Economic Shocks and Civil Conflict: An Instrumental Variable Approach.” Journal of Political Economy 112: 725–53.CrossRefGoogle Scholar
Milgram, Stanley. 1974. Obedience to Authority. New York: Harper & Row.Google Scholar
Nickerson, David W. 2005. “Scalable Protocols Offer Efficient Design for Field Experiments.” Political Analysis 13: 233–52.CrossRefGoogle Scholar
Roethlisberger, Fritz J., and Dickson, William J.. 1939. Management and the Worker. Cambridge, MA:Harvard University Press.Google Scholar
Roth, Alvin E. 1995. “Introduction to Experimental Economics.” In Handbook of Experimental Economics, eds. Kagel, John H. and Roth, Alvin E.. Princeton, NJ: Princeton University Press, 3–110.Google Scholar
Shadish, William R., Cook, Thomas D., and Campbell, Donald T.. 2002. Experimental and Quasi-Experimental Designs for Generalized Causal Inference. Boston: Houghton-Mifflin.Google Scholar
Smith, Eliot R., and Mackie, Diane M.. 1995. Social Psychology. New York: Worth.Google Scholar
Sokol-Hessner, Peter, Hsu, Ming, Curley, Nina G., Delgado, Mauricio R., Camerer, Colin F., and Phelps, Elizabeth A.. 2009. “Thinking Like a Trader Selectively Reduces Individuals' Loss Aversion.” Proceedings of the National Academy of Sciences 106: 5035–40.CrossRefGoogle Scholar
Sovey, Allison J., and Green, Donald P.. 2011. “Instrumental Variables Estimation in Political Science: A Reader's Guide.” American Journal of Political Science 55: 188–200.CrossRefGoogle Scholar
Tversky, Amos, and Kahneman, Daniel. 1974. “Judgment under Uncertainty: Heuristics and Biases.” Science 185: 1124–31.CrossRefGoogle ScholarPubMed
Walker, T. 1976. “Microanalytic Approaches to Political Decision Making.” American Behavioral Science 20: 93–110.CrossRefGoogle Scholar

Save book to Kindle

To save this book to your Kindle, first ensure coreplatform@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×