Skip to main content Accessibility help
×
Hostname: page-component-8448b6f56d-t5pn6 Total loading time: 0 Render date: 2024-04-19T20:46:18.138Z Has data issue: false hasContentIssue false

8 - The Logic and Design of the Survey Experiment

An Autobiography of a Methodological Innovation

Published online by Cambridge University Press:  05 June 2012

Paul M. Sniderman
Affiliation:
Stanford University
James N. Druckman
Affiliation:
Northwestern University, Illinois
Donald P. Greene
Affiliation:
Yale University, Connecticut
James H. Kuklinski
Affiliation:
University of Illinois, Urbana-Champaign
Arthur Lupia
Affiliation:
University of Michigan, Ann Arbor
Get access

Summary

The title promises a chapter about methods, so a confession is in order. Here, as everywhere, my concerns are substantive, not methodological. Still, what one wants to learn and how one ought to go about learning it are intertwined. So, I propose to bring out the logic of the survey experiment by presenting a classification of survey experiment designs. Specifically, I distinguish three designs: manipulative, permissive, and facilitative. The distinctions among the designs turn on the hypotheses being tested, not the operations performed, and, above all, on the role of predispositions. The first design aims to get people to do what they are not predisposed to do; the second to allow them to do what they are predisposed to do, without encouraging them; and the third to provide them with a relevant reason to do what they already are predisposed to do. Against the background of this threefold classification, I want to comment briefly on some issues of causal inference and external validity and then conclude by offering my own view on the reasons for the explosive growth in survey experiments in the study of public opinion.

The modern survey experiment is the biggest change in survey research in a half century. There is some interest in how it came about, I am told. So I begin by telling how I got the idea of computer-assisted survey experiments.

Type
Chapter
Information
Publisher: Cambridge University Press
Print publication year: 2011

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Apostle, Richard A., Glock, Charles Y., Piazza, Thomas, and Suelze, Marijane. 1983. The Anatomy of Racial Attitudes. Berkeley: University of California Press.Google Scholar
Bartels, Larry, and Brady, Henry E.. 1993. “The State of Quantitative Political Methodology.” In The State of the Discipline II, ed. Finifter, Ada. Washington, DC: American Political Science Association, 121–62.Google Scholar
Chong, Dennis, and Druckman, James N.. 2007a. “Framing Public Opinion in Competitive Democracies.” American Political Science Review 101: 637–55.CrossRefGoogle Scholar
Chong, Dennis, and Druckman, James N.. 2007b. “Framing Theory.” Annual Review of Political Science 10: 103–26.CrossRefGoogle Scholar
Converse, Philip E. 1964. “The Nature of Belief Systems in Mass Publics.” In Ideology and Discontent, ed. Apter, David E.. New York: Free Press, 206–61.Google Scholar
Dawson, Michael C. 2001. Black Visions. Chicago: The University of Chicago Press.Google Scholar
Druckman, James N. 2001a. “Using Credible Advice to Overcome Framing Effects.” Journal of Law, Economics, & Organization 17: 62–82.CrossRefGoogle Scholar
Druckman, James N. 2001b. “On the Limits of Framing Effects.” Journal of Politics 63: 1041–66.CrossRefGoogle Scholar
Druckman, James N. 2001c. “The Implications of Framing Effects for Citizen Competence.” Political Behavior 23: 225–56.CrossRefGoogle Scholar
Druckman, James N. 2004. “Political Preference Formation.” American Political Science Review 98: 671–86.CrossRefGoogle Scholar
Druckman, James N., Hennessy, Cari Lynn, Charles, Kristi, and Weber, Jonathan. 2010. “Competing Rhetoric over Time: Frames versus Cues.” Journal of Politics 72: 136–48.CrossRefGoogle Scholar
Freedman, David A., Pisani, Roger, and Purves, Roger. 1998. Statistics. New York: Norton, 3–11.Google Scholar
Gaines, Brian J., Kuklinski, James H., and Quirk, Paul J.. 2007. “The Logic of the Survey Experiment Reexamined.” Political Analysis 15: 1–20.CrossRefGoogle Scholar
Gibson, James L., and Gouws, Amanda. 2003. Overcoming Intolerance in South Africa: Experiments in Democratic Persuasion. New York: Cambridge University Press.Google Scholar
Hacking, Ian. 1983. Representing and Intervening: Introductory Topics in the Philosophy of Natural Science. New York: Cambridge University Press.CrossRefGoogle Scholar
Hurwitz, Jon, and Peffley, Mark.1998. Perception and Prejudice: Race and Politics in the United States. New Haven, CT: Yale University Press.Google Scholar
Jackman, Simon, and Sniderman, Paul M.. 2006. “The Limits of Deliberative Discussion: A Model of Everyday Political Arguments.” Journal of Politics 68: 272–83.CrossRefGoogle Scholar
Kuklinski, James H., Sniderman, Paul M., Knight, Kathleen, Piazza, Thomas, Tetlock, Philiip E., Lawrence, Gordon R., and Mellers, Barbara. 1997. “Racial Attitudes Toward Affirmative Action.” American Journal of Political Science 41: 402–19.CrossRefGoogle Scholar
Merton, Robert K. 1973. The Sociology of Science. Chicago: The University of Chicago Press.Google Scholar
Nelson, Thomas E., and Kinder, Donald R.. 1996. “Issue Frames and Group-Centrism in American Public Opinion.” Journal of Politics 58: 1055–78.CrossRefGoogle Scholar
Riker, William H. 1996. The Strategy of Rhetoric. New Haven, CT: Yale University Press.Google Scholar
Schuman, Howard, and Presser, Stanley. 1981. Questions and Answers in Attitude Surveys. New York: Academic Press.Google Scholar
Sniderman, Paul M., and Carmines, Edward G.. 1997. Reaching beyond Race. Cambridge, MA: Harvard University Press.Google Scholar
Sniderman, Paul M., Fletcher, Joseph F., Russell, Peter, and Tetlock, Philip E.. 1996. The Clash of Rights: Liberty, Equality, and Legitimacy in Pluralist Democracies. New Haven, CT: Yale University Press.Google Scholar
Sniderman, Paul M., and Piazza, Thomas. 1993. The Scar of Race. Cambridge, MA: Harvard University Press.Google Scholar
Sniderman, Paul M., and Piazza, Thomas. 2002. Black Pride and Black Prejudice. Princeton, NJ: Princeton University Press.Google Scholar
Sniderman, Paul M., Tetlock, Philip E., and Elms, Laurel. 2001. “Public Opinion and Democratic Politics: The Problem of Non-attitudes and Social Construction of Political Judgment.” In Citizens and Politics: Perspectives from Political Psychology, ed. Kuklinski, James H.. New York: Cambridge University Press, 254–84.CrossRefGoogle Scholar
Sniderman, Paul M., and Theriault, Sean M.. 2004. “The Structure of Political Argument and the Logic of Issue Framing.” In Studies in Public Opinion, eds. Saris, Willem and Sniderman, Paul M.. Princeton, NJ: Princeton University Press, 133–65.Google Scholar
Stoker, Laura. 1998. “Understanding Whites' Resistance to Affirmative Action: The Role of Principled Commitments and Racial Prejudice.” In Perception and Prejudice: Race and Politics in the United States, eds. Hurwitz, Jon and Peffley, Mark. New Haven, CT: Yale University Press, 135–70.Google Scholar
Webb, Eugene, J., Campbell, Donald T., Schwartz, Richard D., and Sechrest, Lee. 1996. Unobtrusive Measures: Nonreactive Research in the Social Sciences. New York: Rand McNally.Google Scholar
Zaller, John R. 1992. The Nature and Origins of Mass Opinion. New York: Cambridge University Press.CrossRefGoogle Scholar

Save book to Kindle

To save this book to your Kindle, first ensure coreplatform@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×