Hostname: page-component-848d4c4894-xfwgj Total loading time: 0 Render date: 2024-06-30T03:18:41.183Z Has data issue: false hasContentIssue false

Phoning It In: Overcoming Implementation Challenges in Field-Experiment Partnerships

Published online by Cambridge University Press:  04 April 2018

Brian Robert Calfano*
Affiliation:
University of Cincinnati

Abstract

The use of field experiments in political science has become extensive, but the promise of conducting a randomized intervention in a “real world” setting also raises perils for researchers. Partnering with organizations to deliver a randomized intervention may be a cost effective route to data collection, but a long-distance partnership presents certain challenges. In particular, the researcher needs to be especially vigilant about treatment application given the potential for noncompliance with the random assignment schedule. I provide an evaluation of a field intervention’s effectiveness where the long-distance partner organization inadvertently violated the random assignment of voter precincts in a canvassing effort prior to a citizen vote to repeal a non-discrimination housing ordinance protecting LGBT residents of a Midwestern city. I then provide recommendations for researchers to help mitigate treatment noncompliance when they cannot be present during treatment delivery.

Type
Articles
Copyright
Copyright © American Political Science Association 2018 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

REFERENCES

Angrist, Joshua D. 1990. “Lifetime Earning and the Vietnam Era Draft Lottery: Evidence from Social Security Administrative Records.” American Economic Review 80: 313–36.Google Scholar
Broockman, David, and Kalla, Joshua. 2016. “Durability Reducing Transphobia: A Field Experiment on Door-to-Door Canvassing.” Science 352: 220–24.Google Scholar
Gerber, Alan S., and Green, Donald P.. 2008. Get Out the Vote: How to Increase Voter Turnout, second edition. Washington, DC: Brookings Institution.Google Scholar
Gerber, Alan S., Green, Donald P., and Kaplan, Edward H.. 2014. “The Illusion of Learning from Observational Research.” In Field Experiments and Their Critics: Essays on the Uses and Abuses of Experimentation in the Social Sciences, ed. Teele, Dawn Langan, 932. New Haven, CT: Yale University Press.Google Scholar
Green, Donald P., Calfano, Brian R., and Aronow, Peter M.. 2014. “Field Experiment Designs for the Study of Media Effects.” Political Communication 31: 168–80.Google Scholar
Lin, Winston. 2013. “Agnostic Notes on Regression Adjustments to Experimental Data: Reexamining Freedman’s Critique.” The Annals of Applied Statistics 7: 295318.Google Scholar
Nickerson, David W. 2005. “Scalable Protocols Offer Efficient Design for Field Experiments.” Political Analysis 13: 233–52.CrossRefGoogle Scholar