Skip to main content Accessibility help
  • Print publication year: 2017
  • Online publication date: July 2017

5 - Field Experiments in Public Management

from Part II - Methods
Allcott, H. 2015. ‘Site selection bias in program evaluation’, Quarterly Journal of Economics 130(3): 1117–65.
Anderson, D. M. and Edwards, B. C. 2014. ‘Unfulfilled promise: laboratory experiments in public management research’, Public Management Review doi: 10.1080/14719037.2014.943272.
Arceneaux, K. and Butler, D. M. 2015. ‘How not to increase participation in local government: the advantages of experiments when testing policy interventions’, Public Administration Review Early view.
Avellaneda, C. N. 2013. ‘Mayoral decision-making: issue salience, decision context, and choice constraint? An experimental study with 120 Latin American mayors’, Journal of Public Administration Research and Theory 23: 631–61.
Bækgaard, M. Baethge, C. Blom-Hansen, J., Dunlop, C., Esteve, M., Jakobsen, M., Kisida, B., Marvel, J., Moseley, A., Serritzlew, S., Stewart, P., Kjaergaard Thomsen, M. and Wolf, P. 2015. ‘Conducting experiments in public management research: a practical guide’, International Public Management Journal 18(2): 323–42.
Banerjee, A. V. and Duflo, E. 2014. ‘The experimental approach to development economics’, in Field Experiments and Their Critics: Essays on the Uses and Abuses of Experimentation in the Social Sciences, edited by Teele, Dawn Langan, 78114. New Haven, CT: Yale University Press.
Barnow, B. S. 2010. ‘Setting up social experiments: the good, the bad, and the ugly’, Zeitschrift für Arbeitsmarkt Forschung 43: 91105.
Barrett, C. B. and Carter, M. R. 2014. ‘Retreat from radical skepticism: rebalancing theory, observational data, and randomization in development economics’, in Field Experiments and Their Critics: Essays on the Uses and Abuses of Experimentation in the Social Sciences, edited by Teele, Dawn Langan, 5877. New Haven, CT: Yale University Press.
Beath, A., Fontina, C. and Enikolopov, R. 2013. ‘Empowering women through development aid: evidence from a field experiment in Afghanistan’, American Political Science Review 107: 540–57.
Belle, N. 2015. ‘Performance-related pay and the crowding out of motivation in the public sector: a randomized field experiment’, Public Administration Review 75 (2): 230–41.
Bonetti, S. 1998. ‘Experimental economics and deception’, Journal of Economic Psychology 19: 377–95.
Boyne, G. A., James, O., John, P. and Petrovsky, N. 2009. ‘Democracy and government performance: holding incumbents accountable in English local governments’, Journal of Politics 71(4): 1273–84.
Bozeman, B and Scott, P. 1992. ‘Laboratory experiments in public management and management’, Journal of Public Administration Research and Theory 2(4): 293313.
Brewer, G. A. and Brewer, G. A. Jr. 2011. ‘Parsing public/private differences in work motivation and performance: an experimental study’, Journal of Public Administration Research and Theory 21(suppl 3): i347–62.
Butler, D. M. 2010. ‘Monitoring bureaucratic compliance: using field experiments to improve governance’, Public Sector Digest 2010 (winter): 41–4.
Butler, D. M. and Brockman, D. E. 2011. ‘Do politicians racially discriminate against constituents? A field experiment on state legislators’, American Journal of Political Science 55: 463–77.
Card, D., DellaVigna, S. and Malmendier, U. 2011. ‘The role of theory in field experiments’, Journal of Economic Perspectives 25(3): 3962.
Colson, G. Corrigan, J. R., Grebitus, G., Loureiro, M. L. and Rousu, M. C. 2015. ‘Which deceptive practices, if any, should be allowed in experimental economics research? Results from surveys of applied experimental economists and students’, American Journal of Agricultural Economics, Early View 112. doi: 10.1093/ajae/aav067.
Coppock, A. and Green, D. P. 2015. ‘Assessing the correspondence between experimental results obtained in the lab and field: a review of recent social science research’, Political Science Research and Methods 3: 113–31.
Cotterill, S. and Richardson, R. 2010. ‘Expanding the use of experiments on civic behavior: experiments with local governments as research partners’, The Annals of the American Academy of Political and Social Science 628: 148–64.
Druckman, J. N. and Kam, C. D. 2011. ‘Students as experimental participants: a defense of the “narrow database”’, in Handbook of Experimental Political Science, edited by Druckman, James, Green, Donald P., Kuklinski, James H. and Lupia, Arthur, 4157. New York: Cambridge University Press.
Duflo, E., Glennerster, R. and Kremer, M. 2006. Using Randomization in Development Economics Research: A Toolkit. Cambridge, National Bureau of Economic Research.
Dunning, T. 2012. Natural Experiments in the Social Sciences. New York: Cambridge University Press.
Falk, A. and Heckman, J. J. 2009. ‘Lab experiments are a major source of knowledge in the social sciences’, Science 326(5952): 535–8.
Fisher, R. A. 1926. ‘The arrangement of field experiments’, Journal of the Ministry of Agriculture of Great Britain 33: 503–13.
Fisher, R. A. 1935. Design of Experiments. Edinburgh: Oliver and Boyd.
Gerber, A. S. and Green, D. P. 2012. Field Experiments: Design, Analysis and Interpretation. New York: Norton.
Green, D. P. and Thorley, D. 2014. ‘Field experimentation and the study of law and policy’, Annual Review of Law and Social Science 10: 5372.
Guala, F. 2005. The Methodology of Experimental Economics. Cambridge: Cambridge University Press.
Harrison, G., Lau, M. and Williams, M. 2002. ‘Estimating individual discount rates in Denmark: a field experiment’, American Economic Review 92(5): 1606–17.
Harrison, G. W. and List, J. A. 2004. ‘Field experiments’, Journal of Economic Literature 42(4): 1009–55.
Henrich, J., Heine, S. J. and Norenzayan, A. 2010. ‘Beyond WEIRD: towards a broadbased behavioural science’, Behavioral and Brain Sciences 33(2–3): 111–35.
Hertwig, R. and Ortmann, R. 2008. ‘Deception in experiments: revisiting the arguments in its defense’, Ethics and Behavior 18 (1): 5982.
Hess, D. R., Hanmer, M. J. and Nickerson, D. M. 2015. ‘Encouraging local bureaucratic compliance with federal civil rights laws: field experiments with agencies implementing the national voter registration act’, unpublished paper. Accessed 8 August 2015.
Jakobsen, M. 2013. ‘Can government initiatives increase citizen coproduction? Results of a randomized field experiment’, Journal of Public Administration Research and Theory 23(1): 2754.
Jakobsen, M. and Andersen, S. 2013. ‘Coproduction and equity in public service delivery’, Public Administration Review 73(5): 704–13.
James, O. 2011. ‘Performance measures and democracy: information effects on citizens in field and laboratory experiments’, Journal of Public Administration Research and Theory 21: 399418.
James, O. and Moseley, A. 2014. ‘Does performance information about public services affect citizens’ perceptions, satisfaction, and voice behaviour? Field experiments with absolute and relative performance information’. Public Administration 92(2): 493511.
John, P. (2016) Experimentation in Political Science and Public Policy The Challenge and Promise of Field Trials. London: Routledge.
John, P., Cotterill, S., Moseley, A., Richardson, L., Smith, G., Stoker, G. and Wales, C. 2011. Nudge, Nudge, Think, Think: Experimenting with Ways to Change Civic Behaviour. London: Bloomsbury Academic.
Levitt, S. D. and List, J. A. 2009. ‘Field experiments in economics: the past, the present, and the future’, European Economic Review 53: 118.
List, J. 2011. ’Why economists should conduct field experiments and 14 tips for pulling one off’, Journal of Economic Perspectives 25(3): 316.
List, J. and Metcalfe, R. 2014. ‘Field experiments in the developed world: an introduction’, Oxford Review of Economic Policy 30(4): 585–96.
Manzi, J. 2012. Uncontrolled: The Surprising Payoff of Trial-and-Error for Business, Politics, and Society. New York: Basic Books.
Margetts, H. Z. 2011. ‘Experiments for public management research’, Public Management Review 13(2): 189208.
McClendon, G. H. 2012. ‘Ethics of using public officials as field experiment subjects’, Newsletter of the APSA Experimental Section 3: 1320.
Medical Research Council 1948. ‘Streptomycin treatment of pulmonary tuberculosis’, British Medical Journal 2(4582): 769–82.
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gøtzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., Altman, D. G. 2010. ‘CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomized trials’, British Medical Journal 340: c869.
Moseley, A., James, O., John, P. Richardson, L. Ryan, M. and Stoker, G. 2015. ‘Can approaches shown to increase monetary donations to charity also increase voluntary donations of time? Evidence from field experiments using social information’, Unpublished working paper.
Moseley, A. and Stoker, G. 2015. ‘Putting public policy defaults to the test: the case of organ donor registration’, International Public Management Journal 18(2): 246–64.
Mutz, D. C. 2011. Population-Based Survey Experiments. Princeton, NJ: Princeton University Press.
Olken, B. 2007. ‘Monitoring corruption: evidence from a field experiment in Indonesia’, Journal of Political Economy 115: 200–49.
Orr, L. L. 1999. Social Experiments: Evaluating Public Programs with Experimental Methods. Thousand Oaks, CA: Sage.
Pawson, R. and Tilley, N. 1997. Realistic Evaluation. London: Sage.
Riccio, J. and Bloom, H. S. 2002. ‘Extending the reach of randomized social experiments: new directions in evaluations of American welfare-to-work and employment initiatives’, Journal of the Royal Statistical Society: Series A (Statistics in Society) 165: 1330.
Rothwell, P. M. 2015. ‘External validity of randomized controlled trials: to whom do the results of this trial apply?The Lancet 365: 8293.
Rousu, M. C., Colson, G., Corrigan, J. R., Grebitus, C. and Loureiro, M. L. 2015. ‘Deception in experiments: towards guidelines on use in applied economics research’, Applied Economic Perspectives and Psychology 37(3): 524–36.
Salovey, P. and Williams-Piehota, P. 2004. ‘Field experiments in social psychology message framing and the promotion of health protective behaviors’, American Behavioral Scientist 47(5): 488505.
Salsburg, D. 2001. The Lady Tasting Tea: How Statistics Revolutionized Science in the Twentieth Century. New York WH Freeman.
Shadish, William R., Cook, T. D. Thomas D., and Campbell, Donald T. 2002. Experimental and Quasi-Experimental Designs for Generalized Causal Inference. Boston: Houghton Mifflin Company.
Shafir, E. (ed.) 2013. The Behavioral Foundations of Public Policy. Princeton, NJ: Princeton University Press.
Sherman, L. W. and Rogan, D. P. 1995. ‘Deterrent effects of police raids on crack houses: a randomized, controlled experiment’, Justice Quarterly 12: 755–81.
Sherman, L., Rogan, D., Edwards, T., Whipple, R., Shreve, D., Witcher, D., Trimble, W., The Street Narcotics Unit, Velke, R., Blumberg, M., Beatty, A. and Bridgeforth, C. 1995. ‘Deterrent effects of police raids on crack houses: a randomized, controlled experiment’, Justice Quarterly 12: 755–81.
Sherman, L. W. and Weisburd, D. 1995. ‘General deterrent effects of police patrol in crime hot spots: a randomized, controlled trial’, Justice Quarterly 12(4): 635–48.
Soloman, P., Cavanaugh, M. M. and Draine, J. 2009. Randomized Controlled Trials: Design and Implementation for Community Based Psychosocial Interventions. Oxford: Oxford University Press.
Teele, D. L. 2015. ‘Reflections on the ethics of field experiments’, in Field Experiments and Their Critics: Essays on the Uses and Abuses of Experimentation in the Social Sciences, edited by Teele, Dawn Langan, 115–40. New Haven, CT: Yale University Press.
Torgerson, D. J. and Torgerson, C. J. 2008. Designing Randomized Trials in Health, Education and the Social Sciences. Basingstoke: Palgrave.
Vivalt, E. 2015. ‘Heterogeneous treatment effects in impact evaluation’, American Economic Review: Papers & Proceedings 105: 467–70.
Worthy, B., John, P. and Vannoni, M. 2015. ‘Information requests and local accountability: an experimental analysis of local parish responses to an informational campaign’, Unpublished paper.
Yates, F. 1964. ‘Sir Ronald Fisher and the design of experiments’, Biometrics 20: 307–21.