Hostname: page-component-8448b6f56d-sxzjt Total loading time: 0 Render date: 2024-04-18T10:30:13.126Z Has data issue: false hasContentIssue false
  • English
  • Français

The realities of scaling within evidence-based policy

Published online by Cambridge University Press:  09 July 2020

LAUREN H. SUPPLEE  and
MAGGIE C. KANE
LAUREN H. SUPPLEE*
Affiliation:
Child Trends, Bethesda, MD, USA
MAGGIE C. KANE
Affiliation:
Child Trends, Bethesda, MD, USA
*
*Correspondence to: Child Trends, 7315 Wisconsin Ave #1200w, Bethesda, MD20814, USA. E-mail: lauren.supplee@gmail.com
Get access Rights & Permissions [Opens in a new window]

Abstract

The economic model for scaling described by Al-Ubaydli and colleagues offers recommendations to policymakers who make decisions about whether or not to implement evidence-based programs. The core economic model does not currently acknowledge the broader context of policy decision-making and therefore may fail to achieve its objectives. The model focuses primarily on the generation and use of available research in the decision on whether to scale a program. Research studying the use of evidence in policymaking points to a complex set of factors beyond just the strength of the evidence such as leadership, relationships, timing and financial resources that contribute to decisions to scale a program. Second, there is already a robust evidence-based policy movement at the federal, state and local levels. The economic model should leverage this movement rather than providing recommendations that might stall or redirect the movement. The economic model can push the field to strengthen the available evidence while providing recommendations on selecting models to scale within the currently available evidence. This commentary finishes with suggestions for moving forward.

Type
Articles
Information
Behavioural Public Policy , Volume 5 , Special Issue 1: Field Experiments and Public Policy , January 2021 , pp. 90 - 102
Copyright
Copyright © The Author(s) 2020. Published by Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Aarons, G. A., Hurlburt, M. and Horwitz, S. M. (2011), ‘Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors’, Administration and Policy in Mental Health, 38(1): 4–23. doi:https://doi.org/10.1007/s10488-010-0327-7CrossRefGoogle ScholarPubMed
Araujo, M. C., Rubio-Codina, M. and Schady, N. (In press), 70 to 700 to 70,000: Lessons from the Jamaica Experiment. In List, J., Suskind, D. and Supplee, L. (eds), The Scale-Up Effect: Why interventions lose impact at scale and what we can do about it. Routledge.Google Scholar
Avellar, S. A., Thomas, J., Kleinman, R., Sama-Miller, E., Woodruff, S. E., Coughlin, R. and Westbrook, T. R. (2017), ‘External Validity: The Next Step for Systematic Reviews?’ Evaluation Review, 41(4): 283- 325. https://doi.org/10.1177/0193841X16665199CrossRefGoogle ScholarPubMed
Boaz, A., Davies, H., Fraser, A. and Nutley, S. (eds), (2019), What Works Now? Evidence-Based Policy and Practice Revisited. Bristol, UK: Policy Press.Google Scholar
Bogenschneider, K., Corbett, T. J. and Parrot, E. (2019a), ‘Realizing the Promise of Research in Policymaking:’, Journal of Family Theory & Review, 11: 127–147. https://doi.org/10.1111/jftr.12310CrossRefGoogle Scholar
Bogenschneider, K., Day, E. and Parrot, E. (2019b), ‘Revisiting Theory on Research Use: Turning to Policymakers for Fresh Insights’, American Psychologist, 74(7): 778–793. https://doi.org/10.1037/amp0000460CrossRefGoogle Scholar
Broder-Fingert, S., Kuhn, J., Sheldrick, R.C., et al. (2019), ‘Using the Multiphase Optimization Strategy (MOST) framework to test intervention delivery strategies: a study protocol’, Trials 20: 728. doi:10.1186/s13063-019-3853-yCrossRefGoogle ScholarPubMed
Cairney, P., Oliver, K. and Wellstead, A. (2016), ‘To Bridge the Divide between Evidence and Policy: Reduce Ambiguity as Much as Uncertainty’, Public Administration Review, 76(3): 399–402. https://doi.org/10.1111/puar.12555CrossRefGoogle Scholar
Carter, S., Dhaliwal, I., Friedlander, S. and Walsh, C. (In press), Forging Collaborations for Scale: Catalyzing Partnerships Among Policymakers, Practitioners, Researchers, Funders, and Evidence to Policy Organizations. In List, J., Suskind, D. and Supplee, L. (eds), The Scale-up Effect in Early Childhood and Public Policy: Why interventions lose impact on scale and what we can do about it. Routledge.Google Scholar
Chorpita, B.F., Daleiden, E.L. & Weisz, J.R. Ment Health Serv Res (2005), 7: 5. https://doi.org/10.1007/s11020-005-1962-6CrossRefGoogle Scholar
Collins, L. M., Baker, T. B., Mermelstein, R. J., Piper, M. E., Jorenby, D. E., Smith, S. S., … Fiore, M. C. (2011), ‘The multiphase optimization strategy for engineering effective tobacco use interventions’, Annals of behavioral medicine: a publication of the Society of Behavioral Medicine, 41(2): 208–226. doi:10.1007/s12160-010-9253-xCrossRefGoogle ScholarPubMed
Davies, H., Nutley, S. and Walter, I. (2008), ‘Why ‘knowledge transfer' is misconceived for applied social research’, Journal of Health Services Research & Policy, 13(3): 188–190. https://doi.org/10.1258/jhsrp.2008.008055CrossRefGoogle ScholarPubMed
Feldman Farb, A and Margolis, A. L. (2016), ‘The Teen Pregnancy Prevention Program (2010–2015): Synthesis of Impact Findings’, American Journal of Public Health, 106: S9-S15. https://doi.org/10.2105/AJPH.2016.303367.CrossRefGoogle ScholarPubMed
Harper, K. and Temkin, D. (2018), New school safety bills could make schools less safe from kids. Retrieved from https://www.childtrends.org/new-school-safety-bills-could-make-schools-less-safe-for-kidsGoogle Scholar
Haskins, R. and Baron, J. (2011), Building the Connection between Policy and Evidence: The Obama evidence-based initiatives. NESTA. Retrieved from http://coalition4evidence.org/wp-content/uploads/2011/09/Haskins-Baron-paper-on-fed-evid-based-initiatives-2011.pdfGoogle Scholar
Haskins, R. and Margolis, G. (2014), Show Me The Evidence: Obama's Fight for Rigor and Results in Social Policy. Washington, DC: Brookings Institution Press.Google Scholar
Head, B. W. (2010), ‘Reconsidering evidence-based policy: Key issues and challenges’, Policy and Society, 29(2): 77–94. https://doi.org/10.1016/j.polsoc.2010.03.001CrossRefGoogle Scholar
Kingdon, J. W. (1995), The Policy Window, and Joining the Streams. In Agendas, Alternatives, and Public Policies (Second ed., pp. 165–195). Addison-Wesley Educational Publishers.Google Scholar
Lipsey, M. W. (2009), ‘The primary factors that characterize effective interventions with juvenile offenders: A meta-analytic overview’, Victims & Offenders, 4(2): 124–147. https://doi.org/10.1080/15564880802612573CrossRefGoogle Scholar
Maki, J. and Lieb, R (2009), ‘Washington State Institute for Public Policy: Origins and Governance, Olympia: Washington State Institute for Public Policy’, Document No. 09-06-4101.Google Scholar
McKlindon, A (2019), Applying the research and evaluation provisions of the Family First Prevention Services Act. Retrieved from https://www.childtrends.org/wp-content/uploads/2019/10/FamilyFirst_ChildTrends_October2019.pdfGoogle Scholar
Michalopoulos, C., Faucetta, K., Hill, C. J., Portilla, X. A., Burrell, L., Lee, H., . . . Knox, V. (2019), Impacts on Family Outcomes of Evidence-Based Early Childhood Home Visiting: Results from the Mother and Infant Home Visiting Program Evaluation. Washington, DC: Office of Planning, Research, and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.Google Scholar
Modan, N. (2019, August 27). 50 States of Ed Policy: States, districts tackle gun policies as lawmakers remain gridlocked. Retrieved from https://www.educationdive.com/news/the-50-states-of-education-policy-tackling-school-safety-in-an-age-of-mass/561670/Google Scholar
National Research Council. (2012), Using Science as Evidence in Public Policy. Washington, DC: The National Academies Press. doi:https://doi.org/10.17226/13460Google Scholar
Nutley, S., Boaz, A., Davies, H. and Fraser, A. (2019), ‘New development: What works now? Continuity and change in the use of evidence to improve public policy and service delivery’, Public Money & Management, 39 (4): 310–316. DOI: 10.1080/09540962.2019.1598202CrossRefGoogle Scholar
Nutley, S. M., Walter, I. and Davies, H. T. (2007), Using evidence: How research can inform public services (1 ed.). Bristol, UK: Bristol University Press, Policy Press. https://doi.org/10.2307/j.ctt9qgwt1CrossRefGoogle Scholar
Office of Management and Budget (2019) Circular A 11, Section 290 Evaluation and Evidence Building Activities. Retrieved from https://www.whitehouse.gov/wp-content/uploads/2018/06/s290.pdfGoogle Scholar
Oliver, K., Innvar, S., Lorenc, T., Woodman, J. and Thomas, J. (2014), ‘A systematic review of barriers to and facilitators of the use of evidence by policymakers’, BMC Health Services Research, 14(2). Retrieved from http://www.biomedcentral.com/1472-6963/14/2CrossRefGoogle ScholarPubMed
Pennsylvania Commission on Crime and Delinquency (2019), Cost-Benefit Analysis for PCCD's Evidence-based Initiatives – Full Report: Investing in Effective Programs to Improve Lives and Save Tax Payer Dollars. Retrieved from https://www.pccd.pa.gov/Juvenile-Justice/Documents/Cost-Benefit_Analysis_for_PCCDs_Evidence-based_Initiatives_FULL-Report_5-28-19.pdfGoogle Scholar
Penuel, W. R., Farrell, C. C., Allen, A. R., Toyama, Y., Coburn, C. E. (2018), ‘What research district leaders find useful’, Educational Policy, 32(4): 540–568. DOI:10.1177.0895904816673580CrossRefGoogle Scholar
Pew-MacArthur Results First Initiative. (2017), How States Engage in Evidence-Based Policymaking. Retrieved from https://www.pewtrusts.org/en/research-and-analysis/reports/2017/01/how-states-engage-in-evidence-based-policymakingGoogle Scholar
Supplee, L. H. and McCann, T. (2019), There's No Place Like Home: Improving Outcomes One Home Visit at a Time. Chapter in Hart, N. and Yohannes, M. (eds), Evidence Works: Cases Where Evidence Meaningfully Informed Policy. Washington, D.C.: Bipartisan Policy Center.Google Scholar
Supplee, L. H. and Metz, A. (2015), ‘Opportunities and challenges in evidence-based social policy’, Social Policy Report, 28(4): 1–16.CrossRefGoogle Scholar
Tseng, V., Easton, J. Q. and Supplee, L. H. (2017), ‘Research-Practice Partnerships: Building Two-Way Streets of Engagement’, Social Policy Report, 30(4): https://doi.org/10.1002/j.2379-3988.2017.tb00089.xCrossRefGoogle Scholar