Skip to main content Accessibility help
×
Home
Hostname: page-component-684bc48f8b-mkrr2 Total loading time: 0.278 Render date: 2021-04-10T23:19:49.115Z Has data issue: true Feature Flags: { "shouldUseShareProductTool": true, "shouldUseHypothesis": true, "isUnsiloEnabled": true, "metricsAbstractViews": false, "figures": false, "newCiteModal": false, "newCitedByModal": true }

The realities of scaling within evidence-based policy

Published online by Cambridge University Press:  09 July 2020

LAUREN H. SUPPLEE
Affiliation:
Child Trends, Bethesda, MD, USA
MAGGIE C. KANE
Affiliation:
Child Trends, Bethesda, MD, USA
Corresponding
E-mail address:

Abstract

The economic model for scaling described by Al-Ubaydli and colleagues offers recommendations to policymakers who make decisions about whether or not to implement evidence-based programs. The core economic model does not currently acknowledge the broader context of policy decision-making and therefore may fail to achieve its objectives. The model focuses primarily on the generation and use of available research in the decision on whether to scale a program. Research studying the use of evidence in policymaking points to a complex set of factors beyond just the strength of the evidence such as leadership, relationships, timing and financial resources that contribute to decisions to scale a program. Second, there is already a robust evidence-based policy movement at the federal, state and local levels. The economic model should leverage this movement rather than providing recommendations that might stall or redirect the movement. The economic model can push the field to strengthen the available evidence while providing recommendations on selecting models to scale within the currently available evidence. This commentary finishes with suggestions for moving forward.

Type
Articles
Copyright
Copyright © The Author(s) 2020. Published by Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below.

References

Aarons, G. A., Hurlburt, M. and Horwitz, S. M. (2011), ‘Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors’, Administration and Policy in Mental Health, 38(1): 423. doi:https://doi.org/10.1007/s10488-010-0327-7CrossRefGoogle ScholarPubMed
Araujo, M. C., Rubio-Codina, M. and Schady, N. (In press), 70 to 700 to 70,000: Lessons from the Jamaica Experiment. In List, J., Suskind, D. and Supplee, L. (eds), The Scale-Up Effect: Why interventions lose impact at scale and what we can do about it. Routledge.Google Scholar
Avellar, S. A., Thomas, J., Kleinman, R., Sama-Miller, E., Woodruff, S. E., Coughlin, R. and Westbrook, T. R. (2017), ‘External Validity: The Next Step for Systematic Reviews?Evaluation Review, 41(4): 283- 325. https://doi.org/10.1177/0193841X16665199CrossRefGoogle ScholarPubMed
Boaz, A., Davies, H., Fraser, A. and Nutley, S. (eds), (2019), What Works Now? Evidence-Based Policy and Practice Revisited. Bristol, UK: Policy Press.Google Scholar
Bogenschneider, K., Corbett, T. J. and Parrot, E. (2019a), ‘Realizing the Promise of Research in Policymaking:’, Journal of Family Theory & Review, 11: 127147. https://doi.org/10.1111/jftr.12310CrossRefGoogle Scholar
Bogenschneider, K., Day, E. and Parrot, E. (2019b), ‘Revisiting Theory on Research Use: Turning to Policymakers for Fresh Insights’, American Psychologist, 74(7): 778793. https://doi.org/10.1037/amp0000460CrossRefGoogle Scholar
Broder-Fingert, S., Kuhn, J., Sheldrick, R.C., et al. (2019), ‘Using the Multiphase Optimization Strategy (MOST) framework to test intervention delivery strategies: a study protocol’, Trials 20: 728. doi:10.1186/s13063-019-3853-yCrossRefGoogle ScholarPubMed
Cairney, P., Oliver, K. and Wellstead, A. (2016), ‘To Bridge the Divide between Evidence and Policy: Reduce Ambiguity as Much as Uncertainty’, Public Administration Review, 76(3): 399402. https://doi.org/10.1111/puar.12555CrossRefGoogle Scholar
Carter, S., Dhaliwal, I., Friedlander, S. and Walsh, C. (In press), Forging Collaborations for Scale: Catalyzing Partnerships Among Policymakers, Practitioners, Researchers, Funders, and Evidence to Policy Organizations. In List, J., Suskind, D. and Supplee, L. (eds), The Scale-up Effect in Early Childhood and Public Policy: Why interventions lose impact on scale and what we can do about it. Routledge.Google Scholar
Chorpita, B.F., Daleiden, E.L. & Weisz, J.R. Ment Health Serv Res (2005), 7: 5. https://doi.org/10.1007/s11020-005-1962-6CrossRefGoogle Scholar
Collins, L. M., Baker, T. B., Mermelstein, R. J., Piper, M. E., Jorenby, D. E., Smith, S. S., … Fiore, M. C. (2011), ‘The multiphase optimization strategy for engineering effective tobacco use interventions’, Annals of behavioral medicine: a publication of the Society of Behavioral Medicine, 41(2): 208226. doi:10.1007/s12160-010-9253-xCrossRefGoogle ScholarPubMed
Davies, H., Nutley, S. and Walter, I. (2008), ‘Why ‘knowledge transfer' is misconceived for applied social research’, Journal of Health Services Research & Policy, 13(3): 188190. https://doi.org/10.1258/jhsrp.2008.008055CrossRefGoogle ScholarPubMed
Feldman Farb, A and Margolis, A. L. (2016), ‘The Teen Pregnancy Prevention Program (2010–2015): Synthesis of Impact Findings’, American Journal of Public Health, 106: S9-S15. https://doi.org/10.2105/AJPH.2016.303367.CrossRefGoogle ScholarPubMed
Harper, K. and Temkin, D. (2018), New school safety bills could make schools less safe from kids. Retrieved from https://www.childtrends.org/new-school-safety-bills-could-make-schools-less-safe-for-kidsGoogle Scholar
Haskins, R. and Baron, J. (2011), Building the Connection between Policy and Evidence: The Obama evidence-based initiatives. NESTA. Retrieved from http://coalition4evidence.org/wp-content/uploads/2011/09/Haskins-Baron-paper-on-fed-evid-based-initiatives-2011.pdfGoogle Scholar
Haskins, R. and Margolis, G. (2014), Show Me The Evidence: Obama's Fight for Rigor and Results in Social Policy. Washington, DC: Brookings Institution Press.Google Scholar
Head, B. W. (2010), ‘Reconsidering evidence-based policy: Key issues and challenges’, Policy and Society, 29(2): 7794. https://doi.org/10.1016/j.polsoc.2010.03.001CrossRefGoogle Scholar
Kingdon, J. W. (1995), The Policy Window, and Joining the Streams. In Agendas, Alternatives, and Public Policies (Second ed., pp. 165195). Addison-Wesley Educational Publishers.Google Scholar
Lipsey, M. W. (2009), ‘The primary factors that characterize effective interventions with juvenile offenders: A meta-analytic overview’, Victims & Offenders, 4(2): 124147. https://doi.org/10.1080/15564880802612573CrossRefGoogle Scholar
Maki, J. and Lieb, R (2009), ‘Washington State Institute for Public Policy: Origins and Governance, Olympia: Washington State Institute for Public Policy’, Document No. 09-06-4101.Google Scholar
McKlindon, A (2019), Applying the research and evaluation provisions of the Family First Prevention Services Act. Retrieved from https://www.childtrends.org/wp-content/uploads/2019/10/FamilyFirst_ChildTrends_October2019.pdfGoogle Scholar
Michalopoulos, C., Faucetta, K., Hill, C. J., Portilla, X. A., Burrell, L., Lee, H., . . . Knox, V. (2019), Impacts on Family Outcomes of Evidence-Based Early Childhood Home Visiting: Results from the Mother and Infant Home Visiting Program Evaluation. Washington, DC: Office of Planning, Research, and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.Google Scholar
Modan, N. (2019, August 27). 50 States of Ed Policy: States, districts tackle gun policies as lawmakers remain gridlocked. Retrieved from https://www.educationdive.com/news/the-50-states-of-education-policy-tackling-school-safety-in-an-age-of-mass/561670/Google Scholar
National Research Council. (2012), Using Science as Evidence in Public Policy. Washington, DC: The National Academies Press. doi:https://doi.org/10.17226/13460Google Scholar
Nutley, S., Boaz, A., Davies, H. and Fraser, A. (2019), ‘New development: What works now? Continuity and change in the use of evidence to improve public policy and service delivery’, Public Money & Management, 39 (4): 310316. DOI: 10.1080/09540962.2019.1598202CrossRefGoogle Scholar
Nutley, S. M., Walter, I. and Davies, H. T. (2007), Using evidence: How research can inform public services (1 ed.). Bristol, UK: Bristol University Press, Policy Press. https://doi.org/10.2307/j.ctt9qgwt1CrossRefGoogle Scholar
Office of Management and Budget (2019) Circular A 11, Section 290 Evaluation and Evidence Building Activities. Retrieved from https://www.whitehouse.gov/wp-content/uploads/2018/06/s290.pdfGoogle Scholar
Oliver, K., Innvar, S., Lorenc, T., Woodman, J. and Thomas, J. (2014), ‘A systematic review of barriers to and facilitators of the use of evidence by policymakers’, BMC Health Services Research, 14(2). Retrieved from http://www.biomedcentral.com/1472-6963/14/2CrossRefGoogle ScholarPubMed
Pennsylvania Commission on Crime and Delinquency (2019), Cost-Benefit Analysis for PCCD's Evidence-based Initiatives – Full Report: Investing in Effective Programs to Improve Lives and Save Tax Payer Dollars. Retrieved from https://www.pccd.pa.gov/Juvenile-Justice/Documents/Cost-Benefit_Analysis_for_PCCDs_Evidence-based_Initiatives_FULL-Report_5-28-19.pdfGoogle Scholar
Penuel, W. R., Farrell, C. C., Allen, A. R., Toyama, Y., Coburn, C. E. (2018), ‘What research district leaders find useful’, Educational Policy, 32(4): 540568. DOI:10.1177.0895904816673580CrossRefGoogle Scholar
Pew-MacArthur Results First Initiative. (2017), How States Engage in Evidence-Based Policymaking. Retrieved from https://www.pewtrusts.org/en/research-and-analysis/reports/2017/01/how-states-engage-in-evidence-based-policymakingGoogle Scholar
Supplee, L. H. and McCann, T. (2019), There's No Place Like Home: Improving Outcomes One Home Visit at a Time. Chapter in Hart, N. and Yohannes, M. (eds), Evidence Works: Cases Where Evidence Meaningfully Informed Policy. Washington, D.C.: Bipartisan Policy Center.Google Scholar
Supplee, L. H. and Metz, A. (2015), ‘Opportunities and challenges in evidence-based social policy’, Social Policy Report, 28(4): 1–16.CrossRefGoogle Scholar
Tseng, V., Easton, J. Q. and Supplee, L. H. (2017), ‘Research-Practice Partnerships: Building Two-Way Streets of Engagement’, Social Policy Report, 30(4): https://doi.org/10.1002/j.2379-3988.2017.tb00089.xCrossRefGoogle Scholar

Altmetric attention score

Full text views

Full text views reflects PDF downloads, PDFs sent to Google Drive, Dropbox and Kindle and HTML full text views.

Total number of HTML views: 75
Total number of PDF views: 152 *
View data table for this chart

* Views captured on Cambridge Core between 09th July 2020 - 10th April 2021. This data will be updated every 24 hours.

Send article to Kindle

To send this article to your Kindle, first ensure no-reply@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about sending to your Kindle. Find out more about sending to your Kindle.

Note you can select to send to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be sent to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

The realities of scaling within evidence-based policy
Available formats
×

Send article to Dropbox

To send this article to your Dropbox account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Dropbox.

The realities of scaling within evidence-based policy
Available formats
×

Send article to Google Drive

To send this article to your Google Drive account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Google Drive.

The realities of scaling within evidence-based policy
Available formats
×
×

Reply to: Submit a response


Your details


Conflicting interests

Do you have any conflicting interests? *