Skip to main content Accessibility help
×
Home

Measuring Health Program Effectiveness in the Field: An Assessment Tool

  • Sharon M. McDonnell (a1), Abdiaziz S. Yassin (a2), Wayne G. Brown (a3), Helen N. Perry (a4) and Stephen B. Thacker (a5)...

Abstract

To assist field workers in program evaluation and to explicitly discuss program strengths and weaknesses, a practical method to estimate the effectiveness of public health interventions within the existing program capacity was developed. The method and materials were tested in seven countries (Afghanistan, Zimbabwe, Tanzania, Uganda, Guatemala, the Philippines, and Ghana). In this method, four core components are assessed using a questionnaire: (1) the efficacy of the intervention; (2) the level of existing human resources (i.e., quality of recruitment, training, and continuing education); (3) the infrastructure (i.e., supplies, salary, transportation, and supervision); and (4) the level of community support (i.e., access and demand). Using the assessment tool provided, program staff can determine if all necessary elements are in place for a successful program that can deliver the specific intervention. Based on the results of the assessment program, weaknesses can be identified, explicitly discussed, and addressed.The usefulness of this tool in humanitarian relief may be twofold: (1) to assess the design and implementation of effective programs; and (2) to highlight the inevitable need for capacity building as the disaster situation evolves.

Copyright

Corresponding author

Sharon M. McDonnell, MD, MPH c/o Dartmouth Medical School, PO Box 197 Peacham, Vermont 05862, USA E-mail: sharon.mcdonnell@dartmouth.edu

References

Hide All
1.Zwi, AB: How should the health community respond to violent political conflict? PLoS Med 2004;1(1):e14.
2.Bolton, P, Bass, J, Murray, L, et al. : Expanding the scope of humanitarian program evaluation. Prehospital Disast Med 2007;22(5):390395.
3.Weisbrod, BA: Costs and benefits of medical research: A case study of poliomyelitis. J Polit Econ 1971;79:527544.
4.Shepard, DS, Sanoh, L, Coffi, E: Cost-effectiveness of the expanded programme on immunization in the Ivory Coast: A preliminary assessment. Soc Sci Med 1986;22(3):369377.
5.Glasgow, RE, Vogt, TM, Boles, SM: Evaluating the public health impact of health promotion interventions: The RE-AIM framework. Am J Public Health 1999;89:13221327.
6.Gilson, L: Discussion in defense and pursuit of equity. Soc Sci Med 1996;47:18911896.
7.Guidebook for Planning Education in Emergencies and Reconstruction. Chapter 3: Capacity Building. Paris: International Institute for Educational Planning. Available at www.unesco.org/iiep. Accessed 10 June 2007.
8.Potter, C, Brough, R: Systemic capacity building: A hierarchy of needs. Health Policy Plan 2004:19(5):336345.
9.Thacker, SB, Ikeda, RM, Gieseker, KE, et al. : The evidence base for public health informing policy at the Centers for Disease Control and Prevention. Am J Prev Med 2005:29(3):227233.
10.Over, M: Economics for Health Sector Analysis: Concepts and Cases. Washington DC: World Bank, 1991, pp 189190.
11.World Bank: Issues and Options in Health Financing in Turkey. World Bank Report No. 8042-TU. Washington DC: World Bank, 1990.
12.Teutsch, SM, Haddix, AC: Decision Analysis for Public Health. In: Haddix, A, Teutsch, SM, Shaffer, PA, et al. (eds), Prevention Effectiveness: A Guide to Decision Analysis and Economic Evaluation. New York: Oxford University Press, 1996.
13.Tucker, AW, Haddix, AC, Bresee, JS, et al. : Cost-effectiveness analysis of a rotavirus immunization program for the United States. JAMA 1998;279(17):13711376.
14.Mowafi, H. Nowak, K, Hein, K: Facing the challenges in human resources for humanitarian health. Prehospital Disast Med 2007;22(5):351359.
15.El Zein, HA, Birmingham, ME, Karrar, ZA, et al. : Rehabilitation of the expanded programme on immunization in Sudan following a poliomyelitis outbreak. Bull World Health Organ 1998;76(4):335341.
16.Harmon, RG: Training and education for public health: The role of the US Public Health Service. Am J Prev Med 1996;12:151155.
17.Davis, DA, Thomson, MS, Oxman, AD, et al. : Changing physician performance: A systematic review of the effect of continuing medical education strategies. JAMA 1995;274:700705.
18.White, ME, McDonnell, SM, Werker, DH, et al. : Partners in international applied epidemiology and training and service, 1975–2001. Am J Epidemiol 2001;154:993999.
19.US Centers for Disease Control and Prevention: Improving the Quality. Atlanta: CDC, 1996.
20.Bryce, J, Cutts, F, Naimoli, JF, et al. : What have teachers learnt? Lancet 1993;342(8864):160161.
21.Brook, RH: Implementing medical guidelines. Lancet 1995;346:132.
22.Hardie, M: Management training in the 1980s. World Health Forum 1981;2:535537.
23.Simmonds, S, Bennett-Jones, N: Human resource development: The management, planning, and training of health personnel. Health Policy Plan 1989;4:187196.
24.Bhattacharji, S, Abraham, S, Muliyil, J, et al. : Evaluating community health worker performance in India. Health Policy Plan 1986;1(3):232239.
25.Nsubuga, P, Eseko, N, Wuhib, T, et al. : Structure and function of infectious disease surveillance and response, United Republic of Tanzania, 1998. Bull World Health Organ 2002;80(3):196202.
26.US Centers for Disease Control and Prevention: Assessment of infectious disease surveillance—Uganda, 2000. MMWR 2000;49(30):687691.
27.Ruck, NF, Hafeez, M, Manzur, S, et al. : Assessing management training needs: A study in the Punjab health services, Pakistan. J Hlth Pop Dev Count 1999;2(1):7887.
28.Jha, P, Bangoura, O, Ranson, K: The cost-effectiveness of forty health interventions in Guinea. Health Policy Plan 1998;13(3):249262.
29.Ferrinho, P, Lerberghe, WV, Julien, MR, et al. : How and why public sector doctors engage in private practice in Portugese-speaking African countries. Health Policy Plan 1998;13:332–328.
30.Brearley, S: The medical manpower crisis: Who can solve it? Health Serv Manpow Rev 1984;10:810.
31.Curtale, F, Sirwakoti, B, Lagrosa, C, et al. : Improving skills and utilization of community health volunteers in Nepal. Soc Sci Med 1995;40(8):11171125.
32.Soumerai, SB, Avorn, J: Principles of educational outreach (“academic detailing”) to improve clinical decision making. JAMA 1990;263:549556.
33.Henderson, DA: Surveillance of smallpox. Int J Epidemiol 1978;5:1925.
34.Lomas, J, Enkin, M, Anderson, GM, et al. : Opinion leaders versus audit and feedback to implement practices guidelines. Delivery after previous cesarean section. JAMA 1991;265:22022207.
35.Almroth, S, Latham, MC: Rational home management of diarhoea. Lancet 1995;345:709711.
36.Foege, WH, Hogan, RC, Newton, LH: Surveillance projects for selected diseases. Int J Epidemiol 1976;5:2937.
37.Lamboray, JL, Laing, C: Partners for better health. World Health Forum 1984;5:3034.
38.Arblaster, L, Lambert, M, Entwhistle, V, et al. : A systematic review of the effectiveness of health service interventions aimed at reducing inequalities in health. J Health Serv Res Policy 1996;1:92103.
39.Janovsky, K, Cassels, A: Health Policy and Systems Research: Issues, Methods and Priorities. In: Janovsky, K (ed), Health Policy and Systems Development: An Agenda for Research. Geneva: World Health Organization, 1996, pp 1123.
40.Conn, CP, Jenkins, P, Touray, SO: Strengthening health management: experience of district teams in the Gambia. Health Policy Plan 1996, 11(1):6471.
41.MacCarquodale, DW: Primary health care in the Dominican Republic: A study of health worker effectiveness. J Trop Med Hyg 1982;85:251254.
45.Butter, I, Mejia, A: Too many doctors. World Health Forum 1987;8:494500.
46.McPherson, A, Powell, RN: Manpower and Primary Health Care: Guidelines for Improving/Expanding Health Services Coverage in Developing Countries. Honolulu: University Press of Hawaii, 1978.
47.US Centers for Disease Control and Prevention: The guide to community preventive services:What works to promote health? Atlanta: CDC.Available at http://www.thecommunityguide.org/library/book. Accessed 14 June 2007.
48.Agency for Healthcare Research and Quality: Guide to clinical preventive services, 2006. Recommendations of the US Preventive Services Task Force. Available at http://www.ahrq.gov/clinic/pocketgd.htm. Accessed 14 June 2007.

Keywords

Measuring Health Program Effectiveness in the Field: An Assessment Tool

  • Sharon M. McDonnell (a1), Abdiaziz S. Yassin (a2), Wayne G. Brown (a3), Helen N. Perry (a4) and Stephen B. Thacker (a5)...

Metrics

Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed