Skip to main content Accessibility help
×
Hostname: page-component-848d4c4894-v5vhk Total loading time: 0 Render date: 2024-06-17T02:51:31.743Z Has data issue: false hasContentIssue false

18 - The development of composite indicators to measure health care performance

Published online by Cambridge University Press:  22 September 2009

Rowena Jacobs
Affiliation:
Research Fellow University of York, UK
Peter Smith
Affiliation:
Professor University of York, Uk
Maria Goddard
Affiliation:
Assistant Director University of York, UK
Andy Neely
Affiliation:
Cranfield University, UK
Get access

Summary

Introduction

Over the past decade the measurement of comparative performance has become a dominant feature of health care systems across the world (Smith, 2002). Interest is apparent at every level, ranging from the performance of individual clinicians, providers and health plans, right up to the level of entire health systems. The ultimate rationale for collecting, analysing and publishing information on relative performance is to bring about performance improvement. However, the mechanism by which this works will vary, depending on the context within which health care systems operate. For example, market-orientated systems rely to a greater extent on the operation of competitive pressures from consumers, who may use comparative information when making choices about their health care insurers or providers (Porter and Teisberg, 2004). In public health systems, the publication of comparative performance information may form the basis for regulatory intervention.

It is widely acknowledged that health care performance is multidimensional. Policy makers and the public have a legitimate interest in a wide range of aspects of performance, such as efficiency, the quality of the health care process, accessibility, clinical outcomes and responsiveness (Institute of Medicine, 2001). There is now a plethora of information available for the measurement of relative performance, and interpreting such data is therefore becoming increasingly complex. One widely adopted approach to summarizing the information contained in disparate indicators of health care performance is to create a single composite measure.

Type
Chapter
Information
Business Performance Measurement
Unifying Theory and Integrating Practice
, pp. 383 - 407
Publisher: Cambridge University Press
Print publication year: 2007

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Almeida, C., Braveman, P., Gold, M. R., Szwarcwald, C. L., Ribeiro, J. M., Miglionico, A., Millar, J. S., Porto, S., Costa, N. R., Rubio, V. O., Segall, M., Starfield, B., Travessos, C., Uga, A., Valente, J., and Viacava, F. (2001). Methodological concerns and recommendations on policy consequences of the World Health Report 2000. Lancet, 357, 1692–7.CrossRefGoogle ScholarPubMed
Appleby, J., and Mulligan, J. (2000). How Well is the NHS Performing? A Composite Performance Indicator Based on Public Consultation. London: King's Fund.Google Scholar
Appleby, J., and Street, A. (2001). Health system goals: life, death and … football. Journal of Health Services Research, 6(4), 220–5.CrossRefGoogle Scholar
Canadian Institute for Health Information (2001a). Health Care in Canada 2001: A Second Annual Report. Ottawa: Canadian Institute for Health Information.Google Scholar
Canadian Institute for Health Information(2001b). Health Indicators 2001. Ottawa: Canadian Institute for Health Information.Google Scholar
CHI (2003). NHS performance ratings: acute trusts, specialist trusts, ambulance trusts 2002/2003. London: Commission for Health Improvement, www.chi.nhs.uk/ratings/.
CMS (2004). CMS HQI Demonstration Project: Composite Quality Score Methodology Overview. Baltimore: Centers for Medicare and Medicaid Services.Google Scholar
Crombie, I. K., and Davies, H. T. O. (1998). Beyond health outcomes: the advantages of measuring process. Journal of Evaluation in Clinical Practice, 4(1), 31–8.CrossRefGoogle ScholarPubMed
Cutler, T. (2002). Star or black hole?Community Care, 30 May, 40–1.Google Scholar
Department of Health (2001). NHS Performance Ratings: Acute Trusts 2000/01. London: Department of Health.Google Scholar
Department of Health (2002). NHS Performance Ratings and Indicators: Acute Trusts, Specialist Trusts, Ambulance Trusts, Mental Health Trusts 2001/02. London: Department of Health.
Dolan, P., Gudex, C., Kind, P., and Williams, A. (1996). Valuing health states: a comparison of methods. Journal of Health Economics, 15, 209–31.CrossRefGoogle ScholarPubMed
European Commission (2006). Composite indicators: an information server on composite indicators. Ispra, Italy: European Commission, Joint Research Centre, http://farmweb.jrc.ec.europa.eu/ci/JRC_2006EPI_PR.htm.
Freudenberg, M. (2003). Composite Indicators of Country Performance: A Critical Assessment, Science, Technology and Industry Working Paper 2003/16. Paris: Organisation for Economic Co-operation and Development.CrossRefGoogle Scholar
Gravelle, H., and Smith, P. C. (2002). Sources of variations in measured performance. In Smith, P. C. (ed.), Some Principles of Performance Measurement and Performance Improvement, report prepared for the Commission for Health Improvement, 3–5. York: University of York, Centre for Health Economics.Google Scholar
Hauck, K., Shaw, R., and Smith, P. C. (2002). Reducing avoidable inequalities in health: a new criterion for setting health care capitation payments. Health Economics, 11(8), 667–77.CrossRefGoogle ScholarPubMed
Healthcare Commission (2004). 2004 performance ratings. London: Healthcare Commission, http://ratings2004.healthcarecommission.org.uk/.
Healthcare Commission (2005). 2005 performance ratings. London: Healthcare Commission, http://ratings2005.healthcarecommission.org.uk/.
Iezzoni, L. I., Schwartz, M., Ash, A. S., Hughes, J. S., Daley, J., and Mackiernan, Y. D. (1995). Using severity-adjusted stroke mortality rates to judge hospitals. International Journal for Quality in Health Care, 7(2), 81–94.CrossRefGoogle ScholarPubMed
Iezzoni, L. I., Schwartz, M., Ash, A. S., Hughes, J. S., Daley, J., and Mackiernan, Y. D. (1996). Severity measurement methods and judging hospital death rates for pneumonia. Medical Care, 34(1), 11–28.CrossRefGoogle ScholarPubMed
Institute of Medicine (2001). Crossing the Quality Chasm: A New Health System for the 21st Century. Washington, DC: Institute of Medicine of the National Academies, Committee on Quality of Health Care in America.Google Scholar
Jacobs, R., and Dawson, D. (2003). Variation in unit costs of hospitals in the English NHS. Journal of Health Services Research and Policy, 8(4), 202–8.CrossRefGoogle Scholar
Jacobs, R., Smith, P. C., and Goddard, M. (2005). How robust are hospital ranks based on composite performance measures?Medical Care, 43(12), 1177–84.CrossRefGoogle ScholarPubMed
Jencks, S. F., Cuerdon, T., Burwen, D. R., Fleming, B., Houck, P. M., Kussmaul, A. E., Nilasena, D. S., Ordin, D. L., and Arday, D. R. (2000). Quality of medical care delivered to Medicare beneficiaries: a profile at state and national levels. Journal of the American Medical Association, 284(13), 1670–6.CrossRefGoogle ScholarPubMed
Jencks, S. F., Huff, E. D., and Cuerdon, T. (2003). Change in the quality of care delivered to Medicare beneficiaries, 1998–1999 to 2000–2001. Journal of the American Medical Association, 289(3), 305–12.CrossRefGoogle ScholarPubMed
Kmietowicz, Z. (2003). Star rating system fails to reduce variation. British Medical Journal, 327, 184.CrossRefGoogle ScholarPubMed
Miller, N. (2002). Missing the target. Community Care, 21 November, 36–8.Google Scholar
Mullen, P., and Spurgeon, P. (2000). Priority Setting and the Public. Abingdon: Radcliffe Medical Press.Google Scholar
Navarro, V. (2000). Assessment of the World Health Report. Lancet, 356, 1598–601.CrossRefGoogle ScholarPubMed
Navarro, V. (2001). World Health Report 2000: response to Murray and Frenk. Lancet, 357, 1701–2.CrossRefGoogle Scholar
Navarro, V. (2002). The World Health Report 2000: can health care systems be compared using a single measure of performance?American Journal of Public Health, 92(1), 31–4.CrossRefGoogle Scholar
Nord, E. (2002). Measures of goal attainment and performance: a brief, critical consumer guide. Health Policy, 59(3), 183–91.CrossRefGoogle ScholarPubMed
Porter, M. E., and Teisberg, E. O. (2004). Redefining competition in healthcare. Harvard Business Review, 82(3), 65–76.Google Scholar
Premier Inc. (2005). HQI demonstration overview. Washington, DC: Premier Inc., www.premierinc.com/all/quality/hqi/index.jsp.
Ridgway, V. F. (1956). Dysfunctional consequences of performance measurements. Administrative Science Quarterly, 1(2), 240–7.CrossRefGoogle Scholar
Saisana, M., and Tarantola, S. (2002). State-of-the-art Report on Current Methodologies and Practices for Composite Indicator Development. Ispra, Italy: European Commission, Joint Research Centre.Google Scholar
Shaw, R., Dolan, P., Tsuchiya, A., Williams, A., Smith, P. C., and Burrows, R. (2001). Development of a Questionnaire to Elicit Preferences regarding Health Inequalities, Occasional Paper no. 40. York: University of York, Centre for Health Economics.Google Scholar
Simar, L., and Wilson, P. W. (2002). Estimation and Inference in Two-stage Semi-parametric Models of Production Processes. Louvain: Université Catholique de Louvain, Institut de Statistique.Google Scholar
Smith, P. C. (2002). Developing composite indicators for assessing health system efficiency. In Smith, P. C. (ed.), Measuring Up: Improving the Performance of Health Systems in OECD Countries, 322–46. Paris: Organisation for Economic Co-operation and Development.Google Scholar
Smith, P. C. (2003). Formula funding of public services: an economic analysis. Oxford Review of Economic Policy, 19(2), 301–22.CrossRefGoogle Scholar
Smith, P. C., Rice, N., and Carr-Hill, R. (2001). Capitation funding in the public sector. Journal of the Royal Statistical Society, Series A, 164(2), 217–57.CrossRefGoogle Scholar
Snelling, I. (2003). Do star ratings really reflect hospital performance?Journal of Health Organization and Management, 17, 210–23.CrossRefGoogle ScholarPubMed
WHO (2000). The World Health Report 2000: Health Systems: Improving Performance. Geneva: World Health Organization.Google Scholar
Williams, A. (2001). Science or marketing at WHO?Health Economics, 10, 93–100.CrossRefGoogle ScholarPubMed

Save book to Kindle

To save this book to your Kindle, first ensure coreplatform@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×