Hostname: page-component-8448b6f56d-42gr6 Total loading time: 0 Render date: 2024-04-25T06:07:59.730Z Has data issue: false hasContentIssue false

A validated risk score to estimate mortality risk in patients with dementia and pneumonia: barriers to clinical impact

Published online by Cambridge University Press:  26 July 2010

Jenny T. van der Steen*
Affiliation:
VU University Medical Center, EMGO Institute for Health and Care Research, Department of Nursing Home Medicine, Amsterdam, The Netherlands VU University Medical Center, EMGO Institute for Health and Care Research, Department of Public and Occupational Health, Amsterdam, The Netherlands
Gwenda Albers
Affiliation:
VU University Medical Center, EMGO Institute for Health and Care Research, Department of Public and Occupational Health, Amsterdam, The Netherlands
Els Licht-Strunk
Affiliation:
VU University Medical Center, EMGO Institute for Health and Care Research, Department of General Practice, Amsterdam, The Netherlands
Martien T. Muller
Affiliation:
VU University Medical Center, Department of Nursing Home Medicine, Amsterdam, The Netherlands
Miel W. Ribbe
Affiliation:
VU University Medical Center, EMGO Institute for Health and Care Research, Department of Nursing Home Medicine, Amsterdam, The Netherlands
*
Correspondence should be addressed to: Jenny T. van der Steen, PhD, VU University Medical Center, EMGO Institute for Health and Care Research, Department of Nursing Home Medicine, and Department of Public and Occupational Health, Van der Boechorststraat 7, 1081 BT Amsterdam, The Netherlands. Phone: +31-20-4449694; Fax +31-20-4448387. Email j.vandersteen@vumc.nl.

Abstract

Background: The clinical impact of risk score use in end-of-life settings is unknown, with reports limited to technical properties.

Methods: We conducted a mixed-methods study to evaluate clinical impact of a validated mortality risk score aimed at informing prognosis and supporting clinicians in decision-making in dementia patients with pneumonia. We performed a trial (n = 69) with physician-reported outcomes referring to the score's aims. Subsequently, physician focus group discussions were planned to better understand barriers to clinical impact, and we surveyed families (n = 50) and nurses practicing in nursing homes (n = 29). We finally consulted with experts and key persons for implementation.

Results: Most (71%) physicians who used the score considered it useful, but mainly for its learning effects. Families were never informed of numerical risk estimates. Two focus group discussions revealed a reluctance to use a numerical approach, and physicians found that outcomes conditional on antibiotic treatment were inadequate to support decision-making. Nurses varied in their perceived role in informing families. Most families (88%) wished to be informed, preferring a numerical (43%), verbalized (35%), or other approach (18%) or had no preference (5%). Revising the score, we added an ethical framework for decision-making to acknowledge its complexity, an explanatory note addressing barriers related to physicians’ attitudes, and a nurses’ form.

Conclusion: The combined quantitative and qualitative studies elicited: substantial barriers to a numerical approach to physicians’ end-of-life decision-making; crucial information for revisions and further score development; and a need for implementation strategies that focus on education.

Type
Research Article
Copyright
Copyright © International Psychogeriatric Association 2010

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Brehaut, J. C., Stiell, I. G. and Graham, I. D. (2006). Will a new clinical decision rule be widely used? The case of the Canadian C-Spine Rule. Academic Emergency Medicine, 13, 413420.Google Scholar
Bryman, A. (2006). Integrating quantitative and qualitative research: how is it done? Qualitative Research, 6, 97113.Google Scholar
Cabana, M. D. et al. (1999). Why don't physicians follow clinical practice guidelines? A framework for improvement. JAMA, 282, 14581465.Google Scholar
Cameron, C. and Naylor, C. D. (1999). No impact from active dissemination of the Ottawa Ankle Rules: further evidence of the need for local implementation of practice guidelines. Canadian Medical Association Journal, 160, 11651168.Google Scholar
Chen, J. H. et al. (2006). Occurrence and treatment of suspected pneumonia in long-term care residents dying with advanced dementia. Journal of the American Geriatrics Society, 54, 290295.CrossRefGoogle ScholarPubMed
Chow, E., Harth, T., Hruby, G., Finkelstein, J., Wu, J. and Danjoux, C. (2001). How accurate are physicians’ clinical predictions of survival and the available prognostic tools in estimating survival times in terminally ill cancer patients? A systematic review. Clinical Oncology, 13, 209218.Google ScholarPubMed
Christakis, N. A. and Iwashyna, T. J. (1998). Attitude and self-reported practice regarding prognostication in a national sample of internists. Archives of Internal Medicine, 158, 23892395.CrossRefGoogle Scholar
Conroy, S., van der Cammen, T., Schols, J., van Balen, R., Peteroff, P. and Luxton, T. (2009). Medical services for older people in nursing homes: comparing services in England and the Netherlands. Journal of Nutrition, Health and Aging, 13, 559563.Google Scholar
Cuite, C. L., Weinstein, N. D., Emmons, K. and Colditz, G. (2008). A test of numeric formats for communicating risk probabilities. Medical Decision Making, 28, 377384.Google Scholar
Davis, D. A., Thomson, M. A., Oxman, A. D. and Haynes, R. B. (1995). Changing physician performance: a systematic review of the effect of continuing medical education strategies. JAMA, 274, 700705.CrossRefGoogle ScholarPubMed
Eichler, K., Zoller, M., Tschudi, P. and Steurer, J. (2007). Barriers to apply cardiovascular prediction rules in primary care: a postal survey. BMC Family Practice, 8, 1.Google Scholar
Formoso, G., Liberati, A. and Magrini, N. (2001). Practice guidelines: useful and “participative” method? Survey of Italian physicians by professional setting. Archives of Internal Medicine, 161, 20372042.Google Scholar
Francke, A. L., Smit, M. C., de Veer, A. J. and Mistiaen, P. (2008). Factors influencing the implementation of clinical guidelines for health care professionals: a systematic meta-review. BMC medical informatics and decision making, 8, 38.Google Scholar
Gigerenzer, G. and Edwards, A. (2003). Simple tools for understanding risks: from innumeracy to insight. BMJ, 327, 741744.CrossRefGoogle ScholarPubMed
Glare, P. A. and Sinclair, C. T. (2008). Palliative medicine review: prognostication. Journal of Palliative Medicine, 11, 84103.CrossRefGoogle ScholarPubMed
Gordon-Lubitz, R. J. (2003). Risk communication: problems of presentation and understanding. JAMA, 289, 95.Google Scholar
Graham, I. D. et al. (2001). Awareness and use of the Ottawa ankle and knee rules in 5 countries: can publication alone be enough to change practice? Annals of Emergency Medicine, 37, 259266.CrossRefGoogle ScholarPubMed
Graham, I. D. et al. (2007). Physicians’ intentions and use of three patient decision aids. BMC Medical Informatics and Decision Making, 7, 20.CrossRefGoogle ScholarPubMed
Grimshaw, J. M. et al. (2001). Changing provider behaviour. Medical Care, 39 (Suppl. 2), 112145.Google Scholar
Grimshaw, J. et al. (2006). Toward evidence-based quality improvement: evidence (and its limitations) of the effectiveness of guideline dissemination and implementation strategies, 1966–1998. Journal of General Internal Medicine, 21 (Suppl. 2), S14S20.Google Scholar
Hadorn, D. C. (1997). Kinds of patients. Journal of Medicine and Philosophy, 22, 567587.CrossRefGoogle ScholarPubMed
Halm, E. A. et al. (2000). Understanding physician adherence with a pneumonia practice guideline: effects of patient, system, and physician factors. Archives of Internal Medicine, 160, 98104.Google Scholar
Helton, M. R., van der Steen, J. T., Daaleman, T. P., Gamble, G. R. and Ribbe, M. W. (2006). A cross-cultural study of physician treatment decisions for demented nursing home patients who develop pneumonia. Annals of Family Medicine, 4, 221227.CrossRefGoogle ScholarPubMed
Hutt, E. et al. (2006). A multifaceted intervention to implement guidelines improved treatment of nursing home-acquired pneumonia in a state veterans home. Journal of the American Geriatrics Society, 54, 16941700.Google Scholar
Kawamoto, K., Houlihan, C. A., Balas, E. A. and Lobach, D. F. (2005). Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. BMJ, 330 (7494), 765.Google Scholar
Lamont, E. B. and Christakis, N. A. (2001). Prognostic disclosure to patients with cancer near the end of life. Annals of Internal Medicine, 134, 10961105.CrossRefGoogle ScholarPubMed
Lau, F. et al. (2007). A systematic review of prognostic tools for estimating survival time in palliative care. Journal of Palliative Care, 23, 93112.CrossRefGoogle ScholarPubMed
Lemeshow, S., Klar, J. and Teres, D. (1995). Outcome prediction for individual intensive care patients: useful, misused, or abused? Intensive Care Medicine, 21, 770776.Google Scholar
Levy, C., Morris, M. and Kramer, A. (2008). Improving end-of-life outcomes in nursing homes by targeting residents at high-risk of mortality for palliative care: program description and evaluation. Journal of Palliative Medicine, 11, 217225.Google Scholar
Maltoni, M. et al. ; Steering Committee of the European Association for Palliative Care (2005). Prognostic factors in advanced cancer patients: evidence-based clinical recommendations: a study by the Steering Committee of the European Association for Palliative Care. Journal of Clinical Oncology, 23, 62406248.Google Scholar
Mehr, D. R., van der Steen, J. T., Kruse, R. L., Ooms, M. E., Rantz, M. and Ribbe, M. W. (2003). Lower respiratory infections in nursing home residents with dementia: a tale of two countries. The Gerontologist, 43 Spec No 2, 8593.CrossRefGoogle ScholarPubMed
Meyer, G., Köpke, S., Haastert, B. and Mühlhauser, I. (2009). Comparison of a fall risk assessment tool with nurses’ judgement alone: a cluster-randomised controlled trial. Age and Ageing, 38, 417423.CrossRefGoogle Scholar
Mitchell, S. L., Kiely, D. K., Hamel, M. B., Park, P. S., Morris, J. N. and Fries, B. E. (2004). Estimating prognosis for nursing home residents with advanced dementia. JAMA, 291, 27342740.Google Scholar
Moons, K. G. M., Altman, D. G., Vergouwe, Y. and Royston, P. (2009). Prognosis and prognostic research: application and impact of prognostic models in clinical practice. BMJ, 338, b606.CrossRefGoogle ScholarPubMed
Naughton, B. J., Mylotte, J. M., Ramadan, F., Karuza, J. and Priore, R. L. (2001). Antibiotic use, hospital admissions, and mortality before and after implementing guidelines for nursing home-acquired pneumonia. Journal of the American Geriatrics Society, 49, 10201024.CrossRefGoogle ScholarPubMed
O'Connor, A. M., Légaré, F. and Stacey, D. (2003). Risk communication in practice: the contribution of decision aids. BMJ, 327, 736740.CrossRefGoogle ScholarPubMed
Oliver, D. P., Bickel-Swenson, D., Zweig, S., Kruse, R. and Mehr, D. (2009). Experience with implementation of a quality improvement project for the care of nursing home residents. Journal of Nursing Care Quality, 24, 100104.Google Scholar
Paling, J. (2003). Strategies to help patients understand risks. BMJ, 327 (7417), 745748.CrossRefGoogle ScholarPubMed
Parker, S. M. et al. (2007). A systematic review of prognostic/end-of-life communication with adults in the advanced stages of a life-limiting illness: patient/caregiver preferences for the content, style, and timing of information. Journal of Pain and Symptom Management, 34, 8193.Google Scholar
Perel, P., Edwards, P., Wentz, R. and Roberts, I. (2006). Systematic review of prognostic models in traumatic brain injury. BMC Medical Informatics and Decision Making, 6, 38.Google Scholar
Reilly, B. M. and Evans, A. T. (2006). Translating clinical research into clinical practice: impact of using prediction rules to make decisions. Annals of Internal Medicine, 144, 201209.Google Scholar
Stevinson, C., Preston, N. and Todd, C. (2010). Defining priorities in prognostication research: results of a consensus workshop. Palliative Medicine, 24, 462468.Google Scholar
van der Steen, J. T. (2010). Dying with dementia: what we know after more than a decade of research. Journal of Alzheimer's Disease. In press.CrossRefGoogle Scholar
van der Steen, J. T. and Ribbe, M. W. (2008). [Pneumonia mortality risk in patients with dementia: nursing home physicians' use and evaluation of a prognostic score]. Tijdschrift voor Gerontologie en Geriatrie, 39, 233244. In Dutch.Google Scholar
van der Steen, J. T., Muller, M. T., Ooms, M. E., van der Wal, G. and Ribbe, M. W. (2000). Decisions to treat or not to treat pneumonia in demented psychogeriatric nursing home patients: development of a guideline. Journal of Medical Ethics, 26, 114120.CrossRefGoogle ScholarPubMed
van der Steen, J. T., Ooms, M. E., Adèr, H. J., Ribbe, M. W. and van der Wal, G. (2002). Withholding antibiotic treatment in pneumonia patients with dementia: a quantitative observational study. Archives of Internal Medicine, 162, 17531760.Google Scholar
van der Steen, J. T. et al. (2004). Treatment of nursing home residents with dementia and lower respiratory tract infection in the United States and The Netherlands: an ocean apart. Journal of the American Geriatrics Society, 52, 691699.Google Scholar
van der Steen, J. T., Ooms, M. E., van der Wal, G. and Ribbe, M. W. (2005). Withholding or starting antibiotic treatment in patients with dementia and pneumonia: prediction of mortality with physicians’ judgment of illness severity and with specific prognostic models. Medical Decision Making, 25, 210221.CrossRefGoogle ScholarPubMed
van der Steen, J. T. et al. (2006). Predictors of mortality for lower respiratory infections in nursing home residents with dementia were validated transnationally. Journal of Clinical Epidemiology, 59, 970979.Google Scholar
van der Steen, J. T., Mitchell, S. L., Frijters, D. H., Kruse, R. L. and Ribbe, M. W. (2007a). Prediction of 6-month mortality in nursing home residents with advanced dementia: validity of a risk score. Journal of the American Medical Directors Association, 8, 464468.Google Scholar
van der Steen, J. T., Mehr, D. R., Kruse, R. L., Ribbe, M. W. and van der Wal, G. (2007b). Treatment strategy and risk of functional decline and mortality after nursing-home acquired lower respiratory tract infection: two prospective studies in residents with dementia. International Journal of Geriatric Psychiatry, 22, 10131019.CrossRefGoogle ScholarPubMed
van der Steen, J. T., Helton, M. R. and Ribbe, M. W. (2009). Prognosis is important in decision making in Dutch nursing home patients with dementia and pneumonia. International Journal of Geriatric Psychiatry, 24, 933936.Google Scholar
van der Steen, J. T., Lane, P., Kowall, N. W., Knol, D. L. and Volicer, L. (2010). Antibiotics and mortality in patients with lower respiratory infection and advanced dementia. Journal of the American Medical Directors Association. In press.Google Scholar
Viganò, A., Dorgan, M., Buckingham, J. and Suarez-Almazor, M. E. (2000). Survival prediction in terminal cancer patients: a systematic review of the medical literature. Palliative Medicine, 14, 363374.Google Scholar