No CrossRef data available.
Article contents
Random variation drives a critical bias in the comparison of healthcare-associated infections
Published online by Cambridge University Press: 10 March 2023
Abstract
Objective:
To evaluate random effects of volume (patient days or device days) on healthcare-associated infections (HAIs) and the standardized infection ratio (SIR) used to compare hospitals.
Design:
A longitudinal comparison between publicly reported quarterly data (2014–2020) and volume-based random sampling using 4 HAI types: central-line–associated bloodstream infections, catheter-associated urinary tract infections, Clostridioides difficile infections, methicillin-resistant Staphylococcus aureus infections.
Methods:
Using 4,268 hospitals with reported SIRs, we examined relationships of SIRs to volume and compared distributions of SIRs and numbers of reported HAIs to the outcomes of simulated random sampling. We included random expectations into SIR calculations to produce a standardized infection score (SIS).
Results:
Among hospitals with volumes less than the median, 20%–33% had SIRs of 0, compared to 0.3%–5% for hospitals with volumes higher than the median. Distributions of SIRs were 86%–92% similar to those based on random sampling. Random expectations explained 54%–84% of variation in numbers of HAIs. The use of SIRs led hundreds of hospitals with more infections than either expected at random or predicted by risk-adjusted models to rank better than other hospitals. The SIS mitigated this effect and allowed hospitals of disparate volumes to achieve better scores while decreasing the number of hospitals tied for the best score.
Conclusions:
SIRs and numbers of HAIs are strongly influenced by random effects of volume. Mitigating these effects drastically alters rankings for HAI types and may further alter penalty assignments in programs that aim to reduce HAIs and improve quality of care.
- Type
- Original Article
- Information
- Copyright
- © The Author(s), 2023. Published by Cambridge University Press on behalf of The Society for Healthcare Epidemiology of America
References
Zimlichman, E, Henderson, D, Tamir, O, et al. Healthcare-associated infections: a meta-analysis of costs and financial impact on the US health care system. JAMA Intern Med 2013;173:2039–2046.CrossRefGoogle ScholarPubMed
Cassidy, A. Medicare’s hospital-acquired condition reduction program Health Affairs 2015. doi: 10.1377/hpb20150806.512738.Google Scholar
Hospital value-based purchasing. US Health and Human Services website. https://www.hhs.gov/guidance/sites/default/files/hhs-guidance-documents/Hospital_VBPurchasing_Fact_Sheet_ICN907664.pdf. Accessed September, 1, 2022.Google Scholar
Rajaram, R, Chung, JW, Kinnier, CV, et al. Hospital characteristics associated with penalties in the Centers for Medicare & Medicaid Services hospital-acquired condition reduction program. JAMA 2015;314:375–383.CrossRefGoogle ScholarPubMed
Winters, BD, Bharmal, A, Wilson, RF, et al. Validity of the Agency for Health Care Research and Quality Patient Safety Indicators and the Centers for Medicare and Medicaid Hospital-Acquired Conditions: a systematic review and meta-analysis. Med Care 2016;54:1105–1111.CrossRefGoogle ScholarPubMed
Koenig, L, Soltoff, SA, Demiralp, B, et al. Complication rates, hospital size, and bias in the CMS Hospital-Acquired Condition Reduction Program. Am J Med Qual. 2017;32:611–616.CrossRefGoogle ScholarPubMed
Horstman, MJ, Li, YF, Almenoff, PL, Freyberg, RW, Trautner, BW. Denominator doesn’t matter: standardizing healthcare-associated infection rates by bed days or device days. Infect Control Hosp Epidemiol 2015;36:710–716.CrossRefGoogle ScholarPubMed
Lin, MY, Hota, B, Khan, YM, et al. Quality of traditional surveillance for public reporting of nosocomial bloodstream infection rates. JAMA 2010;304:2035–2041.CrossRefGoogle ScholarPubMed
Schreiber, PW, Sax, H, Wolfensberger, A, Clack, L, Kuster, SP. The preventable proportion of healthcare-associated infections 2005–2016: systematic review and meta-analysis. Infect Control Hosp Epidemiol 2018;39:1277–1295.CrossRefGoogle ScholarPubMed
Bearman, G, Doll, M, Cooper, K, et al. Hospital infection prevention: how much can we prevent and how hard should we try? Curr Infect Dis Rep 2019;21:2.CrossRefGoogle ScholarPubMed
The NHSN standardized infection ratio (SIR). Centers for Disease Control and Prevention website. https://www.cdc.gov/nhsn/pdfs/ps-analysis resources/nhsn-sir-guide.pdf. Accessed September, 10, 2021.Google Scholar
Armbrister, AJ, Finke, AM, Long, AM, Korvink, M, Gunn, LH. Turning up the volume to address biases in predicted healthcare-associated infections and enhance US hospital rankings: a data-driven approach. Am J Infect Control 2022;50:166–175.CrossRefGoogle ScholarPubMed
Adjusted ranking metric. Centers for Disease Control and Prevention website. https://www.cdc.gov/nhsn/pdfs/cms/dialysis/NHSN-ARM.pdf. Accessed May 1, 2022.Google Scholar
Monrad, D, Harner, EJ, Stout, WF. Statistics Concepts & Methods, fourth ed. Dubuque, IA: Kendall Hunt; 2010.Google Scholar
Popovich, KJ, Snitkin, ES, Hota, B, et al. Genomic and epidemiological evidence for community origins of hospital-onset methicillin-resistant Staphylococcus aureus bloodstream infections. J Infect Dis 2017;215:1640–1647.CrossRefGoogle ScholarPubMed
Hospitals data archive. Centers for Medicare and Medicaid Services website. https://data.cms.gov/provider-data/archived-data/hospitals. Accessed July 1, 2021.Google Scholar
Baker, MA, Sands, KE, Huang, SS, et al. The impact of COVID-19 on healthcare-associated infections. Clin Infect Dis 2022;74:1748–1754.CrossRefGoogle ScholarPubMed
FY 2021 HAC reduction program HSR user guide. Centers for Medicare and Medicaid Services website. https://qualitynet.cms.gov/inpatient/hac/reports#tab3. Accessed September 10, 2021.Google Scholar
Li, Y, Cao, X, Ge, H, Jiang, Y, Zhou, H, Zheng, W. Targeted surveillance of nosocomial infection in intensive care units of 176 hospitals in Jiangsu province, China. J Hosp Infect 2018;99:36–41.CrossRefGoogle ScholarPubMed
Liu, Weiping, Guo, Tianhui, and Haoxue, L.. Healthcare-associated infection prevention and control management in a tertiary hospital and an overall evaluation. Ann Palliat Med 2020;9:1536–1544.CrossRefGoogle Scholar
Letica-Kriegel, AS, Salmasian, H, Vawdrey, DK, et al. Identifying the risk factors for catheter-associated urinary tract infections: a large cross-sectional study of six hospitals. BMJ Open 2019;9:e022137.CrossRefGoogle ScholarPubMed
Rosenthal, VD, Todi, SK, Alvarez-Moreno, C, et al. Impact of a multidimensional infection control strategy on catheter-associated urinary tract infection rates in the adult intensive care units of 15 developing countries: findings of the International Nosocomial Infection Control Consortium (INICC). Infection 2012;40:517–526.10.1007/s15010-012-0278-xCrossRefGoogle ScholarPubMed
Salm, F, Schwab, F, Behnke, M, et al. Nudge to better care-blood cultures and catheter-related bloodstream infections in Germany at two points in time (2006, 2015). Antimicrob Resist Infect Control 2018;7:1–7.CrossRefGoogle ScholarPubMed
Toor, H, Farr, S, Savla, P, et al. Prevalence of central-line–associated bloodstream infections (CLABSI) in intensive care and medical-surgical units. Cureus 2022;14:e22809.Google ScholarPubMed
Roth, VR, Longpre, T, Taljaard, M, et al. Universal vs risk factor screening for methicillin-resistant Staphylococcus aureus in a large multicenter tertiary-care facility in Canada. Infect Control Hosp Epidemiol 2016;37:41–48.CrossRefGoogle Scholar
Maraqa, NF, Aigbivbalu, L, Masnita-Iusan, C, et al. Prevalence of and risk factors for methicillin-resistant Staphylococcus aureus colonization and infection among infants at a level III neonatal intensive care unit. Am J Infect Control 2011;39:35–41.10.1016/j.ajic.2010.07.013CrossRefGoogle Scholar
Peterson, LR, Schora, DM. Methicillin-resistant Staphylococcus aureus control in the 21st century: laboratory involvement affecting disease impact and economic benefit from large population studies. J Clin Microbiol 2016;54:2647–2654.CrossRefGoogle ScholarPubMed
Bearman, G, Abbas, S, Masroor, N, et al. Impact of discontinuing contact precautions for methicillin-resistant Staphylococcus aureus and vancomycin-resistant Enterococcus: an interrupted time-series analysis. Infect Control Hosp Epidemiol 2018;39:676–682.CrossRefGoogle ScholarPubMed
Marra, AR, Perencevich, EN, Nelson, RE, et al. Incidence and outcomes associated with Clostridium difficile infections: a systematic review and meta-analysis. JAMA Network Open 2020;3:e1917597.CrossRefGoogle ScholarPubMed
Dubberke, ER, Butler, AM, Yokoe, DS, et al. Multicenter study of Clostridium difficile infection rates from 2000 to 2006. Infect Control Hosp Epidemiol 2010;31:1030–1037.CrossRefGoogle ScholarPubMed
Yadlapati, S, Jarrett, SA, Lo, KB, Sweet, J, Judge, TA. Examining the rate of Clostridioides (formerly Clostridium) difficile infection pre-and post–COVID-19 pandemic: an institutional review. Cureus 2021;13:e20397.Google ScholarPubMed
Caroff, DA, Wang, R, Zhang, Z, et al. The limited utility of ranking hospitals based on their colon surgery infection rates. Clin Infect Dis 2021;72:90–98.Google ScholarPubMed
Eddy, DM. Variations in physician practice: the role of uncertainty. Health Aff 1984;3:74–89.CrossRefGoogle ScholarPubMed
Locey et al. supplementary material
Locey et al. supplementary material
File
6.9 MB