Hostname: page-component-76fb5796d-2lccl Total loading time: 0 Render date: 2024-04-26T08:30:17.283Z Has data issue: false hasContentIssue false

Caution on mandatory public reporting

Published online by Cambridge University Press:  02 May 2023

David Birnbaum*
Affiliation:
Applied Epidemiology, Sidney, British Columbia, Canada
*
Corresponding author: David Birnbaum, PhD, MPH, Applied Epidemiology, 609 Cromar Road, North Saanich, BC V8L 5M5, Canada. Email: David.birnbaum@ubc.ca
Rights & Permissions [Opens in a new window]

Abstract

Type
Letter to the Editor
Copyright
© The Author(s), 2023. Published by Cambridge University Press on behalf of The Society for Healthcare Epidemiology of America

To the Editor—Gonzalo Bearman’s otherwise excellent commentary suggests that mandatory public reporting of risk-adjusted patient infections offers important value, citing 2 references.Reference Bearman1 Having run one state’s mandatory program as a research opportunity, I feel compelled to raise a yellow card on that score. Mandatory public HAI reporting to accelerate safety improvement is a noble experiment, but it remains of unproven value and cost-effectiveness. One of Bearman’s 2 references, a systematic review with meta-analysis,Reference Campanella, Vukovic, Parente, Sulejmani, Ricciardi and Specchia2 derives its statistical significance from cardiac surgery mortality reporting but includes only 1 study regarding HAI, a study that finds no impact of public reporting on hospital infection rates. His other referenceReference Marsteller, Hsu and Weeks3 finds that hospitals in states newly enacting HAI reporting mandates soon demonstrated greater reduction in CLABSI rates but later no greater reduction than what was seen in states without mandates. Given the cliché that “data unites, theories divide,” there are 3 possible interpretations. First, legislative mandate could motivate change. For example, Marsteller et alReference Marsteller, Hsu and Weeks3 notes that at baseline hospitals in states with new or impending legislation started with higher CLABSI rates than hospitals in states without a mandate and were more likely to then adopt well-known prevention strategies. Second, legislative mandates do not impact performance. Several studies fail to find statistically significant association, so a single positive signal could be the result of random chance variation or bias. Third, some could appear to be doing better than others simply due to widely ranging rates of underreporting. Standardized methods that are practical, sustainable, and internationally credible for ongoing assurance of reliable quality exist that can be used for annual validation to confirm hospitals meet predefined sensitivity and specificity requirements in their data reporting, but the vast majority of American state HAI programs have performed no credible on-going validation.Reference Birnbaum and Jarvis4

Together with colleagues across the 10 academic domains needed to address a sequence of research questions leading to understand what works, for whom, in what settings (Fig. 1), we used one state’s mandatory HAI program to seek answers.Reference Birnbaum5 Essentially, all participating hospitals continued to exceed our annual validation requirements for high-quality reporting, and all maintained low HAI rates, which were not affected by adding reporting requirements. Risk-stratified rates were more meaningful and accurate indicators of performance than risk-adjusted ratios.Reference Birnbaum and Jarvis4,Reference Birnbaum, Zarate and Marfin6 And as others have reported about public reporting websites, the general public showed little evidence of using such websites to actually influence their care decisions.Reference Reid7 Today, as before, “More research is needed to better understand what health care consumers need on the WWW to support their decision making involving HAIs.”Reference Reid and Borycki8

Figure 1. Improving our understanding of what works, for whom, in what settings. From Figure 1 in Birnbaum D, The US experience with mandatory public reporting. Clin Govern Int J 2012;17:113–123.

Acknowledgments

Financial support

No financial support was provided relevant to this article.

Competing interest

All authors report no conflicts of interest relevant to this article.

References

Bearman, G. Leadership in healthcare epidemiology, antimicrobial stewardship, and medicine: a soccer enthusiast’s perspective. Infect Control Hosp Epidemiol 2023;44:171174.CrossRefGoogle Scholar
Campanella, P, Vukovic, C, Parente, P, Sulejmani, A, Ricciardi, W, Specchia, ML. The impact of public reporting on clinical outcomes: a systematic review and meta-analysis. BMC Health Serv Res 2016;16:296.CrossRefGoogle ScholarPubMed
Marsteller, JA, Hsu, YJ, Weeks, K. Evaluating the impact of mandatory public reporting on participation and performance in a program to reduce central-line–associated bloodstream infections: evidence from a national patient safety collaborative. Am J Infect Control 2014;42 suppl 10:S209S205.CrossRefGoogle Scholar
Birnbaum, D. Epidemiologic methods for investigating infections in the healthcare setting. In Jarvis, WR, ed. Bennett & Brachman’s Hospital Infections, 7th edition. Philadelphia, PA: Wolters Kluwer; 2023:107115.Google Scholar
Birnbaum, D, The US experience with mandatory public reporting. Clin Govern Int J 2012;17:113123.CrossRefGoogle Scholar
Birnbaum, D, Zarate, R, Marfin, T. SIR, you’ve led me astray! Infect Control Hosp Epidemiol 2011;32:276282.CrossRefGoogle ScholarPubMed
Reid, PS. Information-seeking behaviours of healthcare consumers regarding healthcare-associated infections. Master’s degree thesis, University of Victoria School of Health Information Science, 2015.Google Scholar
Reid, PS, Borycki, EM. Factors influencing healthcare consumers’ search for healthcare associated infection information on the World Wide Web. Clin Govern Int J 2012;17:134140.CrossRefGoogle Scholar
Figure 0

Figure 1. Improving our understanding of what works, for whom, in what settings. From Figure 1 in Birnbaum D, The US experience with mandatory public reporting. Clin Govern Int J 2012;17:113–123.