Hostname: page-component-76fb5796d-vfjqv Total loading time: 0 Render date: 2024-04-27T09:37:28.825Z Has data issue: false hasContentIssue false

The CDC antimicrobial use measure is not ready for public reporting or value-based programs

Published online by Cambridge University Press:  19 April 2023

Nathan R. Shively*
Affiliation:
Division of Infectious Diseases, Allegheny Health Network, Pittsburgh, Pennsylvania
Daniel J. Morgan
Affiliation:
Department of Epidemiology and Public Health, University of Maryland School of Medicine, Baltimore, Maryland Veterans’ Affairs (VA) Maryland Healthcare System, Baltimore, Maryland
*
Author for correspondence: Nathan R. Shively, MD, Allegheny General Hospital, 320 E North Ave, Fourth Floor, East Wing, Suite 406, Pittsburgh, PA 15212. E-mail: Nathan.Shively@ahn.org

Abstract

The standardized antimicrobial administration ratio (SAAR) is the metric for reporting antimicrobial use that hospitals will be mandated to use in 2024. We highlight limitations of the SAAR and caution against efforts to use it for public reporting and financial reimbursement. Before the SAAR is ready for public reporting, it needs to include patient-level risk adjustment and antimicrobial resistance data as well as improved hospital location options and revised antimicrobial agent groupings to appropriately reflect and incentivize important stewardship work.

Type
Commentary
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2023. Published by Cambridge University Press on behalf of The Society for Healthcare Epidemiology of America

Antimicrobial use (AU) tracking is a critical component of any antimicrobial stewardship program (ASP). Reference Barlam, Cosgrove and Abbo1 Initially developed in 2015 by the Centers for Disease Control and Prevention (CDC), the standardized antimicrobial administration ratio (SAAR) is an AU measure that has potential to allow for national benchmarking and interfacility comparison. Reference O’Leary, Edwards and Srinivasan2 Thousands of hospitals have voluntarily submitted data to the National Healthcare Safety Network (NHSN) Antimicrobial Use and Resistance (AUR) Option, Reference O’Leary, Edwards and Srinivasan2 and we believe that the SAAR has significant promise as a public health and stewardship tool. However, the Centers for Medicare and Medicaid Services (CMS) has announced that beginning in 2024, all acute-care hospitals and critical-access hospitals will be required to report to the NHSN AUR module. 3 In light of this change, our commentary is meant to caution against public reporting and inclusion in value-based programs tied to reimbursement. Rushing the measure to have consequences for hospital reimbursement before it is ready risks unintended consequences, including a forced redistribution of limited resources, and may be harmful to hospitals and ultimately, patient care. We critique the SAAR and offer past examples of similarly flawed measures used for public reporting without an adequate evidence base.

The SAAR

The SAAR is similar to the more well-established standardized infection ratio (SIR) used to track healthcare-associated infections (HAIs). Similarities include the use of an observed-to-predicted framework to guide facilities. However, a critical difference is that while the optimal number of HAIs is zero, the optimal amount of antibiotic use is unknown. Antibiotics are lifesaving medications to patients with severe infections. The ideal amount of antibiotic use is an elusive benchmark because it can be variable by setting and patient and is, to some degree, subjective. Reference Spivak, Cosgrove and Srinivasan4 Most inpatient ASPs determine appropriate use through some amount of chart audit and feedback, which allows for incorporation of individual clinical scenarios and patient-level variables in decision making. Developing a risk-adjusted SAAR for national benchmarking is a laudable goal, but for ASPs to be able to use it constructively, the details matter.

SAAR is not a single metric but a multifaceted one. The SAAR creates a metric for adult, pediatric, and neonatal populations using 17 patient location types across 22 antimicrobial agent categories. This framework results in 47 possible SAARs (Appendix 1). 5 Certainly, variability in antimicrobial utilization would be expected between these types of units. However, a vast difference of expected use may remain even within these unit types, limiting the value in comparison. For example, a “hematology oncology” unit that cares primarily for solid-tumor cancer patients would have significantly different expected antibiotic use from one that cares primarily for hematologic malignancies with stem-cell transplant patients, where antimicrobial prophylaxis may be appropriate and where neutropenic fever is common. Similarly, in some facilities, solid-organ transplant units may be categorized as any of the ward types, and expected antimicrobial use would undoubtedly differ from similarly categorized wards that do not care for such patients. Although a facility stewardship program with specific knowledge of each of their units may be able to use the SAAR for internal benchmarking and initiatives, the absence of this level of detail would make broader comparisons at the regional, state, or national level of limited value. More importantly, a move toward pay for performance with financial penalties for higher-than-expected use, without such adjustments, would be a disservice to those facilities caring for more vulnerable patients and may increase disparities by income and race. Stewardship in immunocompromised patients is an important and growing area of focus, Reference So, Hand and Forrest6 and peer comparison with similar units or facilities may be valuable for those caring for such patients. However, the SAAR requires further refinement to allow for such comparisons. Reference So, Nakamachi and Thursky7

Beyond the lack of granularity of location types, the current SAAR antimicrobial groupings are similarly too broad to allow for meaningful tracking or comparison. For example, ertapenem and fluoroquinolones are grouped with cefuroxime and ceftriaxone under “adult broad-spectrum antibacterial agents predominantly used for community-acquired infections.” Important stewardship work for community-acquired intra-abdominal infections may include promotion of second- or third-generation cephalosporin use plus metronidazole and discouragement of fluoroquinolone use (due to higher resistance expected for the typical pathogens and the adverse effect profile) and of ertapenem use (given lack of need for need for such broad coverage in most locations). However, such work would be invisible within the current SAAR categorization. Worse, de-escalation from ertapenem would actually increase the “all antibacterial agents” SAAR. Under threat of financial penalties, it is not difficult to imagine a facility moving from ceftriaxone and metronidazole to ertapenem for such infections, which would improve their SAAR but would be worse for patient care, selection of resistance, and overall cost of care. There are similar potential issues in other SAAR antimicrobial groupings (Table 1).

Table 1. Selected Standardized Antimicrobial Administration Ratio (SAAR) Antimicrobial Groupings and Potential Issues

Note. SAAR, standardized antimicrobial administration ratio; IV, intravenous; VRE, vancomycin-resistant enterococci.

To further demonstrate the need for risk adjustment, consider a region in which the community rate of ESBL Enterobacterales is high enough to warrant empiric ertapenem for community-acquired intra-abdominal infections. Even if antimicrobial grouping is rectified in future SAAR iterations, to appropriately compare facilities regarding expected antimicrobial utilization, antimicrobial resistance data would need to be considered. This analysis may be possible with the requirement of submission to the Antimicrobial Resistance Option, and preliminary investigations into utilization of antimicrobial resistance data have been done. Reference Santos, Martinez and Won8 However, any pay-for-performance initiative designed prior to its inclusion would be premature.

Importantly, the SAAR does not adjust for any patient-level factors. Patient-level data are needed to appropriately benchmark antimicrobial utilization. Reference Yu, Moisan and Tartof9 Because inclusion of patient-level variables can substantially influence how hospitals rank, Reference Goodman, Pineles and Magder10 further research into which patient-level variables should be included is necessary to guide further refinement of the SAAR before any consideration of public reporting or using such data for reimbursement. Such refinement is being considered by the CDC. Reference O’Leary, Edwards and Srinivasan2

Finally, feasibility of mandated reporting must also be considered. Smaller-to-midsize community facilities often have fewer financial resources, lower content expertise, and less information technology capability to facilitate the required reporting. Lack of time, technical support, and salary support are known barriers for AUR reporting. Reference Werth, Dilworth and Escobar11 Critical-access hospitals, which voluntarily report to the AU option at a lower percentage compared to all hospitals, Reference O’Leary, Edwards and Srinivasan2 will be required to report to NHSN by 2024. 3 Although the CMS has delayed implementation of AUR reporting by a year from the previously proposed 2023, they estimate a median cost of $187,400 to purchase or build an AUR reporting solution. 3 Especially for smaller facilities who do not already have this in place, mandating reporting by 2024 remains an aggressive timeline with considerable financial and administrative barriers.

The slippery slope

Premature requirement of infectious disease metric reporting has occurred in the past, with negative impacts on patients. In 2004, The Joint Commission instituted a core measure for community-acquired pneumonia that included requirements for drawing blood cultures as well as administration of antibiotics within 4 hours of arrival at the emergency department. Reference Walls and Resnick12 These measures, which were publicly reported and linked to reimbursement, led to unnecessary blood-culture ordering (the routine use of which may lead to false-positive results, unnecessary antibiotics, and increased length of stay Reference Metlay, Waterer and Long13 ) that continued despite revisions to the measure to limit use to a sicker subset of patients. Reference Makam, Auerbach and Steinman14 They also led to unnecessary antibiotic administration by emergency physicians to meet the metric. Reference Nicks, Manthey and Fitch15 Not supported by high-quality evidence, Reference Wilson and Schünemann16 the pneumonia measure has since been retired.

Similarly, adherence to the Severe Sepsis and Septic Shock Early Management Bundle (SEP-1), implemented by the CMS in 2015, has not led to improved patient outcomes, Reference Baghdadi, Brook and Uslan17,Reference Barbash, Davis, Yabes, Seymour, Angus and Kahn18 but these data continue to be required and publicly reported. Citing concerns of antibiotic overuse, the Infectious Diseases Society of America, with the support of the American College of Emergency Physicians, American Hospital Association, Pediatric Infectious Diseases Society, Society for Healthcare Epidemiology of America, Society of Hospital Medicine, and Society of Infectious Diseases Pharmacists, has called for major revisions to the measure. Reference Rhee, Chiotos and Cosgrove19 Although well intended, these examples should serve as warnings that national requirements that precede a firm evidence base can lead to wasteful or harmful patient care and unnecessary administrative burden. Mandated reporting of AU data to the NHSN is one step closer to mandated public reporting and use of the SAAR for financial penalties to hospitals, for which it is not nearly ready.

In summary, we applaud the CDC for continued exploration of the SAAR as a risk-adjusted, validated AU metric available for national benchmarking. However, the SAAR is not ready for mandatory use. It needs granularity and risk adjustment for the metric to improve antibiotic use. The CDC is aware of many of these limitations to the SAAR and has highlighted the potential for improvements in future iterations. Reference O’Leary, Edwards and Srinivasan2 With AUR reporting now mandated by the CMS by 2024, we caution policy makers not to go further by requiring public reporting or inclusion of SAAR metrics in value-based programs because doing so prematurely could lead to significant unintended financial and, more importantly, patient safety consequences.

Supplementary material

To view supplementary material for this article, please visit https://doi.org/10.1017/ash.2023.143

Acknowledgments

Financial support

No financial support was provided relevant to this article.

Conflicts of interest

All authors report no conflicts of interest relevant to this article.

References

Barlam, TF, Cosgrove, SE, Abbo, LM, et al. Implementing an antibiotic stewardship program: guidelines by the Infectious Diseases Society of America and the Society for Healthcare Epidemiology of America. Clin Infect Dis 2016;62:e51e77.CrossRefGoogle Scholar
O’Leary, EN, Edwards, JR, Srinivasan, A, et al. National Healthcare Safety Network standardized antimicrobial administration ratios (SAARs): a progress report and risk modeling update using 2017 data. Clin Infect Dis 2020;71:E702E709.CrossRefGoogle ScholarPubMed
Centers for Medicare and Medicaid Services. Hospital inpatient prospective payment systems for acute-care hospitals and the long-term care hospital prospective payment system and policy changes and fiscal year 2023 rates: Quality Programs and Medicare Promoting Interoperability Program. Fed Register 2022;87:4878049499.Google Scholar
Spivak, ES, Cosgrove, SE, Srinivasan, A. Measuring appropriate antimicrobial use: attempts at opening the black box. Clin Infect Dis 2016;63:16391644.Google ScholarPubMed
Antimicrobial use and resistance (AUR) module protocol. Centers for Disease Control and Prevention website. https://www.cdc.gov/nhsn/pdfs/pscmanual/11pscaurcurrent.pdf. Published 2023. Accessed January 11, 2023.Google Scholar
So, M, Hand, J, Forrest, G, et al. White paper on antimicrobial stewardship in solid-organ transplant recipients. Am J Transplant 2022;22:96112.CrossRefGoogle ScholarPubMed
So, M, Nakamachi, Y, Thursky, K. Auditing tools for antimicrobial prescribing in solid-organ transplant recipients: the why, the how, and an assessment of current options. Transpl Infect Dis 2022;24(5):e13905.CrossRefGoogle Scholar
Santos, CAQ, Martinez, AI, Won, SY, et al. Computing antimicrobial use/antimicrobial resistance ratios: a novel way to assess inpatient antimicrobial utilization using current National Healthcare Safety Network metrics. Transpl Infect Dis 2022;24: e13924.CrossRefGoogle ScholarPubMed
Yu, KC, Moisan, E, Tartof, SY, et al. Benchmarking inpatient antimicrobial use: a comparison of risk-adjusted observed-to-expected ratios. Clin Infect Dis 2018;67:16771685.CrossRefGoogle ScholarPubMed
Goodman, KE, Pineles, L, Magder, LS, et al. Electronically available patient claims data improve models for comparing antibiotic use across hospitals: results from 576 US facilities. Clin Infect Dis 2021;73:e4484e4492.CrossRefGoogle ScholarPubMed
Werth, BJ, Dilworth, TJ, Escobar, ZK, et al. Reporting behaviors and perceptions toward the National Healthcare Safety Network antimicrobial use (AU) and antimicrobial resistance (AR) modules. Infect Control Hosp Epidemiol 2023;44:406412.CrossRefGoogle ScholarPubMed
Walls, RM, Resnick, J. The joint commission on accreditation of healthcare organizations and center for medicare and medicaid services community-acquired pneumonia initiative: what went wrong? Ann Emerg Med 2005;46:409411.CrossRefGoogle ScholarPubMed
Metlay, JP, Waterer, GW, Long, AC, et al. Diagnosis and treatment of adults with community-acquired pneumonia. Am J Respir Crit Care Med 2019;200:E45E67.CrossRefGoogle ScholarPubMed
Makam, AN, Auerbach, AD, Steinman, MA. Blood culture use in the emergency department in patients hospitalized with respiratory symptoms due to a nonpneumonia illness. J Hosp Med 2014;9:521524.CrossRefGoogle ScholarPubMed
Nicks, BA, Manthey, DE, Fitch, MT. The centers for medicare and medicaid services (CMS) community-acquired pneumonia core measures lead to unnecessary antibiotic administration by emergency physicians. Acad Emerg Med 2009;16:184187.CrossRefGoogle ScholarPubMed
Wilson, KC, Schünemann, HJ. An appraisal of the evidence underlying performance measures for community-acquired pneumonia. Am J Respir Crit Care Med 2011;183:14541462.CrossRefGoogle ScholarPubMed
Baghdadi, JD, Brook, RH, Uslan, DZ, et al. Association of a care bundle for early sepsis management with mortality among patients with hospital-onset or community-onset sepsis. JAMA Intern Med 2020;180:707716.CrossRefGoogle ScholarPubMed
Barbash, IJ, Davis, BS, Yabes, JG, Seymour, CW, Angus, DC, Kahn, JM. Treatment patterns and clinical outcomes after the introduction of the medicare sepsis performance measure (SEP-1). Ann Intern Med 2021;174:927935.CrossRefGoogle ScholarPubMed
Rhee, C, Chiotos, K, Cosgrove, SE, et al. Infectious Diseases Society of America position paper: recommended revisions to the National Severe Sepsis and Septic Shock Early Management Bundle (SEP-1) sepsis quality measure. Clin Infect Dis 2021;72:541552.CrossRefGoogle Scholar
Figure 0

Table 1. Selected Standardized Antimicrobial Administration Ratio (SAAR) Antimicrobial Groupings and Potential Issues

Supplementary material: File

Shively and Morgan supplementary material

Appendix 1

Download Shively and Morgan supplementary material(File)
File 23.5 KB