Skip to main content Accessibility help

Development of an Antibiotic Spectrum Score Based on Veterans Affairs Culture and Susceptibility Data for the Purpose of Measuring Antibiotic De-Escalation: A Modified Delphi Approach

  • Karl Madaras-Kelly (a1) (a2), Makoto Jones (a3), Richard Remington (a1) (a4), Nicole Hill (a5), Benedikt Huttner (a3) (a5) and Matthew Samore (a3)...



Development of a numerical score to measure the microbial spectrum of antibiotic regimens (spectrum score) and method to identify antibiotic de-escalation events based on application of the score.


Web-based modified Delphi method.


Physician and pharmacist antimicrobial stewards practicing in the United States recruited through infectious diseases–focused listservs.


Three Delphi rounds investigated: organisms and antibiotics to include in the spectrum score, operationalization of rules for the score, and de-escalation measurement. A 4-point ordinal scale was used to score antibiotic susceptibility for organism-antibiotic domain pairs. Antibiotic regimen scores, which represented combined activity of antibiotics in a regimen across all organism domains, were used to compare antibiotic spectrum administered early (day 2) and later (day 4) in therapy. Changes in spectrum score were calculated and compared with Delphi participants’ judgments on de-escalation with 20 antibiotic regimen vignettes and with non-Delphi steward judgments on de-escalation of 300 pneumonia regimen vignettes. Method sensitivity and specificity to predict expert de-escalation status were calculated.


Twenty-four participants completed all Delphi rounds. Expert support for concepts utilized in metric development was identified. For vignettes presented in the Delphi, the sign of change in score correctly classified de-escalation in all vignettes except those involving substitution of oral antibiotics. The sensitivity and specificity of the method to identify de-escalation events as judged by non-Delphi stewards were 86.3% and 96.0%, respectively.


Identification of de-escalation events based on an algorithm that measures microbial spectrum of antibiotic regimens generally agreed with steward judgments of de-escalation status.

Infect Control Hosp Epidemiol 2014;35(9):1103-1113


Corresponding author

Idaho State University, 1311 East Central Drive, Meridian, ID 83642 (


Hide All
1. Dellit, TH, Owens, RC, McGowan, JE Jr, et al. Infectious Diseases Society of America and the Society for Healthcare Epidemiology of America guidelines for developing an institutional program to enhance antimicrobial stewardship. Clin Infect Dis 2007;44(2):159177.
2. Masterton, RG. Antibiotic de-escalation. Crit Care Clin 2011;27(1):149162.
3. Silva, BN, Andriolo, RB, Atallah, AN, Salomão, R. De-escalation of antimicrobial treatment for adults with sepsis, severe sepsis or septic shock. Cochrane Database Syst Rev 2013;3:CD007934.
4. Singh, N, Rogers, P, Atwood, CW, Wagener, MM, Yu, VL. Short-course empiric antibiotic therapy for patients with pulmonary infiltrates in the intensive care unit: a proposed solution for indiscriminate antibiotic prescription. Am J Respir Crit Care Med 2000;162(2 pt 1):505511.
5. Schlueter, M, James, C, Dominguez, A, Tsu, L, Seymann, G. Practice patterns for antibiotic de-escalation in culture-negative healthcare-associated pneumonia. Infection 2010;38(5):357362.
6. Kollef, MH, Morrow, LE, Niederman, MS, et al. Clinical characteristics and treatment patterns among patients with ventilator-associated pneumonia. Chest 2006;129(5):12101218.
7. Alvarez-Lerma, F, Alvarez, B, Luque, P, et al. Empiric broad-spectrum antibiotic therapy of nosocomial pneumonia in the intensive care unit: a prospective observational study. Crit Care 2006;10(3):R78.
8. Labelle, AJ, Arnold, H, Reichley, RM, Micek, ST, Kollef, MH. A comparison of culture-positive and culture-negative health-care-associated pneumonia. Chest 2010;137(5):11301137.
9. Morel, J, Casoetto, J, Jospé, R, et al. De-escalation as part of a global strategy of empiric antibiotherapy management: a retrospective study in a medico-surgical intensive care unit. Crit Care 2010;14(6):R225.
10. Gonzalez, L, Cravoisy, A, Barraud, D, Conrad, M, Nace, L, Lemarié, J, Bollaert, PE, Gibot, S. Factors influencing the implementation of antibiotic de-escalation and impact of this strategy in critically ill patients. Crit Care 2013;17(4):R140.
11. Schulz, L, Osterby, K, Fox, B. The use of best practice alerts with the development of an antimicrobial stewardship navigator to promote antibiotic de-escalation in the electronic medical record. Infect Control Hosp Epidemiol 2013;34(12):12591265.
12. Holey, EA, Feeley, JL, Dixon, J, Whittaker, VJ. An exploration of the use of simple statistics to measure consensus and stability in Delphi studies. BMC Med Res Methodol 2007;7:52.
13. Cohen, J. Weighted, kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychol Bull 1968;70:213220.
14. American Thoracic Society; Infectious Diseases Society of America. Guidelines for the management of adults with hospital-acquired, ventilator-associated, and healthcare-associated pneumonia. Am J Respir Crit Care Med 2005;171(4):388416.
15. Hsu, C-C, Sandford, BA. The Delphi technique: making sense of consensus. Practical Assess Res Eval 2007;12(10). Accessed January 8, 2014.

Related content

Powered by UNSILO

Development of an Antibiotic Spectrum Score Based on Veterans Affairs Culture and Susceptibility Data for the Purpose of Measuring Antibiotic De-Escalation: A Modified Delphi Approach

  • Karl Madaras-Kelly (a1) (a2), Makoto Jones (a3), Richard Remington (a1) (a4), Nicole Hill (a5), Benedikt Huttner (a3) (a5) and Matthew Samore (a3)...


Altmetric attention score

Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed.