Skip to main content Accessibility help

Deriving Measures of Intensive Care Unit Antimicrobial Use from Computerized Pharmacy Data: Methods, Validation, and Overcoming Barriers

  • David N. Schwartz (a1), R. Scott Evans (a2) (a3), Bernard C. Camins (a4), Yosef M. Khan (a5), James F. Lloyd (a2), Nadine Shehab (a6), Kurt Stevenson (a5) and Centers for Disease Control and Prevention Epicenter Program...



To outline methods for deriving and validating intensive care unit (ICU) antimicrobial utilization (AU) measures from computerized data and to describe programming problems that emerged.


Retrospective evaluation of computerized pharmacy and administrative data.


ICUs from 4 academic medical centers over 36 months.


Investigators separately developed and validated programming code to report AU measures in selected ICUs. Use of antibacterial and antifungal drugs for systemic administration was categorized and expressed as antimicrobial-days (each day that each antimicrobial drug was given to each patient) and patient-days receiving antimicrobials (each day that any antimicrobial drug was given to each patient). Monthly rates were compiled and analyzed centrally, with ICU patient-days as the denominator. Results were validated against data collected from manual review of medical records. Frequent discussion among investigators aided identification and correction of programming problems.


AU data were successfully programmed though a reiterative process of computer code revision. After identifying and resolving major programming errors, comparison of computerized patient-level data with data collected by manual review of medical records revealed discrepancies in antimicrobial-days and patient-days receiving antimicrobials that ranged from less than 1% to 17.7%. The hospital from which numerator data were derived from electronic records of medication administration had the least discrepant results.


Computerized AU measures can be derived feasibly, but threats to validity must be sought out and corrected. The magnitude of discrepancies between computerized AU data and a gold standard based on manual review of medical records varies, with electronic records of medication administration providing maximal accuracy.


Corresponding author

Division of Infectious Diseases, John H. Stroger, Jr., Hospital of Cook County, 1901 West Harrison Street, Chicago, IL 60612 (


Hide All
1. Shlaes, DM, Gerding, DN, John, JF Jr, et al. Society for Healthcare Epidemiology and Infectious Diseases Society of America joint committee on the prevention of antimicrobial resistance: guidelines for the prevention of antimicrobial resistance in hospitals. Clin Infect Dis 1997;25:584599.
2. Rubin, MA, Samore, MH. Antimicrobial use and resistance. Curr Infect Dis Rep 2002;4:491497.
3. Interagency Task Force on Antimicrobial Resistance. A public health action plan to combat antimicrobial resistance. Interagency Task Force on Antimicrobial Resistance. Accessed June 23, 2009.
4. Centers for Disease Control and Prevention. Campaign to prevent antimicrobial resistance in healthcare settings, Accessed June 23, 2009.
5. Dellit, TH, Owens, RC, McGowan, JE Jr, et al. Infectious Diseases Society of America and the Society for Healthcare Epidemiology of America guidelines for developing an institutional program to enhance antimicrobial stewardship. Clin Infect Dis 2007;44: 159177.
6. Jha, AK, DesRoches, CM, Campbell, EG, et al. Use of electronic health records in U.S. hospitals. N Engl J Med 2009;360:16281638.
7. Tokars, JI, Richards, C, Andrus, M, et al. The changing face of surveillance for health care-associated infections. Clin Infect Dis 2004;39:13471352.
8. Wisniewski, MF, Kieszkowski, P, Zagorski, BM, Trick, WE, Sommers, M, Weinstein, RA. Development of a clinical data warehouse for hospital infection control. J Am Med Inform Assoc 2003;10:454462.
9. Centers for Disease Control and Prevention. Prevention Epicenters program, Accessed June 23, 2009.
10. Evans, RS, Larsen, RA, Burke, JP, et al. Computer surveillance of hospital-acquired infections and antibiotic use. JAMA 1986;256: 10071011.
11. McMullin, ST, Reichley, RM, Kahn, MG, Dunagan, WC, Bailey, TC. Automated system for identifying potential dosage problems at a large university hospital. Am J Health Syst Pharm 1997;54: 545549.
12. Kamal, J, Rogers, P, Saltz, J, Mekhjian, H. Information warehouse as a tool to analyze Computerized Physician Order Entry order set utilization: opportunities for improvement. AMIA Annu Symp Proc 2003;336340.
13. Polk, RE, Fox, C, Mahoney, A, Letcavage, J, MacDougall, C. Measurement of adult antibacterial drug use in 130 US hospitals: comparison of defined daily dose and days of therapy. Clin Infect Dis 2007;44:664670.
14. Cohen, AL, Calfee, D, Fridkin, SK, et al. Recommendations for metrics for multidrug-resistant organisms in healthcare settings: SHEA/HICPAC position paper. Infect Control Hosp Epidemiol 2008;29:901913.
15. Itokazu, GS, Glowacki, RC, Schwartz, DN, Wisniewski, MF, Rydman, RJ, Weinstein, RA. Antimicrobial consumption data from pharmacy and nursing records: how good are they? Infect Control Hosp Epidemiol 2005;26:395400.
16. Schwartz, DN, Evans, RS, Camins, BC, et al. Electronic measures of hospital antimicrobial utilization: a multi-center pilot assessment of feasibility and variability in intensive care units. In: Program and abstracts of the 17th Annual Meeting of the Society for Healthcare Epidemiology of America; April 14-17, 2007; Baltimore, MD. Abstract 36.
17. Hogan, WR, Wagner, MM. Accuracy of data in computer-based patient records. J Am Med Inform Assoc 1997;5:342355.
18. Barker, KN, Flynn, EA, Pepper, GA, Bates, DW, Mikeal, RL. Medication errors observed in 36 health care facilities. Arch Intern Med 2002;162:18971903.
19. Filius, PMG, Liem, TBY, van der Linden, PD, Janknegt, R, Natsch, S, Vulto, AG, Verbrugh, HA. An additional measure for quantifying antibiotic use in hospitals. J Antimicrob Chemother 2005; 55:805808.
20. de With, K, Maier, L, Steib-Bauert, M, Kern, P, Kern, WV. Defined or prescribed daily doses? patient days or admissions as denominator. Infection 2006;34:9194.
21. Fitzpatrick, RW, Edwards, CMC. Evaluation of a tool to benchmark hospital antibiotic prescribing in the United Kingdom. Pharm World Sci 2008;30:7378.
22. Küster, SP, Ruef, C, Ledergerber, B, Hintermann, A, Deplazes, C, Neuber, L, Weber, R. Quantitative antibiotic use in hospitals: comparison of measurements, literature review, and recommendations for a standard of reporting. Infection 2008;36:549559.
23. Berrington, A. Antimicrobial prescribing in hospitals: be careful what you measure. J Antimicrob Chemother 2010;65:163168.
24. Pakyz, AL, MacDougall, C, Oinonen, M, Polk, RE. Trends in antibacterial use in US academic health centers: 2002 to 2006. Arch Intern Med 2008;168:22542260.
25. MacDougall, C, Polk, RE. Variability in rates of use of antibac-terials among 130 US hospitals and risk-adjustment models for interhospital comparison. Infect Control Hosp Epidemiol 2008; 29:203211.
26. Hutchinson, JM, Patrick, DM, Marra, F, et al. Measurement of antibiotic consumption: a practical guide to the use of the Anatomical Therapeutic Chemical classification and Defined Daily Dose system methodology in Canada. Can J Infect Dis 2004;15: 2935.
27. de With, K, Meyer, E, Steib-Bauert, M, Schwab, F, Daschner, FD, Kern, WV. Antibiotic use in two cohorts of German intensive care units. J Hosp Infect 2006;64:231237.
28. Carling, PC, Fung, T, Coldiron, JS. Parenteral antibiotic use in acute-care hospitals: a standardized analysis of fourteen institutions. Clin Infect Dis 1999;29:11891196.
29. Vander Stichele, RH, Elseviers, MM, Ferech, M, Blot, S, Goosens, H. Hospital consumption of antibiotics in 15 European countries: results of the ESAC Retrospective Data Collection (1997-2002). J Antimicrob Chemother 2006;58:159167.
30. Müller-Pebody, B, Muscat, M, Pelle, B, Klein, BM, Brandt, CT, Monnet, DL. Increase and change in pattern of hospital antimicrobial use, Denmark, 1997-2001. J Antimicrob Chemother 2004;54:11221126.
31. Monnet, DL, Lennox, KA, Phillips, L, Tenover, FC, McGowan, JE, Gaynes, RP. Antimicrobial use and resistance in eight US hospitals: complexities of analysis and modeling. Infect Control Hosp Epidemiol 1998;19:388394.
32. Fridkin, SF, Edwards, JR, Courval, JM, et al. The effect of vancomycin and third-generation cephalosporins on prevalence of vancomycin-resistant enterococci in 126 U.S. adult intensive care units. Ann Intern Med 2001;135:175183.
33. Lesch, CA, Itokazu, GS, Danziger, LH, Weinstein, RA. Multi-hospital analysis of antimicrobial usage and resistance trends. Diagn Microbiol Infect Dis 2001;41:149154.
34. Zagorski, BM, Trick, WE, Schwartz, DN, et al. The effect of renal dysfunction on antimicrobial utilization measurements. Clin Infect Dis 2002;35:14911497.
35. Mandy, B, Koutny, E, Cornette, Woronoff-Lemsi M-C, Talon, D. Methodological validation of monitoring indicators of antibiotics use in hospitals. Pharm World Sci 2004;26:9095.
36. de With, K, Bestehorn, H, Steib-Bauert, M, Kern, WV. Comparison of defined versus recommended versus prescribed daily doses for measuring hospital antibiotic consumption. Infection 2009; 37:349352.
37. Edwards, JR, Pollock, DA, Kupronis, BA, et al. Making use of electronic data: the National Healthcare Safety Network e-Surveillance initiative. Am J Infect Control 2008;36(suppl):S21S26.

Related content

Powered by UNSILO

Deriving Measures of Intensive Care Unit Antimicrobial Use from Computerized Pharmacy Data: Methods, Validation, and Overcoming Barriers

  • David N. Schwartz (a1), R. Scott Evans (a2) (a3), Bernard C. Camins (a4), Yosef M. Khan (a5), James F. Lloyd (a2), Nadine Shehab (a6), Kurt Stevenson (a5) and Centers for Disease Control and Prevention Epicenter Program...


Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed.