Hostname: page-component-76fb5796d-qxdb6 Total loading time: 0 Render date: 2024-04-25T16:36:28.860Z Has data issue: false hasContentIssue false

Testing a novel audit and feedback method for hand hygiene compliance: A multicenter quality improvement study

Published online by Cambridge University Press:  15 November 2018

Aaron M. Scherer*
Affiliation:
Department of Internal Medicine, University of Iowa, Iowa City, Iowa, United States
Heather Schacht Reisinger
Affiliation:
Department of Internal Medicine, University of Iowa, Iowa City, Iowa, United States Center for Access & Delivery Research and Evaluation (CADRE), Iowa City Veterans Affairs Health Care System, Iowa City, Iowa, United States
Michihiko Goto
Affiliation:
Department of Internal Medicine, University of Iowa, Iowa City, Iowa, United States Center for Access & Delivery Research and Evaluation (CADRE), Iowa City Veterans Affairs Health Care System, Iowa City, Iowa, United States
Cassie Cunningham Goedken
Affiliation:
Center for Access & Delivery Research and Evaluation (CADRE), Iowa City Veterans Affairs Health Care System, Iowa City, Iowa, United States
Gosia S. Clore
Affiliation:
Department of Internal Medicine, University of Iowa, Iowa City, Iowa, United States
Alexandre R. Marra
Affiliation:
Department of Internal Medicine, University of Iowa, Iowa City, Iowa, United States Center for Access & Delivery Research and Evaluation (CADRE), Iowa City Veterans Affairs Health Care System, Iowa City, Iowa, United States Division of Medical Practice, Hospital Israelita Albert Einstein, São Paulo, Brazil
Emily E. Chasco
Affiliation:
Center for Access & Delivery Research and Evaluation (CADRE), Iowa City Veterans Affairs Health Care System, Iowa City, Iowa, United States
Charlesnika T. Evans
Affiliation:
Center of Innovation for Complex Chronic Healthcare (CINCCH), Edward Hines Jr Veterans Affairs Hospital, Chicago, Illinois, United States Center for Healthcare Studies and Department of Preventive Medicine Institute for Public Health and Medicine, Northwestern University Feinberg School of Medicine, Chicago, Illinois, United States
Michael A. Rubin
Affiliation:
Salt Lake Veterans Affairs Informatics, Decision Enhancement, and Surveillance (IDEAS) Center, Salt Lake City, Utah, United States Department of Internal Medicine, University of Utah, Salt Lake City, Utah, United States
Eli N. Perencevich
Affiliation:
Department of Internal Medicine, University of Iowa, Iowa City, Iowa, United States Center for Access & Delivery Research and Evaluation (CADRE), Iowa City Veterans Affairs Health Care System, Iowa City, Iowa, United States
*
Author for correspondence: Aaron M. Scherer, Department of Internal Medicine, University of Iowa, 200 Hawkins Dr, Iowa City, IA 52241. E-mail: aaron-scherer@uiowa.edu

Abstract

Objective

Although most hospitals report very high levels of hand hygiene compliance (HHC), the accuracy of these overtly observed rates is questionable due to the Hawthorne effect and other sources of bias. In the study, we aimed (1) to compare HHC rates estimated using the standard audit method of overt observation by a known observer and a new audit method that employed a rapid (<15 minutes) “secret shopper” method and (2) to pilot test a novel feedback tool.

Design

Quality improvement project using a quasi-experimental stepped-wedge design.

Setting

This study was conducted in 5 acute-care hospitals (17 wards, 5 intensive care units) in the Midwestern United States.

Methods

Sites recruited a hand hygiene observer from outside the acute-care units to rapidly and covertly observe entry and exit HHC during the study period, October 2016–September 2017. After 3 months of observations, sites received a monthly feedback tool that communicated HHC information from the new audit method.

Results

The absolute difference in HHC estimates between the standard and new audit methods was ~30%. No significant differences in HHC were detected between the baseline and feedback phases (OR, 0.92; 95% CI, 0.84–1.01), but the standard audit method had significantly higher estimates than the new audit method (OR, 9.83; 95% CI, 8.82–10.95).

Conclusions

HHC estimates obtained using the new audit method were substantially lower than estimates obtained using the standard audit method, suggesting that the rapid, secret-shopper method is less subject to bias. Providing feedback using HHC from the new audit method did not seem to impact HHC behaviors.

Type
Original Article
Copyright
© 2018 by The Society for Healthcare Epidemiology of America. All rights reserved. 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

Cite this article: Scherer AM, et al. (2019) Testing a novel audit and feedback method for hand hygiene compliance: A multicenter quality improvement study. Infection Control & Hospital Epidemiology 2019, 40, 89–94. doi: 10.1017/ice.2018.277

References

1. Chassin, MR , Loeb, JM . The ongoing quality improvement journey: next stop, high reliability. Health Aff 2011;30:559568.Google Scholar
2. Chen, LF , Vander Weg, MW , Hofmann, DA , Reisinger, HS . The Hawthorne effect in infection prevention and epidemiology. Infect Control Hosp Epidemiol 2015;36:14441450.Google Scholar
3. Walker, JL , Sistrunk, WW , Higginbotham, MA , et al. Hospital hand hygiene compliance improves with increased monitoring and immediate feedback. Am J Infect Control 2014;42:10741078.Google Scholar
4. Haessler, S . The Hawthorne effect in measurements of hand hygiene compliance: a definite problem, but also an opportunity. BMJ Qual Saf 2014;23:965967.Google Scholar
5. Gould, DJ , Creedon, S , Jeanes, A , Drey, NS , Chudleigh, J , Moralejo, D . Impact of observing hand hygiene in practice and research: a methodological reconsideration. J Hosp Infect 2017;95:169174.Google Scholar
6. Maury, E , Moussa, N , Lakermi, C , Barbut, F , Offenstadt, G . Compliance of health care workers to hand hygiene: awareness of being observed is important. Intensive Care Med 2006;32:20882089.Google Scholar
7. Dhar, S , Tansek, R , Toftey, EA , et al. Observer bias in hand hygiene compliance reporting. Infect Control Hosp Epidemiol 2010;31:869870.Google Scholar
8. Eckmanns, T , Bessert, J , Behnke, M , Gastmeier, P , Rüden, H . Compliance with antiseptic hand rub use in intensive care units: the Hawthorne effect. Infect Control Hosp Epidemiol 2006;27:931934.Google Scholar
9. Kohli, E , Ptak, J , Smith, R , Taylor, E , Talbot, EA , Kirldand, KB . Variability in the Hawthorne effect with regard to hand hygiene performance in high- and low-performing inpatient care units. Infect Control Hosp Epidemiol 2009;30:222225.Google Scholar
10. Pan, SC , Tien, KL , Hung, IC , et al. Compliance of health care workers with hand hygiene practices: independent advantages of overt and covert observers. PLoS One 2013;8:e53746.Google Scholar
11. Wu, K-S , Chen, Y-S , Lin, H-S , et al. A nationwide covert observation study using a novel method for hand hygiene compliance in health care. Am J Infect Control 2016;45:240244.Google Scholar
12. Srigley, JA , Furness, CD , Baker, GR , Gardam, M . Quantification of the Hawthorne effect in hand hygiene compliance monitoring using an electronic monitoring system: a retrospective cohort study. BMJ Qual Saf 2014;23:974980.Google Scholar
13. Yin, J , Reisinger, HS , vander Weg, M , et al. Establishing evidence-based criteria for directly observed hand hygiene compliance monitoring programs: a prospective, multicenter cohort study. Infect Control Hosp Epidemiol 2014;35:11631168.Google Scholar
14. Ward, MA , Schweizer, ML , Polgreen, PM , Gupta, K , Reisinger, HS , Perencevich, EN . Automated and electronically assisted hand hygiene monitoring systems: a systematic review. Am J Infect Control 2014;42:472478.Google Scholar
15. Schweizer, ML , Reisinger, HS , Ohl, M , et al. Searching for an optimal hand hygiene bundle: a meta-analysis. Clin Infect Dis 2014;58:248259.Google Scholar
16. Pronin, E . Perception and misperception of bias in human judgment. Trends Cogn Sci 2007;11:3743.Google Scholar
17. Scopelliti, I , Morewedge, CK , McCormick, E , Min, HL , Lebrecht, S , Kassam, KS . Bias blind spot: structure, measurement, and consequences. Manage Sci 2015;61:24682486.Google Scholar
18. Morgan, DJ , Pineles, L , Shardell, M , et al. The effect of contact precautions on healthcare worker activity in acute care hospitals. Infect Control Hosp Epidemiol 2013;34:6973.Google Scholar
19. Chang, N-CN , Reisinger, HS , Jesson, AR , et al. Feasibility of monitoring compliance to the My 5 Moments and entry/exit hand hygiene methods in US hospitals. Am J Infect Control 2016;44:938940.Google Scholar
20. Joint Commission. Update: Citing observations of hand hygiene noncompliance. Joint Commission website. https://www.jointcommission.org/assets/1/18/Update_Citing_Observations_of_Hand_Hygiene_Noncompliance.pdf. Published 2018. Accessed April 13, 2018.Google Scholar
21. Thirkell, G , Chambers, J , Gilbart, W , Thornhill, K , Arbogast, J , Lacey, G . Pilot study of digital tools to support multimodal hand hygiene in a clinical setting. Am J Infect Control 2018;46:261265.Google Scholar
22. Willemsen, I , Kluytmans, J . The infection risk scan (IRIS): Standardization and transparency in infection control and antimicrobial use. Antimicrob Resist Infect Control 2018;7:38.Google Scholar
23. Zikmund-Fisher, BJ , Scherer, AM , Witteman, HO , et al. Graphics help patients distinguish between urgent and non-urgent deviations in laboratory test results. J Am Med Informatics Assoc 2017;24:520528.Google Scholar
24. Zikmund-Fisher, BJ , Scherer, AM , Witteman, HO , Solomon, JB , Exe, NL , Fagerlin, A . Effect of harm anchors in visual displays of test results on patient perceptions of urgency about near-normal values: experimental study. J Med Internet Res 2018;20:e98.Google Scholar
25. Huis, A , van Achterberg, T , de Bruin, M , Grol, R , Schoonhoven, L , Hulscher, M . A systematic review of hand hygiene improvement strategies: a behavioural approach. Implement Sci 2012;7(1). doi:10.1186/1748-5908-7-92.Google Scholar
26. Hussey, MA , Hughes, JP . Design and analysis of stepped wedge cluster randomized trials. Contemp Clin Trials 2007;28:182191.Google Scholar
27. Gould, DJ , Moralejo, D , Drey, N , Chudleigh, JH . Interventions to improve hand hygiene compliance in patient care. Cochrane Database Syst Rev 2017;9:CD005186. doi:10.1002/14651858.CD005186.pub3.Google Scholar
28. Stiller, A , Salm, F , Bischoff, P , Gastmeier, P . Relationship between hospital ward design and healthcare-associated infection rates: a systematic review and meta-analysis. Antimicrob Resist Infect Control 2016;5:51.Google Scholar
29. Camerer, C , Weber, M . Recent developments in modeling preferences: uncertainty and ambiguity. J Risk Uncertain 1992;5:325370.Google Scholar
30. Politi, MC , Han, PKJ , Col, NF . Communicating the uncertainty of harms and benefits of medical interventions. Med Decis Mak 2007;27:681695.Google Scholar
31. Tversky, A , Kahneman, D . The framing of decisions and the psychology of choice. Science 1981;211:453458.Google Scholar
32. Kahneman, D . A perspective on judgment and choice: mapping bounded rationality. Am Psychol 2003;58:697720.Google Scholar
33. Lord, CG , Ross, L , Lepper, MR . Biased assimilation and attitude polarization: the effects of prior theories on subsequently considered evidence. J Pers Soc Psychol 1979;37:20982109.Google Scholar
34. Bastardi, A , Uhlmann, EL , Ross, L . Wishful thinking: belief, desire, and the motivated evaluation of scientific evidence. Psychol Sci 2011;22:731732.Google Scholar
35. Kruger, J , Dunning, D . Unskilled and unaware of it: how difficulties in recognizing one’s own incompetence lead to inflated self-assessments. J Pers Soc Psychol 1999;77:11211134.Google Scholar