Hostname: page-component-76dd75c94c-7vt9j Total loading time: 0 Render date: 2024-04-30T09:44:57.178Z Has data issue: false hasContentIssue false
  • English
  • Français

Hospital Performance Evaluation Checklist in Context of COVID-19 Pandemic: Design and Validation

Published online by Cambridge University Press:  07 December 2023

Abbas Salarvand Open the ORCID record for Abbas Salarvand [Opens in a new window] ,
Amir Khoshvaghti Open the ORCID record for Amir Khoshvaghti [Opens in a new window] ,
Simintaj Sharififar Open the ORCID record for Simintaj Sharififar [Opens in a new window] ,
Sanaz Zargar Balaye Jame ,
Nader Markazi-moghaddam  and
Armin Zareiyan
Abbas Salarvand
Affiliation:
Department of Health Management and Economics, School of Medicine, AJA University of Medical Sciences, Tehran, Iran
Amir Khoshvaghti
Affiliation:
Infectious Diseases Research Center, Aerospace and Subaquatic Medicine Faculty, Aja University of Medical Sciences, Tehran, Iran
Simintaj Sharififar*
Affiliation:
Department of Health in Disasters and Emergencies, Aja University of Medical Sciences, Tehran, Iran
Sanaz Zargar Balaye Jame
Affiliation:
Department of Health Management and Economics, School of Medicine, AJA University of Medical Sciences, Tehran, Iran
Nader Markazi-moghaddam
Affiliation:
Department of Health Management and Economics, School of Medicine, AJA University of Medical Sciences, Tehran, Iran
Armin Zareiyan
Affiliation:
Department of Public Health, School of Nursing, Aja University of Medical Sciences, Tehran, Iran
*
Corresponding author: Simintaj Sharififar; Email: s_sharififar@yahoo.com.
Get access Rights & Permissions [Opens in a new window]

Abstract

Objective:

Around the world, pandemics have been considered among the main hazards in the last 2 decades. Hospitals are 1 of the most important organizations responding to pandemics. The aim of this study was to design and develop a valid checklist for evaluating the hospitals’ performance in response to COVID-19 pandemic, for the first time.

Methods:

This study is a mixed method research design that began in February, 2020 and was conducted in 3 phases: Designing a conceptual model, designing a primary checklist structure, and checklist psychometric evaluation. Known-groups method has been used to evaluate construct validity. Two groups of hospitals were compared: group A (COVID-19 Hospitals) and group B (the other hospitals).

Results:

The checklist’s main structure was designed with 6 main domains, 23 sub-domains, and 152 items. The content validity ratio and index were 0.94 and 0.79 respectively. Eleven items were added, 106 items were removed, and 40 items were edited. Independent t-test showed a significant difference between the scores of the 2 groups of hospitals (P < 0.0001). Pearson correlation coefficient test also showed a high correlation between our checklist and the other. The internal consistency of the checklist was 0.98 according to Cronbach’s alpha test.

Conclusions:

Evaluating the hospitals’ performance and identifying their strengths and weaknesses, can help health system policymakers and hospital managers, and leads to improved performance in response to COVID-19.

Keywords

Covid-19checklistpsychometric evaluationhospital administrationperformanceresponsedisaster
Type
Original Research
Information
Disaster Medicine and Public Health Preparedness , Volume 17 , 2023 , e570
Copyright
© The Author(s), 2023. Published by Cambridge University Press on behalf of Society for Disaster Medicine and Public Health, Inc

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Tartari, E, Allegranzi, B, Ang, B, et al. Preparedness of institutions around the world for managing patients with Ebola virus disease: an infection control readiness checklist. Antimicrob Resist Infect Control. 2015;4(1):22-33.CrossRefGoogle ScholarPubMed
Vetter, P, Eckerle, I, Kaiser, L. Covid-19: a puzzle with many missing pieces. BMJ. 2020;368:627.CrossRefGoogle ScholarPubMed
Balkhy, HH, Perl, TM, Arabi, YM. Preventing healthcare-associated transmission of the Middle East Respiratory Syndrome (MERS): our Achilles heel. Elsevier. 2016;9:208-212.Google ScholarPubMed
Lin, ECL, Peng, YC, Tsai, JCH. Lessons learned from the anti-SARS quarantine experience in a hospital-based fever screening station in Taiwan. Am J Infect Control. 2010;38(4):302-307.CrossRefGoogle Scholar
Raboud, J, Shigayeva, A, McGeer, A, et al. Risk factors for SARS transmission from patients requiring intubation: a multicenter investigation in Toronto, Canada. PLoS One. 2010;5(5):107117.CrossRefGoogle ScholarPubMed
Shin, J-h, Takada, D, Morishita, T, et al. Economic impact of the first wave of the COVID-19 pandemic on acute care hospitals in Japan. PloS One. 2020;15(12):0244852.CrossRefGoogle ScholarPubMed
Garcia-Vicuna, D, Esparza, L, Mallor, F. Hospital preparedness in epidemics by using simulation: the case of COVID-19. medRxiv. 2020;08.12.20173328.CrossRefGoogle Scholar
Sharififar, S, Jahangiri, K, Zareiyan, A, et al. Factors affecting hospital response in biological disasters: a qualitative study. Med J Islam Repub Iran. 2020;34(1):137-149.Google ScholarPubMed
Shi, Y, Wang, G, Cai, X-p, et al. An overview of COVID-19. J Zhejiang Univ Sci B 2020;21(5):343-360.CrossRefGoogle ScholarPubMed
Wu, D, Wu, T, Liu, Q, et al. The SARS-CoV-2 outbreak: what we know. Int J Infect Dis. 2020;94:44-48.CrossRefGoogle ScholarPubMed
World Health Organization (WHO). Hospital preparedness for epidemics. WHO. Library Cataloguing-in-Publication Data; 2014.Google Scholar
Petrosillo, N, Puro, V, Di Caro, A, Ippolito, G. The initial hospital response to an epidemic. Archives Med Res. 2005;36(6):706-712.CrossRefGoogle Scholar
Rathnayake, D, Clarke, M, Jayasooriya, L. Hospital surge capacity: the importance of better hospital pre-planning to cope with patient surge during dengue epidemics – A systematic review. Int J Healthc Manag. 2019. doi: 10.1080/20479700.2019.1692517.CrossRefGoogle Scholar
Coker, R, Mounier-Jack, S. Pandemic influenza preparedness in the Asia–Pacific region. The Lancet. 2006;368(9538):886-889.CrossRefGoogle ScholarPubMed
Dewar, B, Barr, I, Robinson, P. Hospital capacity and management preparedness for pandemic influenza in Victoria. ANZJPH. 2014;38(2):184-190.Google ScholarPubMed
Reidy, M, Ryan, F, Hogan, D, et al. Preparedness of hospitals in the Republic of Ireland for an influenza pandemic, an infection control perspective. BMC Public Health. 2015;15(1):847.CrossRefGoogle ScholarPubMed
Sprung, CL, Zimmerman, JL, Christian, MD, et al. Recommendations for intensive care unit and hospital preparations for an influenza epidemic or mass disaster: summary report of the European Society of Intensive Care Medicine’s Task Force for intensive care unit triage during an influenza epidemic or mass disaster. Intensive Care Med. 2010;36(3):428-443.CrossRefGoogle ScholarPubMed
Sarti, AJ, Sutherland, S, Robillard, N, et al. Ebola preparedness: a rapid needs assessment of critical care in a tertiary hospital. CMAJ Open. 2015;3(2):198-207.CrossRefGoogle ScholarPubMed
Hopkins, RS, Misegades, L, Ransom, J, et al. SARS preparedness checklist for state and local health officials. Emerg Infect Dis. 2004;10(2):369-372.CrossRefGoogle ScholarPubMed
Higgins, W, Wainright, C, Lu, N, et al. Assessing hospital preparedness using an instrument based on the Mass Casualty Disaster Plan Checklist: results of a statewide survey. Am J Infect Control. 2004;32(6):327-332.CrossRefGoogle ScholarPubMed
Olivieri, C, Ingrassia, PL, Della Corte, F, et al. Hospital preparedness and response in CBRN emergencies: TIER assessment tool. Eur J Emerg Med. 2017;24(5):366-370.CrossRefGoogle ScholarPubMed
World Health Organization (WHO). Guidelines for epidemic preparedness and response to measles outbreaks. WHO. Geneva, Switzerland; 1999.Google Scholar
Ali, I, Alharbi, OM. COVID-19: disease, management, treatment, and social impact. Sci Total Environ. 2020;728:138861.CrossRefGoogle ScholarPubMed
Harapan, H, Itoh, N, Yufika, A, et al. Coronavirus disease 2019 (COVID-19): a literature review. J Infect Public Health. 2020;13(5):667-673.CrossRefGoogle ScholarPubMed
Pascarella, G, Strumia, A, Piliego, C, et al. COVID-19 diagnosis and management: a comprehensive review. J Internal Med. 2020;288(2):192-206.CrossRefGoogle ScholarPubMed
Cook, J. Incident command in the time of COVID-19. Lab Med. 2020;51(6):78-82.CrossRefGoogle ScholarPubMed
Devereaux, A, Yang, H, Seda, G, et al. Optimizing scarce resource allocation during COVID-19: rapid creation of a regional healthcare coalition and triage teams in San Diego County, California. Disaster Med Public Health Prep. 2020;1-7.Google ScholarPubMed
Gagliano, A, Villani, PG, Manelli, A, et al. COVID-19 epidemic in the middle province of Northern Italy: impact, logistics, and strategy in the first line hospital. Disaster Med Public Health Prep. 2020;14(3):372-376.CrossRefGoogle ScholarPubMed
Kandel, N, Chungong, S, Omaar, A, et al. Health security capacities in the context of COVID-19 outbreak: an analysis of International Health Regulations annual report data from 182 countries. The Lancet. 2020;395(10229):1047-1053.CrossRefGoogle ScholarPubMed
World Health Organization (WHO). Critical preparedness, readiness, and response actions for COVID-19: interim guidance. WHO; 2020.Google Scholar
Reeves, JJ, Hollandsworth, HM, Torriani, FJ, et al. Rapid response to COVID-19: health informatics support for outbreak management in an academic health system. JAMIA. 2020;27(6):853-859.Google Scholar
World Health Organization (WHO). Hospital readiness checklist. Pan American Health Organization; 2020.Google Scholar
Lawshe, CH. A quantitative approach to content validity. Pers Psychol. 1975;28(4):563-575.CrossRefGoogle Scholar
Polit, DF, Beck, CT, Owen, SV. Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Res Nurs Health. 2007;30(4):459-467.CrossRefGoogle ScholarPubMed
Altman, DG, Bland, JM. Measurement in medicine: the analysis of method comparison studies. J Royal Stat Soc: Series D (The Statistician). 1983;32(3):307-317.Google Scholar
Polit, DF, Frances, Y. Measurement and the measurement of change: a primer for the health professions. Philadelphia: Wolters Kluwer; 2016.Google Scholar
Iran Ministry of Health. Hospital preparedness evaluation checklist for epidemic disasters management; 2020. [Cited March 18, 2021.] https://vc-trethment.kums.ac.ir/kums_content/media/image/2020/08/144185_orig.rar Google Scholar
Schmutz, J, Eppich, WJ, Hoffmann, F, et al. Five steps to develop checklists for evaluating clinical performance: an integrative approach. Acad Med. 2014;89(7):996-1005.CrossRefGoogle ScholarPubMed
Stufflebeam, DL. Guidelines for developing evaluation checklists: the checklists development checklist (CDC). Kalamazoo, MI: The Evaluation Center; 2000.Google Scholar
Verdaasdonk, E, Stassen, L, Widhiasmara, PP, et al. Requirements for the design and implementation of checklists for surgical processes. Surg Endosc. 2009;23(4):715-726.CrossRefGoogle ScholarPubMed
Weiser, TG, Berry, WR. Perioperative checklist methodologies. Canadian J Anesthesia. 2013;60(2):136-142.CrossRefGoogle ScholarPubMed
Mazloumi, A, Azizpour, MM, Garosi, E, et al. Customization, and validation study of WHO surgical safety checklist as a tool to control medical error in operation rooms in Iran. HASWA. 2018;8(2):135-148.Google Scholar
Burian, BK, Clebone, A, Dismukes, K, et al. More than a tick box: medical checklist development, design, and use. Anesth Analg. 2018;126(1):223-232.CrossRefGoogle ScholarPubMed
Soong, C, Daub, S, Lee, J, et al. Development of a checklist of safe discharge practices for hospital patients. J Hospital Med. 2013;8(8):444-449.CrossRefGoogle ScholarPubMed
Brunsveld-Reinders, AH, Arbous, MS, Kuiper, SG, et al. A comprehensive method to develop a checklist to increase safety of intra-hospital transport of critically ill patients. Critic Care. 2015;19(1):214-224.CrossRefGoogle ScholarPubMed
Centers for Disease Control and Prevention (CDC). Comprehensive hospital preparedness checklist for Coronavirus Disease 2019 (COVID-19). US Department of Health and Human Services. Center for Disease Control and Prevention; 2020.Google Scholar
World Health Organization (WHO). Consolidated Ebola virus disease preparedness checklist. WHO;2015(1). https://www.who.int/publications/i/item/who-evd-preparedness-14-Rev1 Google Scholar
World Health Organization (WHO). Hospital preparedness checklist for pandemic influenza: focus on pandemic (H1N1) 2009. WHO Regional Office for Europe; 2009. https://www.who.int/publications/i/item/hospital-preparedness-checklist-for-pandemic-influenza Google Scholar
Hales, B, Terblanche, M, Fowler, R, et al. Development of medical checklists for improved quality of patient care. Int J Qual Health Care. 2008;20(1):22-30.CrossRefGoogle ScholarPubMed
Supplementary material: File

Salarvand et al. supplementary material
Download undefined(File)
File 552.4 KB