Skip to main content Accessibility help

Nontechnical Competency Framework for Health Professionals in All-Hazard Emergency Environment: A Systematic Review

  • Xuejun Hu (a1), Changnan He (a2), Huoliang Chen (a1), Shu Liu (a3), Wenqiang Li (a3), Zhou Lu (a1), Jieqiong Zhang (a1) and Min Yu (a3)...



To summarize characteristics and commonalities of non-technical competency frameworks for health professionals in emergency and disaster.


An electronic literature search was conducted in PubMed, MEDLINE, ERIC, Scopus, Cochrane database, and Google Scholar to identify original English-language articles related to development, evaluation or application of the nontechnical competency frameworks. Reviewers assessed identified articles for exclusion/inclusion criteria and abstracted data on study design, framework characteristics, and reliability/validity evidence.


Of the 9627 abstracts screened, 65 frameworks were identified from 94 studies that were eligible for result extraction. Sixty (63.8%) studies concentrated on clinical settings. Common scenarios of the studies were acute critical events in hospitals (44;46.8%) and nonspecified disasters (39;41.5%). Most of the participants (76; 80.9%) were clinical practitioners, and participants in 36 (38.3%) studies were multispecialty. Thirty-three (50.8%) and 42 (64.6%) frameworks had not reported evidence on reliability and validity, respectively. Fourteen of the most commonly involved domains were identified from the frameworks.


Nontechnical competency frameworks applied to multidisciplinary emergency health professionals are heterogeneous in construct and application. A fundamental framework with standardized terminology for the articulation of competency should be developed and validated so as to be accepted and adapted universally by health professionals in all-hazard emergency environment.


Corresponding author

Correspondence and reprint requests to Min Yu, No. 27 Taiping Road, Beijing, China100850 (e-mail:


Hide All
1.Daily, E, Padjen, P, Birnbaum, M. A review of competencies developed for disaster healthcare providers: limitations of current processes and applicability. Prehosp Disaster Med. 2010;25(5):387-395.
2.Crowe, RP, Wagoner, RL, Rodriguez, SA, et al.Defining components of team leadership and membership in prehospital emergency medical services. Prehosp Emerg Care. 2017;21(5):645-651.
3.Jirativanont, T, Raksamani, K, Aroonpruksakul, N, et al.Validity evidence of non-technical skills assessment instruments in simulated anaesthesia crisis management. Anaesth Intensive Care. 2017;45(4):469-475.
4.Flowerdew, L, Gaunt, A, Spedding, J, et al.A multicentre observational study to evaluate a new tool to assess emergency physicians’ non-technical skills. Emerg Med J. 2013;30(6):437-443.
5.Rosenman, ED, Ilgen, JS, Shandro, JR, et al.A systematic review of tools used to assess team leadership in health care action teams. Acad Med. 2015;90(10):1408-1422.
6.Klein, KJ, Ziegert, JC, Knight, AP, et al.Dynamic delegation: shared, hierarchical, and deindividualized leadership in extreme action teams. Admin Sci Q. 2016;51(4):590-621.
7.Ellis, APJ, Bell, BS, Ployhart, RE, et al.An evaluation of generic teamwork skills training with action teams: effects on cognitive and skill-based outcomes. Pers Psychol. 2005;58(3):641-672.
8.Porter, JE, Cant, RP, Cooper, SJ. Rating teams’ non-technical skills in the emergency department: a qualitative study of nurses’ experience. Int Emerg Nurs. 2018;38:15-20.
9.Thoma, B, Poitras, J, Penciner, R, et al.Administration and leadership competencies: establishment of a national consensus for emergency medicine. CJEM. 2015;17(2):107-114.
10.Munroe, B, Curtis, K, Murphy, M, et al.A structured framework improves clinical patient assessment and nontechnical skills of early career emergency nurses: a pre-post study using full immersion simulation. J Clin Nurs. 2016;25(15-16):2262-2274.
11.Zhuravsky, L. Crisis leadership in an acute clinical setting: Christchurch Hospital, New Zealand ICU experience following the February 2011 earthquake. Prehosp Disaster Med. 2015;30(02):131-136.
12.Linton, J, Farrell, MJ. Nurses’ perceptions of leadership in an adult intensive care unit: a phenomenology study. Intensive Crit Care Nurs. 2009;25(2):64-71.
13.Taylor, KL, Ferri, S, Yavorska, T, et al.A description of communication patterns during CPR in ICU. Resuscitation. 2014;85(10):1342-1347.
14.Kim, J, Neilipovitz, D, Cardinal, P, et al.A pilot study using high-fidelity simulation to formally evaluate performance in the resuscitation of critically ill patients: the University of Ottawa Critical Care Medicine, High-Fidelity Simulation, and Crisis Resource Management I Study. Crit Care Med. 2006;34(8):2167-2174.
15.Dedy, NJ, Bonrath, EM, Ahmed, N, et al.Structured training to improve nontechnical performance of junior surgical residents in the operating room: a randomized controlled trial. Ann Surg. 2016;263(1):43-49.
16.Dedy, NJ, Szasz, P, Louridas, M, et al.Objective structured assessment of nontechnical skills: reliability of a global rating scale for the in-training assessment in the operating room. Surgery. 2015;157(6):1002-1013.
17.Jankouskas, TS, Haidet, KK, Hupcey, JE, et al.Targeted crisis resource management training improves performance among randomized nursing and medical students. Simul Health. 2011;6(6):316-326.
18.Jernigan, PL, Wallace, MC, Novak, CS, et al.Measuring intangibles: defining predictors of non-technical skills in critical care air transport team trainees. Mil Med. 2016;181(10):1357-1362.
19.Myers, JA, Powell, DM, Psirides, A, et al.Non-technical skills evaluation in the critical care air ambulance environment: introduction of an adapted rating instrument--an observational study. Scand J Trauma Resusc Emerg Med. 2016;24:24.
20.Peller, J, Schwartz, B, Kitto, S. Nonclinical core competencies and effects of interprofessional teamwork in disaster and emergency response training and practice: a pilot study. Disaster Med Public Health Prep. 2013;7(4):395-402.
21.Wickramasinghe, KK, Ishara, MH, Liyanage, P, et al.Outcome-based approach in development of a disaster management course for healthcare workers. Ann Acad Med Singapore. 2007;36(9):765-769.
22.Cox, RS, Danford, T. The need for a systematic approach to disaster psychosocial response: a suggested competency framework. Prehosp Disaster Med. 2014;29(2):183-189.
23.Walsh, L, Subbarao, I, Gebbie, K, et al.Core competencies for disaster medicine and public health. Disaster Med Public Health Prep. 2012;6(1):44-52.
24.Tachibanai, T, Takemura, S, Sone, T, et al.Competence necessary for Japanese public health center directors in responding to public health emergencies. Nihon Koshu Eisei Zasshi. 2005;52(11):943-956.
25.Savoia, E, Testa, MA, Biddinger, PD, et al.Assessing public health capabilities during emergency preparedness tabletop exercises: reliability and validity of a measurement tool. Public Health Rep. 2009;124(1):138-148.
26.Cope, JR, Frost, M, Richun, L, et al.Assessing knowledge and application of emergency risk communication principles among public health workers in China. Disaster Med Public Health Prep. 2014;8(3):199-205.
27.Dent, AW, Weiland, TJ, Paltridge, D. Australasian emergency physicians: a learning and educational needs analysis. Part Four: CPD topics desired by emergency physicians. Emerg Med Australas. 2008;20(3):260-266.
28.Flowerdew, L, Brown, R, Vincent, C, et al.Development and validation of a tool to assess emergency physicians’ nontechnical skills. Ann Emerg Med. 2012;59(5):376-385.
29.Schultz, CH, Koenig, KL, Whiteside, M, et al.Development of national standardized all-hazard disaster core competencies for acute care physicians, nurses, and EMS professionals. Ann Emerg Med. 2012;59(3):196-208.
30.Willems, A, Waxman, B, Bacon, AK, et al.Interprofessional non-technical skills for surgeons in disaster response: a qualitative study of the Australian perspective. J Interprof Care. 2013;27(2):177-183.
31.Bhangu, A, Bhangu, S, Stevenson, J, et al.Lessons for surgeons in the final moments of Air France Flight 447. World J Surg. 2013;37(6):1185-1192.
32.Doumouras, AG, Hamidi, M, Lung, K, et al.Non-technical skills of surgeons and anaesthetists in simulated operating theatre crises. Br J Surg. 2017;104(8):1028-1036.
33.Mosca, NW, Sweeney, PM, Hazy, JM, et al.Assessing bioterrorism and disaster preparedness training needs for school nurses. J Public Health Manag Pract. 2005;(Suppl):S38-S44.
34.Gordon, CJ, Jorm, C, Shulruf, B, et al.Development of a self-assessment teamwork tool for use by medical and nursing students. BMC Med Educ. 2016;16(1):218.
35.Yee, B, Naik, VN, Joo, HS, et al.Nontechnical skills in anesthesia crisis management with repeated exposure to simulation-based education. Anesthesiology. 2005;103(2):241-248.
36.Centers for Disease Control and Prevention. Bioterrorism & emergency readiness: competencies for all public health workers. 2002. (Accessed December 24, 2019).
37.King, RV, North, CS, Larkin, GL, et al.Attributes of effective disaster responders: focus group discussions with key emergency response leaders. Disaster Med Public Health Prep. 2010;4(4):332-338.
38.King, RV, Larkin, GL, Fowler, RL, et al.Characteristics of effective disaster responders and leaders: a survey of disaster medical practitioners. Disaster Med Public Health Prep. 2016;10(5):720-723.
39.Ripoll, GA, Djalali, A, Foletti, M, et al.Core competencies in disaster management and humanitarian assistance: a systematic review. Disaster Med Public Health Prep. 2015;9(4):430-439.
40.Chalwin, RP, Flabouris, A. Utility and assessment of non-technical skills for rapid response systems and medical emergency teams. Intern Med J. 2013;43(9):962-969.
41.Al Thobaity, A, Plummer, V, Williams, B. What are the most common domains of the core competencies of disaster nursing? A scoping review. Int Emerg Nurs. 2017;31:64-71.
42.Mete, I, Brannick, MT. Estimating the reliability of nontechnical skills in medical teams. J Surg Educ. 2017;74(4):596-611.
43.Rimstad, R, Braut, GS. Literature review on medical incident command. Prehosp Disaster Med. 2015;30(2):205-215.
44.Weller, J, Shulruf, B, Torrie, J, et al.Validation of a measurement tool for self-assessment of teamwork in intensive care. Br J Anaesth. 2013;111(3):460-467.
45.Flowerdew, L, Brown, R, Vincent, C, et al.Development and validation of a tool to assess emergency physicians’ nontechnical skills. Ann Emerg Med. 2012;59(5):376-385.
46.Yule, S, Flin, R, Paterson-Brown, S, et al.Non-technical skills for surgeons in the operating room: a review of the literature. Surgery. 2006;139(2):140-149.
47.Rehim, SA, DeMoor, S, Olmsted, R, et al.Tools for assessment of communication skills of hospital action teams: a systematic review. J Surg Educ. 2017;74(2):341-351.
48.Liberati, A, Altman, DG, Tetzlaff, J, et al.The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. BMJ. 2009;339:b2700.
49.Savoldelli, GL, Naik, VN, Park, J, et al.Value of debriefing during simulated crisis management: oral versus video-assisted oral feedback. Anesthesiology. 2006;105(2):279-285.
50.Jankouskas, T, Bush, MC, Murray, B, et al.Crisis resource management: evaluating outcomes of a multidisciplinary team. Simul Healthc. 2007;2(2):96-101.
51.Riem, N, Boet, S, Bould, MD, et al.Do technical skills correlate with non-technical skills in crisis resource management: a simulation study. Br J Anaesth. 2012;109(5):723-728.
52.Fox-Robichaud, AE, Nimmo, GR. Education and simulation techniques for improving reliability of care. Curr Opin Crit Care. 2007;13(6):737-741.
53.Wunder, LL. Effect of a nontechnical skills intervention on first-year student registered nurse anesthetists’ skills during crisis simulation. AANA J. 2016;84(1):46-51.
54.Watkins, SC, Roberts, DA, Boulet, JR, et al.Evaluation of a simpler tool to assess nontechnical skills during simulated critical events. Simul Healthc. 2017;12(2):69-75.
55.Flin, R, Maran, N. Identifying and training non-technical skills for teams in acute medicine. Qual Saf Health Care. 2004;13(Suppl 1):i80-i84.
56.Boet, S, Bould, MD, Bruppacher, HR, et al.Looking in the mirror: self-debriefing versus instructor debriefing for simulated crises. Crit Care Med. 2011;39(6):1377-1381.
57.Kim, J, Neilipovitz, D, Cardinal, P, et al.A comparison of global rating scale and checklist scores in the validation of an evaluation tool to assess performance in the resuscitation of critically ill patients during simulated emergencies (abbreviated as “CRM simulator study IB”). Simul Healthc. 2009;4(1):6-16.
58.Doumouras, AG, Engels, PT. Early crisis nontechnical skill teaching in residency leads to long-term skill retention and improved performance during crises: a prospective, nonrandomized controlled study. Surgery. 2017;162(1):174-181.
59.Clarke, S, Horeczko, T, Carlisle, M, et al.Emergency medicine resident crisis resource management ability: a simulation-based longitudinal study. Med Educ Online. 2014;19:25771.
60.Gebbie, K, Merrill, J, Hwang, I, et al.Identifying individual competency in emerging areas of practice: an applied approach. Qual Health Res. 2002;12(7):990-999.
61.Hites, LS, Lafreniere, AV, Wingate, MS, et al.Expanding the public health emergency preparedness competency set to meet specialized local and evolving national needs: a needs assessment and training approach. J Public Health Manag Pract. 2007;13(5):497-505.
62.Briggs, A, Raja, AS, Joyce, MF, et al.The role of nontechnical skills in simulated trauma resuscitation. J Surg Educ. 2015;72(4):732-739.
63.Shewchuk, RM, O’Connor, SJ, Fine, DJ. Building an understanding of the competencies needed for health administration practice. J Healthc Manag. 2005;50(1):32-48.
64.Birnbaum, ML. Structure and science. Prehosp Disaster Med. 2006;21(06):369-371.
65.Westera, W. Competences in education: a confusion of tongues. J Curric Stud. 2001;33(1):75-88.
66.Reznek, M, Smith-Coggins, R, Howard, S, et al.Emergency medicine crisis resource management (EMCRM): pilot study of a simulation-based crisis management course for emergency medicine. Acad Emerg Med. 2003;10(4):386-389.
67.Neira, VM, Bould, MD, Nakajima, A, et al.“GIOSAT”: a tool to assess CanMEDS competencies during simulated crises. Can J Anesth. 2013;60(3):280-289.
68.Cooper, S, Cant, R, Connell, C, et al.Measuring teamwork performance: validity testing of the Team Emergency Assessment Measure (TEAM) with clinical resuscitation teams. Resuscitation. 2016;101:97-101.
69.Endacott, R, Bogossian, FE, Cooper, SJ, et al.Leadership and teamwork in medical emergencies: performance of nursing students and registered nurses in simulated patient scenarios. J Clin Nurs. 2015;24(1-2):90-100.
70.Cooper, S, Cant, R, Porter, J, et al.Rating medical emergency teamwork performance: development of the Team Emergency Assessment Measure (TEAM). Resuscitation. 2010;81(4):446-452.
71.Cant, RP, Porter, JE, Cooper, SJ, et al.Improving the non-technical skills of hospital medical emergency teams: the Team Emergency Assessment Measure (TEAM). Emerg Med Australas. 2016;28(6):641-646.
72.Deitchman, S.Enhancing crisis leadership in public health emergencies. Disaster Med Public Health Prep. 2013;7(5):534-540.
73.Georgino, MM, Kress, T, Alexander, S, et al.Emergency preparedness education for nurses: core competency familiarity measured utilizing an adapted emergency preparedness information questionnaire. J Trauma Nurs. 2015;22(5):240-248, E1-E2.
74.Wisniewski, R, Dennik-Champion, G, Peltier, JW. Emergency preparedness competencies: assessing nurses’ educational needs. J Nurs Adm. 2004;34(10):475-480.
75.Smith, S, Farra, S, Dempsey, A, et al.Preparing nursing students for leadership using a disaster-related simulation. Nurse Educ. 2015;40(4):212-216.
76.Davis, B, Welch, K, Walsh-Hart, S, et al.Effective teamwork and communication mitigate task saturation in simulated critical care air transport team missions. Mil Med. 2014;179(8 Suppl):19-23.
77.Marin, SM, Witt, RR. Hospital nurses’ competencies in disaster situations: a qualitative study in the south of Brazil. Prehosp Disaster Med. 2015;30(6):548-552.
78.Pryor, E, Heck, E, Norman, L, et al.Integrated decision-making in response to weapons of mass destruction incidents: development and initial evaluation of a course for healthcare professionals. Prehosp Disaster Med. 2006;21(1):24-30.
79.Barbera, JA, Macintyre, AG, Shaw, G, et al. Healthcare emergency management competencies: competency framework final report. 2007. (Accessed December 24, 2019).
80.Leenstra, NF, Jung, OC, Johnson, A, et al.Taxonomy of trauma leadership skills: a framework for leadership training and assessment. Acad Med. 2016;91(2):272-281.
81.ICN. WPRO | ICN Framework of Disaster Nursing Competencies. 2009. (Accessed December 24, 2019).
82.Lambden, S, DeMunter, C, Dowson, A, et al.The Imperial Paediatric Emergency Training Toolkit (IPETT) for use in paediatric emergency training: development and evaluation of feasibility and validity. Resuscitation. 2013;84(6):831-836.
83.Veenema, TG, Deruggiero, K, Losinski, S, et al.Hospital administration and nursing leadership in disasters. Nurs Admin Q. 2017;41(2):151-163.
84.von Wyl, T, Zuercher, M, Amsler, F, et al.Technical and non-technical skills can be reliably assessed during paramedic simulation training. Acta Anaesthesiol Scand. 2009;53(1):121-127.
85.Steinemann, S, Berg, B, DiTullio, A, et al.Assessing teamwork in the trauma bay: introduction of a modified “NOTECHS” scale for trauma. Am J Surg. 2012;203(1):69-75.
86.Wang, C, Wei, S, Xiang, H, et al.Development and evaluation of a leadership training program for public health emergency response: results from a Chinese study. BMC Public Health. 2008;8:377.
87.Hsu, EB, Thomas, TL, Bass, EB, et al.Healthcare worker competencies for disaster training. BMC Med Educ. 2006;6:19.
88.Wallin, CJ, Meurling, L, Hedman, L, et al.Target-focused medical emergency team training using a human patient simulator: effects on behaviour and attitude. Med Educ. 2007;41(2):173-180.
89.Ranse, J, Shaban, RZ, Considine, J, et al.Disaster content in Australian tertiary postgraduate emergency nursing courses: a survey. Australas Emerg Nurs J. 2013;16(2):58-63.
90.Atack, L, Parker, K, Rocchi, M, et al.The impact of an online interprofessional course in disaster management competency and attitude towards interprofessional learning. J Interprof Care. 2009;23(6):586-598.
91.Al Thobaity, A, Williams, B, Plummer, V. A new scale for disaster nursing core competencies: development and psychometric testing. Australas Emerg Nurs J. 2016;19(1):11-19.
92.Bristowe, K, Siassakos, D, Hambly, H, et al.Teamwork for clinical emergencies. Qual Health Res. 2012;22(10):1383-1394.
93.Hart, PL, Spiva, L, Baio, P, et al.Medical-surgical nurses’ perceived self-confidence and leadership abilities as first responders in acute patient deterioration events. J Clin Nurs. 2014;23(19-20):2769-2778.
94.Meeker, J, Perry, A, Dolan, C, et al.Development of a competency framework for the nutrition in emergencies sector. Public Health Nutr. 2014;17(03):689-699.
95.Subbarao, I, Lyznicki, JM, Hsu, EB, et al.A consensus-based educational framework and competency set for the discipline of disaster medicine and public health preparedness. Disaster Med Public Health Prep. 2008;2(1):57-68.
96.Gebbie, KM, Qureshi, K. Emergency and disaster preparedness: core competencies for nurses. Am J Nurs. 2002;102(1):46-51.
97.Yeager, V, Cooper, GJ, Burkle, FJ, et al.Twitter as a potential disaster risk reduction tool. Part IV: competency-based education and training guidelines to promote community resiliency. PLoS Curr. 2015;7. doi: 10.1371/currents.dis.ce3fad537bd666770a649a076ee71ba4.
98.Gebbie, KM, Weist, EM, McElligott, JE, et al.Implications of preparedness and response core competencies for public health. J Public Health Manag Pract. 2013;19(3):224-230.
99.Bahrami, M, Aliakbari, F, Aein, F. Iranian nurses’ perception of essential competences in disaster response: a qualitative study. J Educ Health Promot. 2014;3:81.
100.Saleh, SS, Williams, D, Balougan, M. Evaluating the effectiveness of public health leadership training: the NEPHLI experience. Am J Public Health. 2004;94(7):1245-1249.
101.Luo, Y, Liu, L, Huang, WQ, et al.A disaster response and management competency mapping of community nurses in China. Iran J Public Health. 2013;42(9):941-949.
102.Daniel, C, Nick, S, Vishal, P, et al.Tactical and operational response to major incidents_ feasibility and reliability of skills assessment using novel virtual environment. Resuscitation. 2013;84:992-998.
103.Weller, J, Frengley, R, Torrie, J, et al.Evaluation of an instrument to measure teamwork in multidisciplinary critical care teams. BMJ Qual Saf. 2011;20(3):216-222.
104.Poremski, D, Lim, XY, Kunjithapatham, G, et al.Which skills boost service provider confidence when managing people presenting with psychiatric emergencies? Int J Ment Health Nurs. 2016;25(6):566-573.
105.Cooper, S, Wakelam, A. Leadership of resuscitation teams: “Lighthouse Leadership”. Resuscitation. 1999;42(1):27-45.
106.Al Khalaileh, MA, Bond, E, Alasad, JA. Jordanian nurses’ perceptions of their preparedness for disaster management. Int Emerg Nurs. 2012;20(1):14-23.
107.Ahayalimudin, N, Osman, NN. Disaster management: emergency nursing and medical personnel’s knowledge, attitude and practices of the East Coast region hospitals of Malaysia. Australas Emerg Nurs J. 2016;19(4):203-209.
108.Garbutt, SJ, Peltier, JW, Fitzpatrick, JJ. Evaluation of an instrument to measure nurses’ familiarity with emergency preparedness. Mil Med. 2008;173(11):1073-1077.


Type Description Title
Supplementary materials

Hu et al. supplementary material
Hu et al. supplementary material 1

 Unknown (34 KB)
34 KB
Supplementary materials

Hu et al. supplementary material
Hu et al. supplementary material 2

 Unknown (64 KB)
64 KB
Supplementary materials

Hu et al. supplementary material
Hu et al. supplementary material 3

 Word (18 KB)
18 KB

Nontechnical Competency Framework for Health Professionals in All-Hazard Emergency Environment: A Systematic Review

  • Xuejun Hu (a1), Changnan He (a2), Huoliang Chen (a1), Shu Liu (a3), Wenqiang Li (a3), Zhou Lu (a1), Jieqiong Zhang (a1) and Min Yu (a3)...


Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed.