Skip to main content Accessibility help
×
Home
Hostname: page-component-56f9d74cfd-s5lbf Total loading time: 0.388 Render date: 2022-06-26T01:58:26.414Z Has data issue: true Feature Flags: { "shouldUseShareProductTool": true, "shouldUseHypothesis": true, "isUnsiloEnabled": true, "useRatesEcommerce": false, "useNewApi": true }

Development of a national, standardized simulation case template

Published online by Cambridge University Press:  22 June 2020

Jared Baylis*
Affiliation:
Department of Emergency Medicine, University of British Columbia, Vancouver, BC
Christopher Heyd
Affiliation:
Division of Emergency Medicine, Department of Medicine, McMaster University, Hamilton, ON
Brent Thoma
Affiliation:
Department of Emergency Medicine, University of Saskatchewan, Saskatoon, SK
Andrew K. Hall
Affiliation:
Department of Emergency Medicine, Queen's University, Kingston, ON
Timothy Chaplin
Affiliation:
Department of Emergency Medicine, Queen's University, Kingston, ON
Andrew Petrosoniak
Affiliation:
Department of Medicine, University of Toronto, Toronto, ON
Tamara McColl
Affiliation:
Department of Emergency Medicine, University of Manitoba, Winnipeg, MB
Michael O'Brien
Affiliation:
Department of Emergency Medicine, University of Ottawa, Ottawa, ON
Jean-François Deshaies
Affiliation:
Department of Family Medicine and Emergency Medicine, Université de Sherbrooke, Sherbrooke, QC
Kyla Caners
Affiliation:
Division of Emergency Medicine, Department of Medicine, McMaster University, Hamilton, ON
*
Correspondence to: Jared Baylis, Kelowna General Hospital, 2268 Pandosy St., Kelowna, BCV1Y 1T2, Canada; Email: jbaylis@alumni.ubc.ca

Abstract

Emergency medicine (EM) training programs incorporate simulation for teaching as well as formative and summative assessment. The development of a simulation curriculum for Canadian postgraduate EM programs is underway and would be facilitated by a standardized, user-friendly, nationally endorsed simulation template. We convened a nationally representative group of simulation educators to participate in a three-phase process to develop and refine a simulation case template for Canadian EM educators. Participants provided feedback by means of free text comments and focus groups which were analyzed to inform modification of the template. We anticipate that this template will facilitate the sharing of cases across sites and the development of standardized cases for simulation-based assessment.

Résumé

Résumé

On a recours à la simulation tant dans l'enseignement que dans les évaluations formatives et sommatives, dans les programmes de formation en médecine d'urgence (MU). Un curriculum de simulation est en cours d’élaboration dans les programmes de formation postdoctorale en MU au Canada, et la tâche serait facilitée par la conception d'un modèle normalisé de simulation, convivial et applicable à l’échelle du pays. Un groupe représentatif de formateurs en simulation au pays a donc été formé pour participer à un processus en trois phases d’élaboration et d'amélioration d'un modèle de simulation conçu à l'intention des enseignants en MU au Canada. Les participants ont fait part de leurs observations dans des commentaires sous forme de texte libre et dans des groupes de réflexion, puis, après analyse, le modèle de cas a été amélioré en conséquence. L’équipe de recherche est d'avis que ce modèle facilitera l’échange de cas dans tous les centres de formation et l’élaboration de cas normalisés pour les évaluations fondées sur la simulation.

Type
Educational Innovation
Copyright
Copyright © Canadian Association of Emergency Physicians 2020

INTRODUCTION

Nearly all Royal College of Physicians and Surgeons of Canada Emergency Medicine (RCPSC-EM) postgraduate training programs have a simulation-based education curriculum.Reference Russell, Hall, Hagel, Petrosoniak, Dagnone and Howes1 The transition to a national competency-based assessment systemReference Kester-Greene, Hall and Walsh2 will require an increase in the use of simulation to provide standardized training experiences and another avenue for assessment.3,Reference Holmboe, Sherbino, Long, Swing and Frank4 Unfortunately, high-quality simulation cases are resource-intensive to develop, and there is no formal mechanism within Canada's EM training programs to promote the collaborative sharing of cases.

A standardized national scenario template could facilitate the development and sharing of high-quality simulation cases by providing a common framework. Simulation scenario templates guide the structure and delivery of simulation cases.Reference Benishek, Lazzara, Gaught, Arcaro, Okuda and Salas5 The use of unfamiliar, external case templates is challenging for educators and simulation technicians (simulation center employees who assist with simulation cases)Reference Bailey, Taylor, FitzGerald, Kerrey, LeMaster and Geis6 who must frequently revise them before use. Furthermore, national scholarly collaboration has been identified as fundamental to the advancement of simulation-based education in EM in CanadaReference Chaplin, Thoma and Petrosoniak7 and a common template could assist with this goal.

We partnered with the EM Simulation Education Researchers Collaborative (EM-SERC), a group of simulation educators committed to advancing EM simulation-based education in Canada by means of collaborative research and knowledge translation, to develop a national simulation template.

PURPOSE/RATIONALE

Well-developed simulation templates have the potential to facilitate the delivery of simulation-based education by assisting users in organizing scenarios and identifying potential challenges before implementation.Reference Benishek, Lazzara, Gaught, Arcaro, Okuda and Salas5 Herein, we describe the development and refinement of a national EM simulation scenario template.

DESCRIPTION OF INNOVATION

Several university-based simulation centers were already using the EM Sim Cases (https://emsimcases.com) template; therefore, we chose to use it as our first draft for the template derivation process. We generated feedback on the template using three phases. We consulted members of the EM-SERC mailing list, which included 20 EM simulation educators representing every RCPSC-EM training site. We resolved conflicting comments using a democratic process.

In phase 1, we sought free-text feedback on the EM Sim Cases template by means of email. We received 65 comments from 11 respondents. Two authors (J.B. and K.C.) performed an inductive thematic analysis which identified four major themes (formatting, objectives, debriefing, and assessment tools). Fifty-one of 65 comments were incorporated into the revised template.

In phase 2, we sought free-text feedback on the revised template by means of email. Two authors (J.B. and K.C.) conducted a second thematic analysis of 40 comments from 12 respondents and identified three broad themes (formatting, objectives, and debriefing). We incorporated 30 out of 40 comments into the penultimate template.

In phase 3, we sought feedback on the penultimate template by means of focus groups with simulation educators and technologists at six Canadian university-affiliated simulation programs across four provinces. Several sites also included nurses, respiratory therapists, and physicians from specialties other than EM. An investigator at each site led their local focus group using guided questions (online Supplemental Appendix A) soliciting participant feedback for the overall template and each individual section. The feedback was collected using either audio recordings or written notes. The feedback was transcribed and e-mailed to J.B. and K.C. This phase generated 98 specific comments which we grouped by template section and served to inform the final template (Supplemental Appendix B).

DISCUSSION

We describe a structured process, endorsed by Canadian simulation educators, to develop an iteratively refined simulation case template. The incorporation of feedback from key EM simulation educators across the country will improve the successful and wide-ranging adoption of the template. We anticipate this product will facilitate the collaboration of simulation initiatives nationwide. Specifically, this template will support: (1) a reduction in the duplication of efforts across sites by facilitating the sharing of simulation cases; (2) a national collaboration for the development of both simulation cases and curricula; and (3) multicenter simulation-based research by removing confounders related to the local adoption of an unfamiliar case template. This will be important to improve the rigour and validity of data by reducing inter-site variability.

The template will be particularly important for the use of simulation in national high-stakes assessment and multisite research. Simulations used for high-stakes assessment and high-quality research must be reproducible to strengthen their validity.Reference Norcini, Anderson and Bollela8 The standardization of cases is imperative to meet these objectivesReference Bond and Spillane9 and the consistent use of a template is likely to lead to comfort among faculty and technicians running the cases.Reference Laack, Lones, Schumacher, Todd and Cook10

Several training sites plan to convert their simulation cases to our final template. To ensure that it serves the needs of the EM community we will conduct a usability analysis and survey among sites who adopt this new template. We plan to increase the adoption of this template using several steps: (1) publication in free-open-access form on https://emsimcases.com; (2) a post outlining its release disseminated by means of Twitter; and (3) a simulation case-series from multiple Canadian postgraduate training programs using the new template published at https://emsimcases.com.

Our project has several limitations. First, most EM-SERC members are from RCPSC-EM training sites, as such, Canadian College of Family Physicians-EM training sites may be underrepresented, thus limiting its generalizability within the Canadian academic EM simulation community. Second, although we solicited feedback from a national group of simulation educators (EM-SERC), simulation technologists, and experienced simulation educators, the perspectives of our allied health colleagues were not methodically pursued, and it may be less applicable to non–physician-based simulation education. Finally, we did not anonymize feedback which may have introduced bias. We mitigated these limitations by obtaining national buy-in and increased generalizability by including simulation leaders from multiple sites in the development process.

SUMMARY

We derived a national simulation case template to encourage the sharing of cases between programs, to facilitate further simulation research, and aid in the development of standardized simulation scenarios for assessment purposes.

Supplemental material

The supplemental material for this article can be found at https://doi.org/10.1017/cem.2020.394.

Competing interests

None declared.

References

Russell, E, Hall, AK, Hagel, C, Petrosoniak, A, Dagnone, JD, Howes, D. Simulation in Canadian postgraduate emergency medicine training – a national survey. CJEM 2018;20:132–41.CrossRefGoogle ScholarPubMed
Kester-Greene, N, Hall, AK, Walsh, CM. Simulation curricular content in postgraduate emergency medicine: a multicentre Delphi study. CJEM 2019;21(5):667–75.CrossRefGoogle ScholarPubMed
The Royal College of Physicians and Surgeons of Canada. Competence by design. [refd June 22, 2019]. Available at: http://www.royalcollege.ca/rcsite/cbd/competence-by-design-cbd-e (accessed May 19, 2020).Google Scholar
Holmboe, ES, Sherbino, J, Long, DM, Swing, SR, Frank, JR. The role of assessment in competency-based medical education. Med Teach 2010;32(8):676–82.CrossRefGoogle ScholarPubMed
Benishek, LE, Lazzara, EH, Gaught, WL, Arcaro, LL, Okuda, Y, Salas, E. The Template of Events for Applied and Critical Healthcare Simulation (TEACH Sim): a tool for systematic simulation scenario design. Simul Healthc 2015;10(1):2130.CrossRefGoogle ScholarPubMed
Bailey, R, Taylor, RG, FitzGerald, MR, Kerrey, BT, LeMaster, T, Geis, GL. Defining the simulation technician role: results of a survey-based study. Simul Healthc 2015;10(5):283–7.CrossRefGoogle ScholarPubMed
Chaplin, T, Thoma, B, Petrosoniak, A, et al. Simulation-based research in emergency medicine in Canada: priorities and perspectives. CJEM 2019;22:103111.CrossRefGoogle Scholar
Norcini, J, Anderson, MB, Bollela, V, et al. 2018 Consensus framework for good assessment. Med Teach 2018;40(11):1102–9.CrossRefGoogle ScholarPubMed
Bond, WF, Spillane, L. The use of simulation for emergency medicine resident assessment. Acad Emerg Med 2002;9(11):1295–9.CrossRefGoogle ScholarPubMed
Laack, TA, Lones, EA, Schumacher, DR, Todd, FM, Cook, DA. Sharing simulation-based training courses between institutions: opportunities and challenges. Adv Simul (Lond) 2017;2:1.CrossRefGoogle ScholarPubMed
Supplementary material: File

Baylis et al. supplementary material

Baylis et al. supplementary material 1

Download Baylis et al. supplementary material(File)
File 14 KB
Supplementary material: File

Baylis et al. supplementary material

Baylis et al. supplementary material 2

Download Baylis et al. supplementary material(File)
File 64 KB
Supplementary material: File

Baylis et al. supplementary material

Baylis et al. supplementary material 3

Download Baylis et al. supplementary material(File)
File 65 KB
You have Access

Save article to Kindle

To save this article to your Kindle, first ensure coreplatform@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Development of a national, standardized simulation case template
Available formats
×

Save article to Dropbox

To save this article to your Dropbox account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you used this feature, you will be asked to authorise Cambridge Core to connect with your Dropbox account. Find out more about saving content to Dropbox.

Development of a national, standardized simulation case template
Available formats
×

Save article to Google Drive

To save this article to your Google Drive account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you used this feature, you will be asked to authorise Cambridge Core to connect with your Google Drive account. Find out more about saving content to Google Drive.

Development of a national, standardized simulation case template
Available formats
×
×

Reply to: Submit a response

Please enter your response.

Your details

Please enter a valid email address.

Conflicting interests

Do you have any conflicting interests? *