Hostname: page-component-8448b6f56d-c4f8m Total loading time: 0 Render date: 2024-04-19T07:34:01.163Z Has data issue: false hasContentIssue false
  • English
  • Français

MIXED REALITY IN MEDICAL SIMULATION: A COMPREHENSIVE DESIGN METHODOLOGY

Published online by Cambridge University Press:  27 July 2021

Agnese Brunzini ,
Alessandra Papetti ,
Michele Germani  and
Erica Adrario
Agnese Brunzini*
Affiliation:
Università Politecnica delle Marche, Department of Industrial Engineering and Mathematical Sciences;
Alessandra Papetti
Affiliation:
Università Politecnica delle Marche, Department of Industrial Engineering and Mathematical Sciences;
Michele Germani
Affiliation:
Università Politecnica delle Marche, Department of Industrial Engineering and Mathematical Sciences;
Erica Adrario
Affiliation:
Università Politecnica delle Marche, Department of Biomedical Sciences and Public Health, Section of Anaesthesia and Intensive Care Unit
*
Brunzini, Agnese, Università Politecnica delle Marche, Department of Industrial Engineering and Mathematical Sciences, Italy, a.brunzini@pm.univpm.it

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the ‘Save PDF’ action button.

In the medical education field, the use of highly sophisticated simulators and extended reality (XR) simulations allow training complex procedures and acquiring new knowledge and attitudes. XR is considered useful for the enhancement of healthcare education; however, several issues need further research.

The main aim of this study is to define a comprehensive method to design and optimize every kind of simulator and simulation, integrating all the relevant elements concerning the scenario design and prototype development.

A complete framework for the design of any kind of advanced clinical simulation is proposed and it has been applied to realize a mixed reality (MR) prototype for the simulation of the rachicentesis. The purpose of the MR application is to immerse the trainee in a more realistic environment and to put him/her under pressure during the simulation, as in real practice.

The application was tested with two different devices: the headset Vox Gear Plus for smartphone and the Microsoft Hololens. Eighteen students of the 6th year of Medicine and Surgery Course were enrolled in the study. Results show the comparison of user experience related to the two different devices and simulation performance using the Hololens.

Keywords

Design methodologyTrainingEducationMedical SimulationMixed Reality
Type
Article
Information
Proceedings of the Design Society , Volume 1: ICED21 , August 2021 , pp. 2107 - 2116
Creative Commons
Creative Common License - CCCreative Common License - BYCreative Common License - NCCreative Common License - ND
This is an Open Access article, distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives licence (http://creativecommons.org/licenses/by-nc-nd/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is unaltered and is properly cited. The written permission of Cambridge University Press must be obtained for commercial re-use or in order to create a derivative work.
Copyright
The Author(s), 2021. Published by Cambridge University Press

References

AL Sabei, S.D. and Lasater, K. (2016), “Simulation debriefing for clinical judgment development: A concept analysis”, Nurse Education Today, Vol. 45, pp. 42–47. https://dx.doi.org/10.1016/j.nedt.2016.06.008CrossRefGoogle ScholarPubMed
Brunzini, A., Papetti, A., Brandoni Serrani, E., Scafà, M., Germani, M. (2019), “How to Improve Medical Simulation Training: A New Methodology Based on Ergonomic Evaluation”, AHFE 2019, AISC 963, pp. 145–155. https://doi.org/10.1007/978-3-030-20135-7_14CrossRefGoogle Scholar
Dawson, S.L. and Kaufman, J.A. (1998) “The imperative for medical simulation”, Proceedings of the IEEE, Vol. 86 No. 3, pp. 479–483. https://dx.doi.org/10.1109/5.662872CrossRefGoogle Scholar
Elshama, S.S. (2020) “How to apply Simulation-Based Learning in Medical Education?”, IberoAmerican Journal of Medicine, Vol. 02, pp. 79–86. http://doi.org/10.5281/zenodo.3685233CrossRefGoogle Scholar
Garzón, J., Pavón, J. and Baldiris, S. (2017), “Augmented Reality Applications for Education: Five Directions for Future Research”, Lecture Notes in Computer Science, Vol. 10324, pp. 402–414. https://dx.doi.org/10.1007/978-3-319-60922-5_31CrossRefGoogle Scholar
Gerup, J., Soerensen, C.B. and Dieckmann, P. (2020), “Augmented reality and mixed reality for healthcare education beyond surgery: an integrative review”, International Journal of Medical Education, Vol. 11, pp. 1–18. https://dx.doi.org/10.5116/ijme.5e01.eb1aGoogle ScholarPubMed
Herron, J. (2016), “Augmented Reality in Medical Education and Training”, Journal of Electronic Resources in Medical Libraries, Vol. 13, pp. 51–55. https://doi.org/10.1080/15424065.2016.1175987CrossRefGoogle Scholar
Kobayashi, L., Zhang, X.C., Collins, S.A., Karim, N. and Merck, D.L. (2017), “Exploratory Application of Augmented Reality/Mixed Reality Devices for Acute Care Procedure Training”, West J Emerg Med, Vol.19 No.1, pp. 158–164. https://dx.doi.org/10.5811/westjem.2017.10.35026Google ScholarPubMed
Kotranza, A., Scott Lind, D. and Lok, B. (2012), “Real-Time Evaluation and Visualization of Learner Performance in a Mixed-Reality Environment for Clinical Breast Examination”, IEEE Trans Vis Comput Graph, Vol. 18 No. 7, pp. 1101–1114. https://dx.doi.org/10.1109/TVCG.2011.132CrossRefGoogle Scholar
Koziol, L.F. and Budding, D.E. (2012), “Procedural Learning”, Encyclopedia of the Sciences of Learning. https://doi.org/10.1007/978-1-4419-1428-6_670CrossRefGoogle Scholar
Linde, A.S. and Geoffrey, T.M. (2019), “Applications of Future Technologies to Detect Skill Decay and Improve Procedural Performance”, Military Medicine, Vol. 184, pp. 72–77.CrossRefGoogle ScholarPubMed
Margarido Mendes, H.C., Costa, C.I.A.B., da Silva, N.A., Leite, F.P., Esteves, A. and Lopes, D.S. (2020), “PIÑATA: Pinpoint insertion of intravenous needles via augmented reality training assistance”, Computerized Medical Imaging and Graphics, Vol. 82. https://doi.org/10.1016/j.compmedimag.2020.101731Google Scholar
Meola, A., Cutolo, F., Carbone, M., Cagnazzo, F., Ferrari, M. and Ferrari, V. (2017), “Augmented reality in neurosurgery: a systematic review”, Neurosurgical Review, Vol. 40, pp. 537–548. https://dx.doi.org/10.1007/s10143-016-0732-9CrossRefGoogle ScholarPubMed
Munzer, B.W., Khan, M.M., Shipman, B. and Mahajan, P. (2019), “Augmented Reality in Emergency Medicine: A Scoping Review”, Journal of Medical Internet Research, Vol. 21 No. 4. https://dx.doi.org/10.2196/12368CrossRefGoogle Scholar
Rochlen, L.R., Levine, R. and Tait, A.R. (2017), “First-Person Point-of-View-Augmented Reality for Central Line Insertion Training: A Usability and Feasibility Study”, Simulation in Healthcare, Vol. 12 No. 1, pp. 57–62. https://dx.doi.org/10.1097/SIH.0000000000000185CrossRefGoogle ScholarPubMed
Sherstyuk, A., Vincent, D., Berg, B. and Treskunov, A. (2011), “Mixed Reality Manikins for Medical Education” In: Furht, B. (eds) Handbook of Augmented Reality. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-0064-6_23Google Scholar
Seagull, F.J. (2012), “Human Factors Tools For Improving Simulation Activities In Continuing Medical Education”, Journal Of Continuing Education In The Health Professions, Vol. 32, pp. 261–268. https://dx.doi.org/10.1002/chp.21154CrossRefGoogle ScholarPubMed
WHO World Health Organization Data and Statistics [web] (2017) // Regional Office for Europe. http://www.euro.who.int/en/health-topics/Health-systems/patient-safety/data-and-statistics.Google Scholar
Zhu, E., Hadadgar, A., Masiello, I. and Zary, N. (2014), “Augmented reality in healthcare education: an integrative review” PeerJ, 2:e469. https://doi.org/10.7717/peerj.469CrossRefGoogle ScholarPubMed