Hostname: page-component-76fb5796d-25wd4 Total loading time: 0 Render date: 2024-04-26T07:54:40.378Z Has data issue: false hasContentIssue false

Intelligent Tutoring Systems: Re-Envisioning Surgical Education in Response to COVID-19

Published online by Cambridge University Press:  10 September 2020

Nykan Mirchi*
Affiliation:
Neurosurgical Simulation and Artificial Intelligence Learning Centre, Montreal Neurological Institute and Hospital, McGill University, Montreal, Quebec, Canada Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
Nicole Ledwos
Affiliation:
Neurosurgical Simulation and Artificial Intelligence Learning Centre, Montreal Neurological Institute and Hospital, McGill University, Montreal, Quebec, Canada
Rolando F. Del Maestro
Affiliation:
Neurosurgical Simulation and Artificial Intelligence Learning Centre, Montreal Neurological Institute and Hospital, McGill University, Montreal, Quebec, Canada
*
Correspondence to: Nykan Mirchi, 3801 University Street, Room E2.89, Montreal, Quebec, Canada, H3A 2B4. Email: nykan.mirchi@mail.mcgill.ca
Rights & Permissions [Opens in a new window]

Abstract

Type
Commentary
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
© The Author(s), 2020. Published by Cambridge University Press on behalf of The Canadian Journal of Neurological Sciences Inc.

COVID-19 has presented a series of unique challenges to surgical education. In the face of the global pandemic, access to traditional training techniques is limited. As health and safety have become top priorities, surgical residents have been reassigned to COVID units and most elective surgeries have been either postponed or cancelled. For surgical trainees, these reductions mean the loss of crucial learning opportunities to practice technical psychomotor skills. For residents in their ultimate or pen-ultimate years of residency who are soon to complete their final exams, this is a significant concern. While online resources for operative anatomy are available and training in emergency surgical cases continue, the reduction in elective cases presents an important problem for residents. Surgical educators are now faced with the challenge of ensuring their residents receive adequate training during this time. For both residents and surgical educators, it is impossible to predict how long this pandemic will last and what its effects on surgical training will be.

Advances in high-fidelity simulations provide residents with new opportunities to practice surgical skills and mitigate the challenges faced by current training paradigms including minimal access to standardized and objective feedback. These high-fidelity simulations were first extensively employed in the aviation industry, where trainees are required to practice and be examined on simulators before becoming accredited. However, the development and integration of virtual reality simulation in surgical education has been limited, especially in fields involving complex bimanual operative skills such as neurosurgery. This has resulted in a slow adoption of high-fidelity simulation technology paradigms for the assessment, training, and evaluation of trainees in some surgical fields.

The current global pandemic provides an opportunity to re-examine surgical education. Reference Tomlinson, Hendricks and Cohen-Gadol1 As many technical skills training programs are temporarily put on hold, residents as well as medical students are concerned about their ability to acquire the necessary skillsets to allow them to provide excellent care to their patients. Simulators can be used to help trainees become familiar with specific surgical procedures, analyze 3D anatomical structures, and practice technical skills in risk-free environments. Intelligent tutoring systems are automated teaching platforms capable of providing individualized performance feedback to learners using a variety of simulators. These systems, in combination with virtual reality simulators, allow important surgical training to continue even during a pandemic.

Intelligent tutoring systems integrated with virtual reality simulation allow operators to experience hyper-realistic tool interactions with the anatomical tissue. These systems can harvest the power of large datasets and utilize machine learning to automatically differentiate surgical expertise and provide feedback on operative performance. Reference Winkler-Schwartz, Yilmaz and Mirchi2Reference Mirchi, Bissonnette and Ledwos4 The Virtual Operative Assistant, an intelligent tutoring system powered by machine learning for neurosurgical simulation, discusses the limitations and challenges of this technology. Reference Mirchi, Bissonnette, Yilmaz, Ledwos, Winkler-Schwartz and Del Maestro5 By deconstructing psychomotor skills into teachable metrics, trainees can obtain personalized feedback on specific factors identified by algorithms which may improve performance.

An important factor when re-envisioning surgical education with automated teaching is how to accomplish a smooth integration of intelligent tutoring systems into current technical skills training. Dedicated learning centers could be incorporated within active hospital environments, allowing timely and easy access to learners interested in improving surgical psychomotor performance. Trainees could practice technical skills on the simulator to the level of mastery and obtain continuous feedback on performance in an iterative manner, with decreasing reliance on educator supervision. This learning-focused environment would provide trainees with an immersive and engaging way to practice and enhance their technical skills, all while practicing social distancing. A prototype for such a center is illustrated in Figure 1. We recognize that the cost associated with such a training center would not be insignificant. However, the value of their development and implementation need to be considered relative to the current toll of technical and procedural errors on patients and society. Reference Rolston, Zygourakis, Han, Lau, Berger and Parsa6 Mistakes in high-risk neurosurgical procedures also have high rates of medico-legal claims further increasing their impact on society. Reference Schaffer, Jena, Seabury, Singh, Chalasani and Kachalia7Reference Hamdan, Strachan, Nath and Coulter9 The potential that training in these specialized centers will aid in the understanding and prevention of surgical errors needs to be rigorously explored.

Figure 1: Prototype for a surgical simulation training center incorporating intelligent training systems. Trainees can practice a simulated procedure on the virtual reality platforms and obtain individualized feedback displayed on the monitor above each station. Simulators are arranged with sufficient space to maintain social distancing while limiting distraction. The figure was produced by Dr. Mostafa Sabbagh and Manal Al-Tahawi who have granted the co-authors permission of use.

The authors are not advocating for the replacement of the present educational paradigms by automated systems. We recognize that human interaction is vital to learning. Rather, we believe that the integration and the wider availability of intelligent tutoring systems may complement present curricula while minimizing the impact of events such as a pandemic on trainees’ skills development. Surgical education programs will have to adapt in order to smoothly integrate automated and in-person education pedagogy. Intelligent tutoring systems can utilize a variety of simulation platforms to provide almost unlimited opportunities for repetitive practice without constraints imposed by the availability of supervision. In these risk-free environments, numerous adaptable and clinically relevant simulations can be tailored to the needs of learners, consistent with best practices for simulation-based education. Reference Cook, Hamstra and Brydges10Reference Winkler-Schwartz, Marwa and Bajunaid12 These systems also increase the surgical educators’ armamentarium to help learners achieve mastery levels of surgical performance. Several studies are currently underway to compare the effectiveness of intelligent tutoring systems with more traditional formative teaching methods employed by surgical educators. The democratization of data accumulated from these simulation platforms is also important. Reference Reznick, Harris, Horsley and Hassani13 As simulators become more available across international training centers, it would be important to establish a centralized database of anonymized simulation data. This database should be accessible by research groups across the globe to develop more representative and generalizable models to power intelligent tutoring systems. As we navigate through these unprecedented times, the full impact of COVID-19 on surgical education programs is yet to be ascertained. With continued research, increased development, and dissemination of intelligent tutoring systems, we can be better prepared for ever-evolving future challenges.

Acknowledgements

We thank Dr. Recai Yilmaz, MD and Dr. Alexander Winkler-Schwartz, MD at the Neurosurgical Simulation and Artificial Intelligence Learning Centre at McGill University.

Funding

This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.

Disclosures

Nykan Mirchi, Nicole Ledwos and Dr. Rolando F. Del Maestro report a patent entitled “Methods and Systems for Generating a Training Platform” pending to Nykan Mirchi, Vincent Bissonnette, Nicole Ledwos, Recai Yilmaz, Alexander Winkler-Schwartz, Rolando F. Del Maestro.

Nykan Mirchi, Nicole Ledwos and Dr. Rolando F. Del Maestro report previous financial support from the AO Foundation, outside the submitted work. Miss Ledwos also reports financial support from Christian Gaeda Brain Tumour Research Studentship, outside the submitted work.

Dr. Rolando F. Del Maestro reports a grant from the Royal College of Physicians and Surgeons of Canada that has funded investigations related to AI and virtual reality.

Statement of Authorship

NM and RFD conceptualized the manuscript. NM and NL wrote the manuscript with input and feedback from all authors. RFD was in charge of the overall direction and planning.

References

Tomlinson, SB, Hendricks, BK, Cohen-Gadol, AA. Editorial. Innovations in neurosurgical education during the COVID-19 pandemic: is it time to reexamine our neurosurgical training models? J Neurosurg JNS. 2020;133:1271. doi: 10.3171/2020.4.JNS201012 Google Scholar
Winkler-Schwartz, A, Yilmaz, R, Mirchi, N, et al. Machine learning identification of surgical and operative factors associated with surgical expertise in virtual reality simulation. JAMA Netw Open. 2019;2(8):e198363. doi: 10.1001/jamanetworkopen.2019.8363 CrossRefGoogle ScholarPubMed
Bissonnette, V, Mirchi, N, Ledwos, N, Alsidieri, G, Winkler-Schwartz, A, Del Maestro, RF. Artificial intelligence distinguishes surgical training levels in a virtual reality spinal task. J Bone Jt Surg. 2019;101(23):e127. doi: 10.2106/jbjs.18.01197 CrossRefGoogle Scholar
Mirchi, N, Bissonnette, V, Ledwos, N, et al. Artificial neural networks to assess virtual reality anterior cervical discectomy performance. Oper Neurosurg. 2019;19(1):6575. doi: 10.1093/ons/opz359 CrossRefGoogle Scholar
Mirchi, N, Bissonnette, V, Yilmaz, R, Ledwos, N, Winkler-Schwartz, A, Del Maestro, RF. The virtual operative assistant: an explainable artificial intelligence tool for simulation-based training in surgery and medicine. PLoS One. 2020;15(2):e0229596. doi: 10.1371/journal.pone.0229596 CrossRefGoogle Scholar
Rolston, JD, Zygourakis, CC, Han, SJ, Lau, CY, Berger, MS, Parsa, AT. Medical errors in neurosurgery. Surg Neurol Int. 2014;5(Suppl 10):S435.CrossRefGoogle ScholarPubMed
Schaffer, AC, Jena, AB, Seabury, SA, Singh, H, Chalasani, V, Kachalia, A. Rates and characteristics of paid malpractice claims among US physicians by specialty, 1992-2014. JAMA Intern Med. 2017;177(5):710–8.CrossRefGoogle ScholarPubMed
Jena, AB, Seabury, S, Lakdawalla, D, Chandra, A. Malpractice risk according to physician specialty. N Engl J Med. 2011;365(7):629–36.CrossRefGoogle ScholarPubMed
Hamdan, A, Strachan, RD, Nath, F, Coulter, IC. Counting the cost of negligence in neurosurgery: lessons to be learned from 10 years of claims in the NHS. Br J Neurosurg. 2015;29(2):169–77.CrossRefGoogle ScholarPubMed
Cook, DA, Hamstra, SJ, Brydges, R, et al. Comparative effectiveness of instructional design features in simulation-based education: systematic review and meta-analysis. Med Teach. 2013;35(1):e86798. doi: 10.3109/0142159X.2012.714886 CrossRefGoogle ScholarPubMed
Winkler-Schwartz, A, Bissonnette, V, Mirchi, N, et al. Artificial intelligence in medical education: best practices using machine learning to assess surgical expertise in virtual reality simulation. J Surg Educ. 2019;76(6):1681–90. doi: 10.1016/j.jsurg.2019.05.015 CrossRefGoogle ScholarPubMed
Winkler-Schwartz, A, Marwa, I, Bajunaid, K, et al. A comparison of visual rating scales and simulated virtual reality metrics in neurosurgical training: a generalizability theory study. World Neurosurg. 2019;127:e2305. doi: 10.1016/j.wneu.2019.03.059 CrossRefGoogle ScholarPubMed
Reznick, RK, Harris, K, Horsley, T, Hassani, MS. Task force report on artificial intelligence and emerging digital technologies. R Coll Physicians Surg Canada. 2020;152.Google Scholar
Figure 0

Figure 1: Prototype for a surgical simulation training center incorporating intelligent training systems. Trainees can practice a simulated procedure on the virtual reality platforms and obtain individualized feedback displayed on the monitor above each station. Simulators are arranged with sufficient space to maintain social distancing while limiting distraction. The figure was produced by Dr. Mostafa Sabbagh and Manal Al-Tahawi who have granted the co-authors permission of use.