Hostname: page-component-8448b6f56d-c4f8m Total loading time: 0 Render date: 2024-04-19T20:46:47.558Z Has data issue: false hasContentIssue false
  • English
  • Français

An overview of augmented and virtual reality applications in radiotherapy and future developments enabled by modern tablet devices

Published online by Cambridge University Press:  15 August 2013

F. Cosentino ,
N. W. John  and
J. Vaarkamp
F. Cosentino*
Affiliation:
Medical Physics Department, North Wales Cancer Treatment Centre, Betsi Cadwaladr University Health Board, Bodelwyddan, UK
N. W. John
Affiliation:
School of Computer Science, Bangor University, Bangor, UK
J. Vaarkamp
Affiliation:
Medical Physics Department, North Wales Cancer Treatment Centre, Betsi Cadwaladr University Health Board, Bodelwyddan, UK
*
Correspondence to: F Cosentino, North Wales Cancer Treatment Centre, Medical Physics Department, Glan Clwyd Hospital, Bodelwyddan LL18 5UJ, UK. Tel: ++ 44 (0)1745 445113. E-mail: Francesco.Cosentino@Wales.NHS.uk
Get access Rights & Permissions [Opens in a new window]

Abstract

Purpose

We review augmented (AR) and virtual reality (VR) applications in radiotherapy as found in the scientific literature and highlight future developments enabled by the use of small mass-produced devices and portability of techniques developed in other fields to radiotherapy.

Analysis

The application of AR and VR within radiotherapy is still in its infancy, with the notable exception of training and teaching applications. The relatively high cost of equipment needed to generate a realistic 3D effect seems one factor that has slowed down its use, but also the sheer amount of image data is relatively recent, were radiotherapy professionals are only beginning to explore how to use this to its full potential. This increased availability of 3D data in radiotherapy will drive the application of AR and VR in radiotherapy to efficiently recognise and extract key features in the data to act on in clinical decision making.

Conclusion

The development of small mass-produced tablet devices coming on the market will allow the user to interact with computer-generated information more easily, facilitating the application of AR and VR. The increased connectivity enabling virtual presence of remote multidisciplinary team meetings heralds significant changes to how radiotherapy professionals will work, to the benefit of our patients.

Keywords

augmented realityIGRTimage guided radiotherapyimagingnew techniquesvirtual realityvisualisation
Type
Literature Reviews
Information
Journal of Radiotherapy in Practice , Volume 13 , Issue 3 , September 2014 , pp. 350 - 364
Copyright
Copyright © Cambridge University Press 2013 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

1.Vidal, F P, Bello, F, Brodlie, K Wet al. Principles and applications of computer graphics in medicine. Computer Graphics Forum 2006; 25 (1): 113–137.Google Scholar
2.Beavis, A W, Page, L, Phillips, R, Ward, J. VERT: Virtual Environment for Radiotherapy Training. Conference: World Congress on Medical Physics and Biomedical Engineering, 2009; 25 (12): 236–238.Google Scholar
3.Appleyard, R, Coleman, L. Early experiences of the Virtual Environment for Radiotherapy Training (VERT) initiative and the potential to extend its use to other professional groups. Clin Oncol (R Coll Radiol) 2009; 21 (3): 240–241.Google Scholar
4.Hubbold, R J, Hancock, D J, Moore, C J. Autostereoscopic display for radiotherapy planning. Stereoscopic Displays and Virtual Reality Systems IV. Proceedings of the Society of Photo-Optical Instrumentation Engineers (SPIE), 3012, pp. 16–27. San Jose, CA, 1997.CrossRefGoogle Scholar
5.Schlaefer, A, Blanck, O, Schweikard, A. Autostereoscopic display of the 3D dose distribution to assess beam placement for robotic radiosurgery. Med Phys 2005; 32 (6): 2122.Google Scholar
6.Schroeder, W, Martin, K, Lorensen, B. Visualization Toolkit: An Object-Oriented Approach to 3D Graphics, 4th edition. Kitware, 2006.Google Scholar
7.Shang, C, Williams, T, Beavis, A, Ward, J, Sims, C, Phillips, R. Can current prostate IMRT be further improved with immersive virtual reality simulation? Med Phys 2006; 33 (6): 2075.Google Scholar
8.Gong, X, Kirk, M, Zusag, Tet al. Holographic image guided radiation therapy (HIGRT) treatment planning: a multi-institutional study [Abstract]. Int J Radiat Oncol Biol Phys 2006; 66 (3): 6664–6665.Google Scholar
9.Chu, J, Gong, X, Cai, Cet al. Multi-institutional randomized study to evaluate a holographic display device for treatment planning. Int J Radiat Oncol Biol Phys 2007; 69 (3, Suppl 1), S698–S698.Google Scholar
10.Chu, J, Zhang, Y, Yurkewicz, K. 3D display of treatment planning and anatomy data: initial observation using a promising technical advance. World Congress on Medical Physics and Biomedical Engineering. IFMBE Proceedings, 14, 1844–1847, 2007.CrossRefGoogle Scholar
11.Gong, X, Kirk, M, Zusag, Tet al. Application of a 3D volumetric display for radiation therapy treatment planning I: quality assurance procedures. J Appl Clin Med Phys 2009; 10 (3): 96–114.Google Scholar
12.Chu, J, Gong, X, Cai, Yet al. Application of holographic display in radiotherapy treatment planning II: a multi-institutional study. J Appl Clin Med Phys 2009; 10 (3): 115–124.Google Scholar
13.Patel, D, Muren, L P, Mehus, A, Kvinnsland, Y, Ulvang, D M, Villanger, K P. A virtual reality solution for evaluation of radiotherapy plans. Radiother Oncol 2007; 82 (2): 218–221.Google Scholar
14.Butler, E, Teh, B S, Bell, Bet al. Stereoscopic visualization of treatment plans. Int J Radiat Oncol Biol Phys 2008; 72 (1): S423.Google Scholar
15.Deutschmann, H, Steininger, P, Nairz, O, Kopp, P, Merz, F, Wurstbauer, K. ‘Augmented Reality’ in conventional simulation by projection of 3-D structures into 2-D images. Strahlentherapie und Onkologie 2008; 2: 93–99.Google Scholar
16.Talbot, J, Meyer, J, Watts, R, Grasset, R. A method for patient set-up guidance in radiotherapy using augmented reality. Australasian Physical and Engineering Sciences in Medicine 2009; 32 (4): 201–211.CrossRefGoogle ScholarPubMed
17.Santhanam, A P, Willoughby, T R, Kaya, Iet al. A display framework for visualizing real-time 3D lung tumor radiotherapy. J Display Tech 2008; 4 (4): 473–482.Google Scholar
18.Wang, C-Y, Lee, T-F, Fang, C-H. A volume visualization system with augmented reality interaction for evaluation of radiotherapy plans. Proceedings of the 2009 Fourth International Conference on Innovative Computing, Information and Control, 433–436, 2009.Google Scholar
19. ITK – Segmentation & Registration Toolkit. http://www.itk.org/. Accessed 5th January 2013.Google Scholar
20.Chen, Y, Chang, W, Liu, C, Chen, C. Integration of multidisciplinary technologies for remote-controlled, dynamic tracking, and real-time target verification for conformal radiotherapy: a prototype of target visualization system. Int J Radiat Oncol Biol Phys 2011; 81 (1): S1, S771.Google Scholar
21.Accuray press release. Accuray rolls out PlanTouch for the CyberKnife System. 2012 http://www.accuray.com/media/press-releases/accuray-rolls-out-plantouch-cyberknife-system/. Accessed 5th January 2013.Google Scholar
22.Butler, E. The use of interactive, real-time, three-dimensional (3D) volumetric visualization for image guided assistance in the brachytherapy needle placement for advanced gynaecological malignancies. Int J Radiat Oncol Biol Phys 2011; 81 (2): S1, S482–S483.Google Scholar
23.Nakata, N, Suzuki, N, Hattori, A, Hirai, N, Miyamoto, Y, Fukuda, K. Informatics in radiology: intuitive user interface for 3D image manipulation using augmented reality and a smartphone as a remote control. Radiographics 2012; 25 (1): 273–283.CrossRefGoogle Scholar
24. ARToolKit. http://www.hitl.washington.edu/artoolkit/. Accessed 5th January 2013.Google Scholar
25. OsiriX DICOM Viewer. http://www.osirix-viewer.com/. Accessed 5th January 2013.Google Scholar
26.Marra, I, Gallo, L, De Pietro, G. 3D interaction with volumetric medical data: experiencing the Wiimote. Ambi-Sys’ 08: Proceedings of the 1st International Conference on Ambient Media and Systems (pp. 1–6). Brussels, Belgium: ICST, 2008.Google Scholar
27.Gallo, L, Minutolo, A, De Pietro, G. A user interface for VR-ready 3D medical imaging by off-the-shelf input devices. Comput Biol Med 2010; 40: 350–358.CrossRefGoogle ScholarPubMed
28. MITO – DICOM Viewer. http://sourceforge.net/projects/mito/. Accessed 5th January 2013.Google Scholar
29.Mitchell, P, Wilkinson, I D, Griffiths, P D, Linsley, K, Jakubowski, J. A stereoscope for image-guided surgery. Brit J Neurosurg 2002; 16 (3): 261–266.Google Scholar
30.Liao, H, Ishihara, H, Tran, H H, Masamune, K, Sakuma, I, Dohi, T. Precision-guided surgical navigation system using laser guidance and 3D autostereoscopic image overlay. Comput Med Imag Grap 2010; 34: 46–54.Google Scholar
31.International Commission on Radiation Units and Measurements. (1999) Prescribing, Recording and Reporting Photon Beam Therapy (Supplement to ICRU Report 50). ICRU Report 62. (International Commission on Radiation Units and Measurements, Bethesda, MD).Google Scholar
32.Tomikawa, M, Hong, J, Shiotani, Set al. Real-time 3-dimensional virtual reality navigation system with open MRI for breast-conserving surgery. JACS 2010; 210 (6): 927–933.Google Scholar
33.Kim, S, Hong, J, Joung, Set al. Dual surgical navigation using augmented and virtual environment techniques. Int J Optomechatronics 2011; 5 (2): 155–169.Google Scholar
34.Gavaghan, K, Oliveira-Santos, T, Peterhans, Met al. Evaluation of a portable image overlay projector for the visualisation of surgical navigation data: phantom studies. Int J CARS 2012; 7: 547–556.Google Scholar
35.Low, D, Lee, C K, Dip, L L T, Ng, W H, Ang, B T, Ng, I. Augmented reality neurosurgical planning and navigation for surgical excision of parasagittal, falcine and convexity meningiomas. Brit J Neurosurg 2010; 24 (1): 69–74.Google Scholar
36. HITLabNZ—CityViewAR. http://www.hitlabnz.org/index.php/products/cityviewar. Accessed 5th January 2013.Google Scholar
37. String Augmented Reality. http://www.poweredbystring.com/product. Accessed 5th January 2013.Google Scholar