Skip to main content Accessibility help

We use cookies to distinguish you from other users and to provide you with a better experience on our websites. Close this message to accept cookies or find out how to manage your cookie settings.

Close cookie message
×
Hostname: page-component-76fb5796d-vfjqv Total loading time: 0 Render date: 2024-04-25T21:06:55.926Z Has data issue: false hasContentIssue false

42 - Multimedia Learning in Virtual and Mixed Reality

from Part VIII - Multimedia Learning with Media

Published online by Cambridge University Press:  19 November 2021

By
Jocelyn Parong
Edited by
Richard E. Mayer  and
Logan Fiorella
Richard E. Mayer
Affiliation:
University of California, Santa Barbara
Logan Fiorella
Affiliation:
University of Georgia
Get access

Summary

This chapter reviews media comparison research on the effects of various immersive technologies, including virtual reality and two types of mixed reality, augmented reality and augmented virtuality, on learning outcomes, as well as some boundary conditions for these effects. In sum, previous meta-analyses report that low immersion virtual reality (d = .22–.41) and low immersion augmented reality (d = .46–.68) improve learning outcomes compared to other instructional media, with small-to-medium-sized effects. However, high immersion virtual reality (median d = .10) and high immersion augmented reality (median d = .16) are less promising. Research on augmented virtuality is sparse, but shows positive effects on learning (median d = .45) based on a few studies. Theoretical implications of these immersive technologies regarding cognitive frameworks, as well as their practical implications on the future of technology in the classroom, are discussed.

Keywords

virtual realityaugmented realitymixed realitymedia comparison researchaugmented virtuality
Type
Chapter
Information
The Cambridge Handbook of Multimedia Learning , pp. 498 - 509
Publisher: Cambridge University Press
Print publication year: 2021

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Anthes, C., García-Hernández, R. J., Wiedemann, M., & Kranzlmüller, D. (2016). State of the art of virtual reality technology. IEEE Aerospace Conference Proceedings, 2016, 1–19.CrossRefGoogle Scholar
Avcı, Ş. K., Çoklar, A. N., & İstanbullu, A. (2019). The effect of three dimensional virtual environments and augmented reality applications on the learning achievement: A meta-analysis study. Education and Science, 44(198), 149–182.Google Scholar
Azuma, R. T. (1997). A survey of augmented reality. Presence, 6(4), 355–385.Google Scholar
Birchfield, D., & Megowan-Romanowicz, C. (2009). Earth science learning in SMALLab: A design experiment for mixed-reality. Journal of Computer Supported Collaborative Learning, 4, 403–421.Google Scholar
Carrera, J. F., Wang, C. C., Clark, W., & Southerland, A. M. (2019). A systematic review of the use of google glass in graduate medial education. Journal of Graduate Medical Education, 11(6), 637–648.Google Scholar
Checa, D., & Bustillo, A. (2020). A review of immersive virtual reality serious games to enhance learning and training. Multimedia Tools and Applications, 79, 5501–5527.CrossRefGoogle Scholar
Chen, C. Zhang, L., Luczak, T., Smith, E., & Burch, R. F. (2019). Using Microsoft HoloLens to improve memory recall in anatomy and physiology: A pilot study to examine the efficacy of using augmented reality in education. Journal of Educational Technology Development and Exchange, 12(1), 17–31.Google Scholar
Clark, R. E. (1983). Reconsidering research on learning from media. Review of Educational Research, 53(4), 445–459.Google Scholar
Clark, R. E. (1994). Media will never influence learning. Educational Technology Research and Development, 42(1), 21–29.Google Scholar
Concannon, B. J., Esmail, S., & Roberts, M. R. (2019). Head-mounted display virtual reality in post-secondary education and skill training. Frontiers in Education, 4(80), 1–23.Google Scholar
Cummings, J. J., & Bailenson, J. N. (2016). How immersive is enough? A meta-analysis of the effect of immersive technology on user presence. Media Psychology, 19(2), 272–309.Google Scholar
Dede, C. (2009). Immersive interfaces for engagement and learning. Science, 323, 66–69.CrossRefGoogle ScholarPubMed
Dolgunsöz, E., Yildirim, G., & Yildirim, S. (2018). The effect of virtual reality on EFL writing performance. Journal of Language and Linguistic Studies, 14(1), 278–292.Google Scholar
Ekstrand, C., Jamal, A., Nguyen, R., Kudryk, A., Mann, J., & Mendez, I. (2018). Immersive and interactive virtual reality to improve learning and retention of neuroanatomy in medical students: A randomized controlled study. CMAJ Open, 6(1), E103–E109.Google Scholar
Freina, L., & Ott, M. (2015). A literature review on immersive virtual reality in education: State of the art and perspectives. Proceedings of eLearning and Software for Education (eLSE), 1, 133–141.Google Scholar
Garzón, J., & Acevedo, J. (2019). Meta-analysis of the impact of augmented reality on students’ learning gains. Educational Research Review, 27, 244–260.Google Scholar
Halabi, O. (2020). Immersive virtual reality to enforce teaching in engineering education. Multimedia Tools and Applications, 79, 2987–3004.Google Scholar
Innocenti, E. D., Geronazzo, M., Vescovi, D., Nordahl, R., Serafin, S., Ludovico, A., & Avanzini, F. (2019). Mobile virtual reality for musical genre learning in primary education. Computers & Education, 139, 102–117.Google Scholar
Jensen, L., & Konradsen, F. (2018). A review of the use of virtual reality head-mounted displays in education and training. Education and Information Technologies, 23, 1515–1529.Google Scholar
Johnson-Glenberg, M. C., Birchfield, D., Tolentino, L., & Koziupa, T. (2014). Collaborative embodied learning in mixed reality motion-capture environments: Two science studies. Journal of Educational Psychology, 106(1), 86–104.Google Scholar
Kaplan, A. D., Cruit, J., Endsley, M., Beers, S. M., Sawyer, B. D., & Hancock, P. A. (2020). The effects of virtual reality, augmented reality, and mixed reality as training enhancements: A meta-analysis. Human Factors. Advance online publication. https://doi.org/10.1177/0018720820904229Google Scholar
Kavanagh, S., Luxton-Reilly, A., Wuensche, B., & Plimmer, B. (2017). A systematic review of virtual reality in education. Themes in Science and Technology Education, 10(2), 85–119.Google Scholar
Kim, Y. M., Rhiu, I., & Yun, M. H. (2019). A systematic review of virtual reality system from the perspective of user experience. International Journal of Human–Computer Interaction, 36, 893–910.Google Scholar
Kozhevnikov, M., Gurlitt, J., & Kozhevnikov, . (2013). Learning relative motion concepts in immersive and non-immersive virtual environments. Journal of Science Education and Technology, 22(6), 952–962.CrossRefGoogle Scholar
Kozma, R. B. (1991). Learning with media. Review of Educational Research, 61(2), 179–211.CrossRefGoogle Scholar
Kozma, R. B. (1994). Will media influence learning? Reframing the debate. Educational Technology Research & Development, 42(2), 7–19.Google Scholar
Kuhn, J., Lukowicz, P., Hirth, M., Poxrucker, A., Weppner, J., & Younas, J. (2016). gPhysics – Using smart glasses for head-centered, context-aware learning in physics experiments. IEEE Transactions on Learning Technologies, 9(4), 304–317.Google Scholar
Limniou, M., Roberts, D., & Papadopoulos, N. (2008). Full immersive virtual environment CAVETM in chemistry education. Computers & Education, 51, 584–593.CrossRefGoogle Scholar
Lindgren, R., Tscholl, M., Wang, S., & Johnson, E. (2016). Enhancing learning and engagement through embodied interaction within a mixed reality simulation. Computers & Education, 95, 174–187.Google Scholar
Maas, M. J., & Hughes, M. (2020). Virtual, augmented, and mixed-reality in K-12 education: A review of the literature. Technology, Pedagogy, and Education, 29(2), 231–249.CrossRefGoogle Scholar
Makransky, G., Andreasen, N. K., Baceviciute, S., & Mayer, R. E. (2020). Immersive virtual reality increases liking but not learning with a science simulation and generative learning strategies promote learning in immersive virtual reality. Journal of Educational Psychology. Advance online publication. https://doi.org/10.1037/edu0000473Google Scholar
Makransky, G., Borre-Gude, S., & Mayer, R. E. (2019). Motivational and cognitive benefits of training in immersive virtual reality based on multiple assessments. Journal of Computer Assisted Learning, 35(6), 691–707.CrossRefGoogle Scholar
Makransky, D., Terkildsen, T. S., & Mayer, R. E. (2017). Adding immersive virtual reality to a science lab simulation causes more presence but less learning. Learning and Instruction, 60, 225–236.Google Scholar
Mann, S., Havens, J. C., Iorio, J., Yuan, Y., & Furness, T. (2018). All reality: Virtual, augmented, mixed (X), mediated (X, Y), and multimediated reality. In 2018 Augmented World Expo, May 30–June 1, 2018. Santa Clara, CA.Google Scholar
Maresky, H. S., Oikonomou, A., Ali, I., Ditkofsky, N., Pakkal, M., & Ballyk, B. (2018). Virtual reality and cardiac anatomy: Exploring immersive three-dimensional cardiac imaging, a pilot study in undergraduate medical anatomy education. Clinical Anatomy, 32, 238–243.Google Scholar
Mayer, R. E. (2014). Media comparison approach: Are games more effective than conventional media? In Mayer, R. E. (ed.), Computer Games for Learning: An Evidence-Based Approach (pp. 225–249). Cambridge, MA: The MIT Press.Google Scholar
Merchant, Z., Goetz, E. T., Cifuentes, L., Keeney-Kennicutt, W., & Davis, T. J. (2014). Effectiveness of virtual reality-based instruction on students’ learning outcomes in K-12 and higher education: A meta-analysis. Computers & Education, 70, 29–40.Google Scholar
Meyer, O. A., Omdahl, M. K., & Makransky, G. (2019). Investigating the effect of pre-training when learning through immersive virtual reality and video: A media and methods experiment. Computers & Education, 140, 1–17.Google Scholar
Milgram, P., & Kishino, F. (1994). A taxonomy of mixed reality visual displays. IEEE Transactions on Information Systems, 77(12), 1321–1329.Google Scholar
Moreno, R., & Mayer, R. E. (2002). Learning science in virtual reality multimedia environments: Role of methods and media. Journal of Educational Psychology, 94(2), 598–610.CrossRefGoogle Scholar
Moreno, R., & Mayer, R. E. (2004). Personalized messages that promote science Learning in virtual environments. Journal of Educational Psychology, 96(1), 165–173.Google Scholar
Muhanna, M. A. (2015). Virtual reality and the CAVE: Taxonomy, interaction challenges and research directions. Journal of King Saud University – Computer and Information Sciences, 27, 344–361.Google Scholar
Nilsson, N. C., Nordhal, R., & Serafin, S. (2016). Immersion revisited: A review of existing definitions of immersion and their relation to different theories of presence. Human Technology, 12(2), 108–134.Google Scholar
Ozdemir, M., Sahin, C., Arcagok, S., & Demir, M. K. (2018). The effect of augmented reality applications in the learning process: A meta-analysis study. Eurasian Journal of Educational Research, 74, 165–186.Google Scholar
Parong, J., & Mayer, R. E. (2018). Learning science in immersive virtual reality. Journal of Educational Psychology, 110(6), 785–797.Google Scholar
Parong, J., & Mayer, R. E. (2020). Cognitive and affective processes for learning science in immersive virtual reality. Journal of Computer Assisted Learning, 37, 226–241.Google Scholar
Pennefather, P., Krebs, C. (2019). Exploring the role of xR in visualisations for use in medical education. In Rea, P. (ed.), Biomedical Visualisation. Advances in Experimental Medicine and Biology (Vol. 1171, pp. 15–24). Cham: Springer.Google Scholar
Radianti, J., Majchrzak, T. A., Fromm, J., & Wohlgenannt, I. (2020). A systematic review of immersive virtual reality applications for higher education: Design elements, lessons learned, and research agenda. Computers & Education, 147, 103778.Google Scholar
Ren, S., McKenzie, F. D., Chaturvedi, S. K., Prabhakaran, R., Yoon, J., Katisioloudis, P. J., & Garcia, H. (2015). Design and comparison of immersive interactive learning and instructional techniques of 3D virtual laboratories. Presence, 24(2), 93–112.Google Scholar
Selzer, M. N., Gazcon, N. F., & Larrea, M. L. (2019). Effects of virtual presence and learning outcome using low-end virtual reality systems. Displays, 59, 9–15.CrossRefGoogle Scholar
Shi, A., Wang, Y., & Ding, N. (2019). The effect of game-based immersive virtual reality learning environment on learning outcomes: Designing an intrinsic integrated educational game for pre-class learning. Interactive Learning Environments. Advance online publication. https://doi.org/10.1080/10494820.2019.1681467Google Scholar
Sitzmann, T. (2011). A meta-analytic examination of the instructional effectiveness of computer-based simulation games. Personnel Psychology, 64, 489–528.Google Scholar
Slater, M. (2009). Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments. Philosophical transactions of the Royal Society of London. Series B, Biological Sciences, 364(1535), 3549–3557.CrossRefGoogle ScholarPubMed
Slater, M., & Sanchez-Vives, M. V. (2016). Enhancing out lives with immersive virtual reality. Frontiers in Robotics and AI, 3(74), 1–47.Google Scholar
Smith, S. J., Farra, S. L., Ulrich, D. L., Hodgson, E., Nicely, S., & Mickle, A. (2018). Effectiveness of two varying levels of virtual reality simulation. Nursing Education Perspectives, 39, E10–E15.Google Scholar
Starkey, E. M., Spencer, C., Lesniak, K., Tucker, C., & Miller, S. R. (2017). Do technological advancements lead to learning enhancements? An exploration in virtual product dissection. Paper Presented at the ASME 2017 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, Cleveland, OH.Google Scholar
Stepan, K., Zeiger, J., Hanchuk, S., Del Signore, A., Shrivastava, R., Govindaraj, S., & Iloreta, A. (2017). Immersive virtual reality as a teaching tool for neuroanatomy. International Forum of Allergy & Rhinology, 7(10), 1006–1013.Google Scholar
Strzys, M. P., Kapp, S., Thees, M., Klein, P., Lukowicz, P., Knierim, P., Schmidt, A., & Kuhn, J. (2018). Physics holo.lab learning experience: Using smartglasses for augmented reality labwork to foster the concepts of heat condution. European Journal of Physics, 39, 1–12.Google Scholar
Tai, T.-Y., Chen, H. H.-J., & Todd, G. (2020). The impact of a virtual reality app on adolescent efl learners’ vocabulary learning. Computer Assisted Language Learning. Advance online publication. https://doi/org/10.1080/09588221.2020.1752735Google Scholar
Tang, Y. M., Au, K. M., Lau, H. C. W., Ho, G. T. S., & Wu, C. H. (2020). Evaluating the effectiveness of learning design with mixed reality (MR) in higher education. Virtual Reality, 24, 797–807.CrossRefGoogle Scholar
Tekedere, H., & Göke, H. (2016). Examining the effectiveness of augmented reality applications in education: A meta-analysis. International Journal of Environmental and Science Education, 11(16), 9469–9481.Google Scholar
The Body VR. (2016). The Body VR: Journey into the Cell [Computer software]. The Body VR.Google Scholar
Thees, M., Kapp, S., Strzys, M. P., Beil, F., & Lukowicz, P. (2020). Effects of augmented reality on learning and cognitive load in university laboratory courses. Computers in Human Behavior, 108, 106316.Google Scholar
Tolentino, L., Birchfield, D., Megowan-Romanowicz, C., Johnson- Glenberg, M. C., Kelliher, A., & Martinez, C. (2009). Teaching and learning in the mixed-reality science classroom. Journal of Science Education and Technology, 18, 501–517.Google Scholar
Visible Body. (2017). Human Anatomy Atlas [Mobile application]. Visible Body.Google Scholar
Webster, R. (2016). Declarative knowledge acquisition in immersive virtual learning environments. Interactive Learning Environments, 24(6), 1319–1333.Google Scholar
Winn, W., Windschitl, M., Fruland, R., & Lee, Y. (2002). When does immersion in a virtual environment help students construct understanding? In Proceedings of the International Conference of Learning Societies, October 23–26, 2002. Seattle, WA. pp. 497–503.Google Scholar
Yu, S.-J., Sun, J. C.-Y., & Chen, O. T.-C. (2019). Effect of AR-based online wearable guides on university students’ situational interest and learning performance. Universal Access in the Information Society, 18, 287–299.Google Scholar
Zhu, B., Feng, M., Lowe, H., Kesselman, J., Harrison, L., & Dempski, R. E. (2018). Increasing enthusiasm and enhancing learning for biochemistry-laboratory safety with an augmented reality program. Journal of Chemical Education, 95, 1747–1753.Google Scholar
Zinchenko, Y. P., Khoroshikh, P. P., Sergievich, A. A., Smirnov, A. S., Tumyalis, A. V., Kovalev, A. I., Gutnikov, S. A., & Golokhvast, K. S. (2020). Virtual reality is more efficient in learning human heart anatomy especially for subjects with ow baseline knowledge. New Ideas in Psychology, 59, 100786.CrossRefGoogle Scholar

Save book to Kindle

To save this book to your Kindle, first ensure coreplatform@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×