Skip to main content Accessibility help
  • Get access
    Check if you have access via personal or institutional login
  • Cited by 2
  • Print publication year: 2014
  • Online publication date: August 2014

29 - Multimedia Learning with Intelligent Tutoring Systems

from Part V - Multimedia Learning in Advanced Computer-Based Contexts



Intelligent tutoring systems (ITS) are a form of computer training that attempt to simulate both human tutors and ideal tutoring strategies. Learning gains from ITS environments have been promising, showing 0.4–1.1 standard deviations of improvement in learning over traditional instruction and the reading of texts. These systems show advantages in learning over conventional computer-based instruction, which in turn show improvements over the presentation of static material. This chapter reviews highlights of these ITS advances, particularly from the perspective of multimedia. Different types of multimedia have been integrated with these tutoring systems, including materials in multiple modalities, animation, interactive simulation, and conversational agents. The chapter identifies forms of multimedia implemented in tutoring systems driven by problem solving, simulations, natural language, games, and embodied interaction. Although these types of ITS routinely incorporate various multimedia, there is not a large body of research that assesses the incremental impact of particular multimedia features on learning or that segregates the contributions of the multimedia per se versus the intelligent mechanisms of ITS. Available evidence suggests that the conceptual content that is adaptively presented and interactively experienced by the student is more important than the type of media that presents the content. It is important to align media to the knowledge, skills, and strategies targeted by ITS and to resist media features that add irrelevant activities that distract from the serious educational content. More research is needed to determine how feedback, interactivity, attention focus features, hints, and other intelligent scaffolding are optimally coordinated with multimedia.


Adams, D. M., Mayer, R. E., MacNamara, A., Koenig, A., & Wainess, R. (2012). Narrative games for learning: Testing the discovery and narrative hypotheses. Journal of Educational Psychology, 104(1), 235–239
Ainsworth, S. (2008). How do animations influence learning? In D. Robinson & G. Schraw (Eds.), Current perspectives on cognition, learning, and instruction: Recent innovations in educational technology that facilitate student learning (pp 37–67). Charlotte, NC: Information Age.
Aleven, V., McLaren, B. M., Sewall, J., & Koedinger, K. R. (2009). A new paradigm for intelligent tutoring systems: Example-tracing tutors. International Journal of Artificial Intelligence in Education, 19(2), 105–154.
Aleven, V., Stahl, E., Schworm, S., Fischer, F., & Wallace, R. (2003). Help seeking and help design in interactive learning environments. Review of Educational Research, 73(3), 277–320.
Anderson, J. R., Corbett, A. T., Koedinger, K. R., & Pelletier, R. (1995). Cognitive tutors: Lessons learned. Journal of the Learning Sciences, 4(2), 167–207.
Anderson, J. R., & Gluck, K. (2001). What role do cognitive architectures play in intelligent tutoring systems? In D. Klahr & S. M. Carver (Eds.), Cognition & instruction: Twenty-five years of progress (pp. 227–262). Hillsdale, NJ: Lawrence Erlbaum.
Arroyo, I., Royer, J. M., & Woolf, B. P. (2011). Using an intelligent tutor and math fluency training to improve math performance. International Journal of Artificial Intelligence in Education, 21(1), 135–152.
Azevedo, R., et al.(2012). The effectiveness of pedagogical agents’ prompting and feedback in facilitating co-adapted learning with MetaTutor. In S. A. Cerri, & B. Clancey (Eds.), Proceedings of Intelligent Tutoring Systems (ITS) 2012 (pp. 256–261). Berlin: Springer.
Baker, R. S., Corbett, A. T., Roll, I., & Koedinger, K.R. (2008) Developing a generalizable detector of when students game the system. User Modeling and User-Adapted Interaction, 18(3), 287–314.
Baker, R. S., D’Mello, S. K., Rodrigo, M. T., & Graesser, A.C. (2010). Better to be frustrated than bored: The incidence, persistence, and impact of learners’ cognitive-affective states during interactions with three different computer-based learning environments. International Journal of Human-Computer Studies, 68(2), 223–241.
Baker, R. S., Goldstein, A. B., & Heffernan, N. T. (2011). Detecting learning moment-by-moment. International Journal of Artificial Intelligence in Education, 21(1), 5–25.
Bickmore, T., Schulman, D., & Vardoulakis, L. (in press). Tinker: A relational agent museum guide. Autonomous Agents and Multi-Agent Systems.
Biswas, G., Jeong, H., Kinnebrew, J., Sulcer, B., & Roscoe, R. (2010). Measuring self-regulated learning skills through social interactions in a teachable agent environment. Research and Practice in Technology-Enhanced Learning, 5(02), 123–152.
Clark, R. C., & Mayer, R. E. (2003). e-Learning and the science of instruction: Proven guidelines for consumers and designers of multimedia learning. San Francisco: Jossey-Bass.
D’Mello, S. K., Dowell, N., & Graesser, A. (2011). Does it really matter whether students’ contributions are spoken versus typed in an intelligent tutoring system with natural language? Journal of Experimental Psychology – Applied, 17 (1), 1–17.
D’Mello, S. K., & Graesser, A. C. (2012). Dynamics of affective states during complex learning. Learning and Instruction, 22(2), 145–157.
D’Mello, S. K., Lehman, B., Pekrun, R., & Graesser, A.C. (in press). Confusion can be beneficial for learning. Learning and Instruction.
D’Mello, S. K., Olney, A., Williams, C., & Hays, P. (2012). Gaze tutor: A gaze-reactive intelligent tutoring system. International Journal of Human-Computer Studies, 70(5), 377–398.
Dodds, P., & Fletcher, J. D. (2004). Opportunities for new “smart” learning environments enabled by next-generation web capabilities. Journal of Educational Multimedia and Hypermedia, 13(4), 391–404.
Fournier-Viger, P., Nkambou, R., & Mayers, A. (2008). Evaluating spatial representations and skills in a simulator-based tutoring system. IEEE Transactions on Learning Technologies, 1(1), 63–74.
Gong, Y., Beck, J. E., Heffernan, N. T., & Forbes-Summers, E. (2010). The fine-grained impact of gaming (?) on learning. In V. Aleven, J. Kay, & J. Mostow (Eds.), Proceedings of Intelligent Tutoring Systems (ITS) 2010 (pp. 194–203). Berlin: Springer.
Graesser, A. C., Chipman, P., Haynes, B., & Olney, A. (2005). AutoTutor: An intelligent tutoring system with mixed-initiative dialogue. IEEE Transactions on Education, 48(4), 612–618.
Graesser, A. C., Conley, M. W., & Olney, A. (2012). Intelligent tutoring systems. In K. R. Harris, S. Graham, T. Urdan, A. G. Bus, S. Major, & H. L. Swanson (Eds.), APA educational psychology handbook, vol. 3: Application to learning and teaching (pp. 451–473). Washington, DC: American Psychology Association.
Graesser, A. C., D’Mello, S. K., Hu, X., Cai, Z., Olney, A., & Morgan, B. (2012). AutoTutor. In P. McCarthy and C. Boonthum-Denecke (Eds.), Applied natural language processing: Identification, investigation, and resolution (pp. 169–187). Hershey, PA: IGI Global.
Graesser, A. C., Jeon, M., & Dufty, D. (2008). Agent technologies designed to facilitate interactive knowledge construction. Discourse Processes, 45(4–5), 298–322.
Graesser, A. C., Lu, S., Jackson, G. T., Mitchell, H. H., Ventura, M., Olney, A., & Louwerse, M. M. (2004). AutoTutor: A tutor with dialogue in natural language. Behavior Research Methods, Instruments, and Computers, 36(2), 180–192.
Graesser, A. C., McNamara, D. S., & VanLehn, K. (2005). Scaffolding deep comprehension strategies through Point&Query, AutoTutor, and iSTART. Educational Psychologist, 40(4), 225–234.
Graesser, A. C., Moreno, K., Marineau, J., Adcock, A., Olney, A., & Person, N. (2003). AutoTutor improves deep learning of computer literacy: Is it the dialog or the talking head? In U. Hoppe, F. Verdejo, & J. Kay (Eds.), Proceedings of Artificial Intelligence in Education (AIED) 2003 (pp. 47–54). Amsterdam: IOS Press.
Graesser, A. C., & Person, N. K. (1994). Question asking during tutoring. American Educational Research Journal, 31(1), 104–137.
Halpern, D. F., Millis, K., Graesser, A. C., Butler, H., Forsyth, C., & Cai, Z. (2012). Operation ARA: A computerized learning game that teaches critical thinking and scientific reasoning. Thinking Skills and Creativity, 7(2), 93–100.
Hays, M., Lane, H. C., Auerbach, D., Core, M. G., Gomboc, D., & Rosenberg, M. (2009). Feedback specificity and the learning of intercultural communication skills. In V. Dimitrova, R. Mizoguchi, B. DuBoulay, & A. Graesser (Eds.), Proceedings of Artificial Intelligence in Education (AIED) 2009 (pp. 391–398). Amsterdam: IOS Press.
Heffernan, N. T., Koedinger, K. R., & Razzaq, L. (2008) Expanding the model-tracing architecture: A 3rd generation intelligent tutor for algebra symbolization. International Journal of Artificial Intelligence in Education, 18(2), 153–178.
Hegarty, M., Kriz, S., & Cate, C. (2003). The roles of mental animations and external animations in understanding mechanical systems. Cognition and Instruction, 21(4), 209–249.
Hu, X., Craig, S. D., Bargagliotti A. E., Graesser, A. C., Okwumabua, T., Anderson, C., Cheney, K. R., & Sterbinsky, A. (2012). The effects of a traditional and technology-based after-school program on 6th grade students’ mathematics skills. Journal of Computers in Mathematics and Science Teaching, 31(1), 17–38.
Hu, X., & Graesser, A. C. (2004). Human Use Regulatory Affairs Advisor (HURAA): Learning about research ethics with intelligent learning modules. Behavior Research Methods, Instruments, and Computers, 36(2), 241–249.
Jackson, G. T., Dempsey, K. B., & McNamara, D. S. (2011). Short and long term benefits of enjoyment and learning within a serious game. In G. Biswas, S. Bull, J. Kay, & A. Mitrovic (Eds.), Proceedings of Artificial Intelligence in Education (AIED) 2011 (pp. 139–146). Berlin: Springer.
Johnson, W. L. (2010). Serious use of a serious game for language learning. International Journal of Artificial Intelligence in Education, 20(2), 175–195.
Johnson, W. L., Rickel, J. W., and Lester, J. C. (2000). Animated pedagogical agents: Face-to-face interaction in interactive learning environments. International Journal of Artificial Intelligence in Education, 11(1), 47–78.
Kalra, N., Lauwers, T., Dewey, D., Stepleton, T., & Dias, M. B. (2009). Design of a Braille writing tutor to combat illiteracy. Information Systems Frontiers, 11(2), 117–128.
Koedinger, K. R., McLaughlin, E. A., & Heffernan, N. T. (2010). A quasiexperimental evaluation of an on-line formative assessment and tutoring system. Journal of Educational Computing Research, 43(4), 489–510.
Kopp, K. J., Britt, M. A., Millis, K., & Graesser, A. C. (2012). Improving the efficiency of dialogue in tutoring. Learning and Instruction, 22(5), 320–330.
Landauer, T. K., McNamara, D. S., Dennis, S. E., & Kintsch, W. E. (2007). Handbook of latent semantic analysis. Hillsdale, NJ: Lawrence Erlbaum.
Lesgold, A., Lajoie, S., Bunzo, M., & Eggan, G. (1988). Sherlock: A coached practice environment for an electronics troubleshooting job. In J. Larkin, R. Chabay, & C. Scheftic (Eds.), Computer-assisted instruction and intelligent tutoring systems: Establishing communication and collaboration. Hillsdale, NJ: Lawrence Erlbaum.
Lomas, D., Stamper, J., Muller, R., Patel, K., & Koedinger, K. R. (2012). The effects of adaptive sequencing algorithms on player engagement within an online game. In S. A. Cerri & B. Clancey (Eds.), Proceedings of Intelligent Tutoring Systems (ITS) 2012 (pp. 588–590). Berlin: Springer.
Matsuda, N., Yarzebinski, E., Keiser, V., Raizada, R., William, W. C., Stylianides, G. J., & Koedinger, K. R. (in press). Cognitive anatomy of tutor learning: Lessons learned with SimStudent. Journal of Educational Psychology.
Mavrikis, M., Gutierrez-Santos, S., Geraniou, E., & Noss (2012). Design requirements, student perception indicators and validation metrics for intelligent exploratory learning environments. Personal and Ubiquitous Computing. Springer OnlineFirst. doi: 10.1007/s00779-012-0524-3, 1-16.
Mayer, R. E. (2009). Multimedia learning (2d ed.). New York: Cambridge University Press.
McLaren, B. M., DeLeeuw, K. E., & Mayer, R. E. (2011). A politeness effect in learning with web-based intelligent tutors. International Journal of Human-Computer Studies, 69(1–2), 70–79.
McNamara, D. S., O’Reilly, T., Best, R., & Ozuru, Y. (2006). Improving adolescent students’ reading comprehension with iSTART. Journal of Educational Computing Research, 34(2), 147–171.
Millis, K, Forsyth, C., Butler, H., Wallace, P., Graesser, A., & Halpern, D. (2011). Operation ARIES! A serious game for teaching scientific inquiry. In M. Ma, A. Oikonomou, & J. Lakhmi (Eds.), Serious games and edutainment applications (pp.169–196). London: Springer.
Moreno, R., & Mayer, R. E (2005). Role of guidance, reflection, and interactivity in an agent-based multimedia game. Journal of Educational Psychology, 97(1), 117–128.
Moreno, R., & Mayer, R. E. (2007). Interactive multimodal learning environments. Educational Psychology Review, 19(3), 309–326.
National Research Council (2010). The role of simulations and games in science assessment. In M. A. Honey & M. Hilton (Eds.), Learning science through computer games and simulations (pp. 87–104). Washington, DC: National Academies Press.
Olney, A., D’Mello, S., Person, N., Cade, W., Hayes, P., Williams, C., Lehman, B., & Graesser, A.C. (2012). Guru: A computer tutor that models expert human tutors. In S. A. Cerri & B. Clancey (Eds.), Proceedings of Intelligent Tutoring Systems (ITS) 2012 (pp. 256–261). Berlin: Springer.
O’Neil, H. F., & Perez, R. S. (2008). Computer games and team and individual learning. Amsterdam: Elsevier.
Pardos, Z. A., Dailey, M. D., & Heffernan, N. T. (2011). Learning what works in ITS from non-traditional randomized controlled trial data. International Journal of Artificial Intelligence in Education, 21(1), 47–63.
Razzaq, L., & Heffernan, N. T. (2010). Hints: Is it better to give or wait to be asked? In V. Aleven, J. Kay, & J. Mostow (Eds.) Proceedings of Intelligent Tutoring Systems (ITS) 2010 (pp. 349–358). Berlin: Springer.
Ritter, S., Anderson, J. R., Koedinger, K. R., & Corbett, A. (2007). Cognitive Tutor: Applied research in mathematics education. Psychonomic Bulletin & Review, 14(2), 249–255.
Roll, I., Aleven, V., McLaren, B. M., & Koedinger, K. R. (2011). Improving students’ help-seeking skills using metacognitive feedback in an intelligent tutoring system. Learning and Instruction, 21(2), 267–280.
Rowe, J. P., Shores, L. R., Mott, B. W., & Lester, J. C. (2011). Integrating learning, problem solving, and engagement in narrative-centered learning environments. International Journal of Artificial Intelligence in Education, 21(1–2), 115–133.
Schatz, S., Oakes, C., Folsom-Kovarik, J. T., & Dolletski-Lazar, R. (2012). ITS + SBT: A review of operational situated tutors. Military Psychology, 24(2, SI), 166–193.
Schnotz, W., & Bannert, M. (2003). Construction and interference in learning from multiple representation. Learning and instruction, 13(2), 141–156.
Shih, C. (2012). Zero tolerance cue angle analysis and its effect on successive sink rate of a low cost billiard reposition control tutoring system. Knowledge-Based Systems, 30, 17–34.
Shute, V.J. (2008). Focus on formative feedback. Review of Educational Research, 78, 153–189.
Silverman, B. G., Pietrocola, D., Nye, B. D., Weyer, N., Osin, O., Johnson, D., & Weaver, R. (2012). Rich socio-cognitive agents for immersive training environments: Case of NonKin Village. Autonomous Agents and Multi-Agent Systems, 24(2), 312–343.
Singh, R., et al. (2011). Feedback during web-based homework: The role of hints. In G. Biswas, S. Bull, J. Kay, & A. Mitrovic (Eds.), Proceedings of Artificial Intelligence in Education (AIED) 2011 (pp. 328–336). Berlin: Springer.
Steenbergen-Hu, S., & Cooper, H. (in press). A meta-analysis of the effectiveness of intelligent tutoring systems on college students’ academic learning. Journal of Educational Psychology.
Stottler, R., & Panichas, S. (2006). A new generation of tactical action officer intelligent tutoring system (ITS). In Proceedings of Interservice/Industry Training, Simulation and Education Conference( I/ITSEC) 2006. Orlando, FL.
Suraweera, P., & Mitrovic, A. (2004). An intelligent tutoring system for entity relationship modelling. International Journal of Artificial Intelligence in Education, 14(3–4), 375–417.
U. S. Department of Education, Institute of Education Sciences (2009). Cognitive Tutor Algebra 1. What Works Clearinghouse. Retrieved from
VanLehn, K. (2006). The behavior of tutoring systems. International Journal of Artificial Intelligence in Education, 16(3), 227–265.
VanLehn, K. (2011). The relative effectiveness of human tutoring, intelligent tutoring systems, and other tutoring systems. Educational Psychologist, 46(4), 197–221.
VanLehn, K., Graesser, A. C., Jackson, G. T., Jordan, P., Olney, A., & Rose, C. P. (2007). When are tutorial dialogues more effective than reading? Cognitive Science, 31, 3–62.
VanLehn, K., et al. (2005). The Andes physics tutoring system: Five years of evaluations. In G. I. McCalla and C.-K. Looi (Eds.), Proceedings of the Artificial Intelligence in Education (AIED) 2005 (pp. 678–685). Amsterdam: IOS Press.
Wang, Y. H., Young, S. S. C., & Jang, J.-S. (2009). Evaluation of tangible learning companion/robot for English language learning. In Proceedings of the International Conference on Advanced Learning Technologies (ICALT) 2009 (pp. 322–326). Riga, Latvia: IEEE Press.
Ward, W., Cole, R., Bolaños, D., Buchenroth-Martin, C., Svirsky, E., van Vuuren, S., Weston, T., Zheng, J., & Becker, L. (2011). My Science Tutor: A conversational multimedia virtual tutor for elementary school science. ACM Transactions of Speech and Language Processing, 13, 4–16.
Woolf, B. P. (2009). Building intelligent interactive tutors: Student-centered strategies for revolutionizing e-learning. Burlington, MA: Elsevier.