Skip to main content Accessibility help
×
Hostname: page-component-76fb5796d-vvkck Total loading time: 0 Render date: 2024-04-25T17:22:55.934Z Has data issue: false hasContentIssue false

22 - Tangible Computing

from Systems Software and Technology

Published online by Cambridge University Press:  15 February 2019

Sally A. Fincher
Affiliation:
University of Kent, Canterbury
Anthony V. Robins
Affiliation:
University of Otago, New Zealand
Get access

Summary

Around the turn of the century, the emerging idea of Tangible User Interfaces (TUIs) captured the imaginations of many in the Human-Computer Interaction research community. TUIs sought to break interaction with computers away from screens and single-purpose input devices such as mice and keyboards. Instead, TUIs take advantage of intuitive interaction with objects and artifacts from the physical world. This chapter reviews the history of the CS education research community’s exploration of tangible interaction for computer programming. We also discuss why tangible computing matters now and how we see it shaping the future landscape of computing education. The chapter will touch on physical computing and robotics, but our main emphasis will be on the use of tangible technologies to support computer programming in and with the physical world.
Type
Chapter
Information
Publisher: Cambridge University Press
Print publication year: 2019

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Albo-Canals, J., Barco, A., Relkin, E., Hannon, D., Heerink, M., Heinemann, M., Leidl, K., & Bers, M. (2018). The use case of KIBO robot to positively impact social and emotional development in children with ASD. International Journal of Social Robots, 10, 371383.CrossRefGoogle Scholar
American Academy of Pediatrics (2016). Media and young minds. Pediatrics, 138(5), e20162591.CrossRefGoogle Scholar
Bers, M. (2008). Blocks to Robots: Learning with Technology in the Early Childhood Classroom. New York: Teachers College Press.Google Scholar
Bers, M. U. (2012). Designing Digital Experiences for Positive Youth Development: From Playpen to Playground. Cary, NC: Oxford University Press.CrossRefGoogle Scholar
Bers, M. U. (2018a). Coding as a Playground: Programming and Computational Thinking in the Early Childhood Classroom. New York: Routledge Press.Google Scholar
Bers, M. U. (2018b). Coding, playgrounds and literacy in early childhood education: The development of KIBO robotics and ScratchJr. In Global Engineering Education Conference (EDUCON) (pp. 20942102). New York: IEEE.Google Scholar
Bers, M. U., & Horn, M. S. (2010). Tangible programming in early childhood. In Berson, I. R. & Berson, M. J. (Eds.), HighTech Tots: Childhood in a Digital World (pp. 4970). Charlotte, NC: IAP.Google Scholar
Blackwell, A. F., & Hague, R. (2001). AutoHAN: An architecture for programming the home. In Proceedings of the IEEE Symposia on Human-Centric Computing Languages and Environments, 2001 (pp. 150157). New York: IEEE.Google Scholar
Blackwell, A., McLean, A., Noble, J., & Rohrhuber, J. (2014). Collaboration and learning through live coding (Dagstuhl Seminar 13382). In Dagstuhl Reports (Vol. 3, No. 9). Wadern, Germany: Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik.Google Scholar
Blikstein, P. (2013). Gears of our childhood: Constructionist toolkits, robotics, and physical computing, past and future. In Proceedings of Interaction Design and Children (pp. 173182). New York: ACM Press.CrossRefGoogle Scholar
Buechley, L., & Eisenberg, M. (2008). The LilyPad Arduino: Toward wearable engineering for everyone. IEEE Pervasive Computing, 7(2), 1215.CrossRefGoogle Scholar
diSessa, A. A. (2001). Changing Minds: Computers, Learning, and Literacy. Cambridge, MA: MIT Press.Google Scholar
diSessa, A. A., & Abelson, H. (1986). Boxer: A reconstructible computational medium. Communications of the ACM, 29(9), 859868.CrossRefGoogle Scholar
Dourish, P. (2004). Where the Action Is: The Foundations of Embodied Interaction. Cambridge, MA: MIT press.Google Scholar
Erwin, B., Cyr, M., & Rogers, C. (2000). Lego engineer and robolab: Teaching engineering with labview from kindergarten to graduate school. International Journal of Engineering Education, 16(3), 181192.Google Scholar
Fernaeus, Y., & Tholander, J. (2006). Finding design qualities in a tangible programming space. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 447456). New York: ACM Press.Google Scholar
Frei, P., Su, V., Mikhak, B., & Ishii, H. (2000). Curlybot: Designing a new class of computational toys. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 129136). New York: ACM Press.Google Scholar
Horn, M. S., AlSulaiman, S., & Koh, J. (2013). Translating Roberto to Omar: Computational literacy, stickerbooks, and cultural forms. In Proceedings of Interaction Design and Children (pp. 120127). New York: ACM Press.CrossRefGoogle Scholar
Horn, M. S., Crouser, R. J., & Bers, M. U. (2012). Tangible interaction and learning: The case for a hybrid approach. Personal and Ubiquitous Computing, 16(4), 379389.Google Scholar
Horn, M. S., & Jacob, R. J. (2007). Designing tangible programming languages for classroom use. In Proceedings of Tangible and Embedded Interaction (pp. 159162). New York: ACM Press.Google Scholar
Hornecker, E., & Buur, J. (2006). Getting a grip on tangible interaction: A framework on physical space and social interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 437446). New York: ACM Press.Google Scholar
Hu, F., Zekelman, A., Horn, M., & Judd, F. (2015). Strawbies: Explorations in tangible programming. In Proceedings of Interaction Design and Children (pp. 410413). New York: ACM Press.Google Scholar
Hurtienne, J., & Israel, J. H. (2007). Image schemas and their metaphorical extensions: intuitive patterns for tangible interaction. In 1st International Conference on Tangible and Embedded Interaction (pp. 127134). New York: ACM Press.Google Scholar
Ishii, H., & Ullmer, B. (1997). Tangible bits: Towards seamless interfaces between people, bits and atoms. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 234241). New York: ACM Press.Google Scholar
Kafai, Y., Searle, K., Martinez, C., & Brayboy, B. (2014). Ethnocomputing with electronic textiles: Culturally responsive open design to broaden participation in computing in American indian youth and communities. In Proceedings of the ACM Technical Symposium on Computer Science Education (pp. 241246). New York: ACM Press.CrossRefGoogle Scholar
Kazakoff, E., & Bers, M. (2012). Programming in a robotics context in the kindergarten classroom: The impact on sequencing skills. Journal of Educational Multimedia and Hypermedia, 21(4), 371391.Google Scholar
Kelleher, C., & Pausch, R. (2005). Lowering the barriers to programming: A taxonomy of programming environments and languages for novice programmers. ACM Computing Surveys (CSUR), 37(2), 83137.CrossRefGoogle Scholar
Lakoff, G., & Johnson, M. (2008). Metaphors We Live By. Chicago, IL: University of Chicago Press.Google Scholar
Macaranas, A., Antle, A. N., & Riecke, B. E. (2012). Bridging the gap: Attribute and spatial metaphors for tangible interface design. In Sixth International Conference on Tangible, Embedded and Embodied Interaction (pp. 161168). New York: ACM Press.CrossRefGoogle Scholar
McNerney, T. S. (2004). From turtles to tangible programming bricks: Explorations in physical language design. Personal and Ubiquitous Computing, 8(5), 326337.Google Scholar
Mellis, D., Banzi, M., Cuartielles, D., & Igoe, T. (2007). Arduino: An open electronic prototyping platform. In Proceedings SIGCHI Conference on Human Factors in Computing Systems (Extended Abstracts). New York: ACM Press.Google Scholar
Mittelstadt, B. D., Allo, P., Taddeo, M., Wachter, S., & Floridi, L. (2016). The ethics of algorithms: Mapping the debate. Big Data & Society, 3(2), 121.Google Scholar
Myers, B. A., Ko, A. J., & Burnett, M. M. (2006). Invited research overview: end-user programming. In Proceedings SIGCHI Conference on Human Factors in Computing Systems (Extended Abstracts). New York: ACM Press.Google Scholar
O’Malley, C., & Fraser, D. S. (2004). Literature Review in Learning with Tangible Technologies. A NESTA Futurelab Research report – Report 12. Bristol, UK: FutureLab.Google Scholar
Papert, S. (1980). Mindstorms: Children, Computers, and Powerful Ideas. New York: Basic Books.Google Scholar
Pugnali, A., Sullivan, A., & Bers, M. U. (2017) The impact of user interface on young children’s computational thinking. Journal of Information Technology Education: Innovations in Practice, 16, 172193.Google Scholar
Pattis, R. E. (1981). Karel the Robot: A Gentle Introduction to the Art of Programming. Hoboken, NJ: John Wiley & Sons, Inc.Google Scholar
Raffle, H. S., Parkes, A. J., & Ishii, H. (2004). Topobo: A constructive assembly system with kinetic memory. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 647654). New York: ACM Press.CrossRefGoogle Scholar
Repenning, A. (1993). Agentsheets: A tool for building domain-oriented visual programming environments. In Proceedings of the INTERACT’93 and CHI’93 Conference on Human Factors in Computing Systems (pp. 142143). New York: ACM Press.Google Scholar
Resnick, M., Maloney, J., Monroy-Hernández, A., Rusk, , Eastmond, N., Brennan, E., , K., & Kafai, Y. (2009). Scratch: Programming for all. Communications of the ACM, 52(11), 6067.Google Scholar
Resnick, M., Martin, F., Berg, R., Borovoy, R., Colella, V., Kramer, K., & Silverman, B. (1998). Digital manipulatives: New toys to think with. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 281287). New York: ACM Press.Google Scholar
Resnick, M., Ocko, S., & Papert, S. (1988). LEGO, Logo, and design. Children’s Environments Quarterly, 5(4), 1418.Google Scholar
Rusk, N., Resnick, M., Berg, R., & Pezalla-Granlund, M. (2008). New pathways into robotics: Strategies for broadening participation. Journal of Science Education and Technology, 17(1), 5969.Google Scholar
Schweikardt, E., & Gross, M. D. (2006). roBlocks: A robotic construction kit for mathematics and science education. In Proceedings of Multimodal Interfaces (pp. 7275). New York: ACM Press.Google Scholar
Searle, K. A., Fields, D. A., Lui, D. A., & Kafai, Y. B. (2014). Diversifying high school students’ views about computing with electronic textiles. In Proceedings of International Computing Education Research (pp. 7582). New York: ACM Press.Google Scholar
Shaer, O., & Hornecker, E. (2010). Tangible user interfaces: Past, present, and future directions. Foundations and Trends in Human–Computer Interaction, 3(1–2), 1137.Google Scholar
Sherman, L., Druin, A., Montemayor, J., Farber, A., Platner, M., Simms, S., …, Kruskal, A. (2001). StoryKit: Tools for children to build room-sized interactive experiences. In SIGCHI Conferene on Human Factors in Computing Systems (pp. 197198). New York: ACM Press.Google Scholar
Smith, A. C. (2007). Using magnets in physical blocks that behave as programming objects. In Proceedings of the 1st International Conference on Tangible and Embedded Interaction (pp. 147150). New York: ACM Press.Google Scholar
Smith, A. C., & Kotzé, P. (2010). Indigenous African artefacts: Can they serve as tangible programming objects? In IST-Africa, 2010 (pp. 111). New York: IEEE.Google Scholar
Strawhacker, A. L., & Bers, M. U. (2015). “I want my robot to look for food”: Comparing children’s programming comprehension using tangible, graphical, and hybrid user interfaces. International Journal of Technology and Design Education, 25(3), 293319.Google Scholar
Strawhacker, A., Sullivan, A., & Bers, M. U. (2013). TUI, GUI, HUI: Is a bimodal interface truly worth the sum of its parts? In Proceedings of Interaction Design and Children (pp. 309312). New York: ACM Press.Google Scholar
Sullivan, A., & Bers, M. U. (2016). Robotics in the early childhood classroom: Learning outcomes from an 8-week robotics curriculum in pre-kindergarten through second grade. International Journal of Technology and Design Education, 26(1), 320.Google Scholar
Sullivan, A., & Bers, M. U. (2017). Computational thinking and young children: Understanding the potential of tangible and graphical interfaces. In Ozcinar, H., Wong, G., & Ozturk, T. (Eds.), Teaching Computational Thinking in Primary Education (pp. 123137). Hershey, PA: IGI Global.Google Scholar
Sullivan, A., & Bers, M. U. (2018). Dancing robots: Integrating art, music, and robotics in Singapore’s early childhood centers. International Journal of Technology and Design Education, 28(2), 325346.Google Scholar
Sullivan, A. A., Bers, M. U., & Mihm, C. (2017). Imagining, playing, and coding with KIBO: Using robotics to foster computational thinking in young children. In Proceedings of the International Conference on Computational Thinking Education (pp. 110115). Ting Kok, Hong Kong: The Education University of Hong Kong.Google Scholar
Suzuki, H., & Kato, H. (1995). Interaction-level support for collaborative learning: AlgoBlock – An open programming language. In The First International Conference on Computer Support for Collaborative Learning (pp. 349355). Hillsdale, NJ: Lawrence Erlbaum Associates.Google Scholar
Thieme, A., Morrison, C., Villar, N., Grayson, M., & Lindley, S. (2017). Enabling collaboration in learning computer programing inclusive of children with vision impairments. In Proceedings of the 2017 Conference on Designing Interactive Systems (pp. 739752). New York: ACM Press.Google Scholar
Uttal, D. H., Scudder, K. V., & DeLoache, J. S. (1997). Manipulatives as symbols: A new perspective on the use of concrete objects to teach mathematics. Journal of Applied Developmental Psychology, 18(1), 3754.Google Scholar
Weiser, M., Gold, R., & Brown, J. S. (1999). The origins of ubiquitous computing research at PARC in the late 1980s. IBM Systems Journal, 38(4), 693696.Google Scholar
Wyeth, P. (2008). How young children learn to program with sensor, action, and logic blocks. Journal of the Learning Sciences, 17(4), 517550.Google Scholar
Xambó, A., Drozda, , Weisling, B., Magerko, A., Huet, B., Gasque, M., , T., & Freeman, J. (2017). Experience and ownership with a tangible computational music installation for informal learning. In Tangible and Embedded Interaction (pp. 351360), New York: ACM Press.Google Scholar
Zuckerman, O., Arida, S., & Resnick, M. (2005). Extending tangible interfaces for education: Digital montessori-inspired manipulatives. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 859868). New York: ACM Press.Google Scholar
Zweben, S., & Bizot, B. (2016). Taulbee survey. Computing Research News, 29(5), 351.Google Scholar

Save book to Kindle

To save this book to your Kindle, first ensure coreplatform@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×