Skip to main content Accessibility help
×
Hostname: page-component-78c5997874-s2hrs Total loading time: 0 Render date: 2024-11-18T18:54:25.193Z Has data issue: false hasContentIssue false

2 - Toward the Integration of Bodily States, Language, and Action

Published online by Cambridge University Press:  05 June 2012

Gün R. Semin
Affiliation:
Koninklijke Nederlandse Akademie van Wetenschappen, Amsterdam
Eliot R. Smith
Affiliation:
Indiana University, Bloomington
Arthur M. Glenberg
Affiliation:
University of Wisconsin at Madison, WI, USA
Get access

Summary

This chapter develops an account of human cognition and language centered on three ideas. First, cognition is for action: Only organisms that can orchestrate action have nervous systems, and the basic function of a nervous system is to guide action. The second idea is that of neural exploitation (Gallese & Lakoff, 2005). Namely, as brains evolve, additional functions exploit the operation of neural systems already in place. Importantly, language seems to be such a system in that language comprehension involves the simulation of action calling upon neural systems otherwise used for perception, action, and emotional processing. Third, the simulations invoked by language make use of forward models (e.g., Grush, 2004) that are predominately used in the control of action. Consequently, both short-term (e.g., fatigue, practice, emotional states) and long-term (e.g., development, learning, neural insults) changes in action systems are predicted to affect language comprehension.

COGNITION IS FOR ACTION

What Brains Are For

“What are brains for?” The answer to that question would seem to be obvious: “Brains are for thinking!” But consider some of the exquisite work that the brain does that one would not ordinarily classify as thinking. The brain controls and coordinates eye and neck muscles that allow us to track an annoying housefly, not to mention the tremendous amount of work done by the visual areas of the brain in locating and identifying the fly. The brain coordinates that tracking activity with reaching out with the hand and arm to swat the fly.

Type
Chapter
Information
Embodied Grounding
Social, Cognitive, Affective, and Neuroscientific Approaches
, pp. 43 - 70
Publisher: Cambridge University Press
Print publication year: 2008

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Barsalou, L. W. (1999). Perceptual symbol systems. Behavioral and Brain Sciences, 22, 577–660.Google ScholarPubMed
Borghi, A. M., Glenberg, A. M., & Kaschak, M. P. (2004). Putting words in perspective. Memory & Cognition, 32, 863–873.CrossRefGoogle Scholar
Buccino, G., Riggio, L., Melli, G., Binkofski, F., Gallese, V., & Rizzolatti, G. (2005). Listening to action-related sentences modulates the activity of the motor system: A combined TMS and behavioral study. Cognitive Brain Research, Aug 2005.CrossRefGoogle ScholarPubMed
Calvo-Merino, B., Glaser, D. E., Grezes, J., Passingham, R. E., & Haggard, P. (2005) Action observation and acquired motor skills: An FMRI study with expert dancers. Cerebral Cortex, 15, 1243–1249.CrossRefGoogle ScholarPubMed
Chambers, C. G., Tanenhaus, M. K., & Magnuson, J. S. (2004). Actions and affordances in syntactic ambiguity resolution. Journal of Experimental Psychology: Learning, Memory, and Cognition, 30, 687–696.Google ScholarPubMed
Classen, J., Liepert, J., Wise, S. P., Hallett, M., & Cohen, L. G. (1998). Rapid plasticity of human cortical movement representation induced by practice. Journal of Neurophysiology, 79, 1117–1123.CrossRefGoogle ScholarPubMed
De Vega, M. (in press). Levels of embodied meaning. From pointing to counterfactuals. In Vega, M., Glenberg, A. M., & Graesser, A. C. (Eds.), Symbols, Embodiment, and Meaning. Oxford: Oxford University Press.Google Scholar
Vega, M., Robertson, D. A., Glenberg, A. M., Kaschak, M. P., & Rinck, M. (2004). On doing two things at once: Temporal constraints on actions in language comprehension. Memory and Cognition, 32, 1033–1043.CrossRefGoogle ScholarPubMed
Fadiga, L., Craighero, L., Buccino, G., & Rizzolatti, G. (2002). Speech listening specifically modulates the excitability of tongue muscles: a TMS study. European Journal of Neuroscience, 15, 399–402.CrossRefGoogle ScholarPubMed
Fadiga, L., Fogassi, L., Pavesi, G., & Rizzolatti, G. (1995). Motor facilitation during action observation: A magnetic stimulation study. Journal of Neurophysiology, 73, 2608–2611.CrossRefGoogle ScholarPubMed
Ferrari, P. F., Rozzi, S., & Fogassi, L. (2005). Mirror neurons responding to observation of actions made with tools in monkey ventral premotor cortex. Journal of Cognitive Neuroscience, 17, 212–226.CrossRefGoogle ScholarPubMed
Fiorio, M., Tinazzi, M., & Aglioti, S. M. (2006). Selective impairment of hand mental rotation in patients with focal hand dystonia. Brain, 129, 47–54.CrossRefGoogle ScholarPubMed
Frijda N. (2005). Emotions and action. In Manstead, A. S. R., Frijda, N., & Fischer, A. (Eds.), Feelings and emotions: The Amsterdam symposium. Cambridge, UK: Cambridge University Press.Google Scholar
Gallese, V., Keysers, C., & Rizzolatti, G. (2004). A unifying view of the basis of social cognition. Trends in Cognitive Sciences, 8, 396–403.CrossRefGoogle ScholarPubMed
Gallese, V., & Lakoff, G. (2005). The brain's concepts: The role of the sensory-motor system in conceptual knowledge. Cognitive Neuropsychology, 22, 455–479.CrossRefGoogle ScholarPubMed
Gentilucci, M., Benuzzi, F., Gangitano, M., & Grimaldi, S. (2001). Grasp with hand and mouth: A kinematic study on healthy subjects. Journal of Neurophysiology, 86, 1685–1699.CrossRefGoogle ScholarPubMed
Gentilucci, M., Bernardis, P., Crisi, G., & Volta, R. D. (2006). Repetitive transcranial magnetic stimulation of Broca's area affects verbal responses to gesture observation. Journal of Cognitive Neuroscience, 18, 1059–1074.CrossRefGoogle ScholarPubMed
Gibson, J. J. (1979). The ecological approach to visual perception. New York: Houghton Mifflin.Google Scholar
Glenberg, A. M. (1997). What memory is for. Behavioral and Brain Sciences, 20, 1–55.Google ScholarPubMed
Glenberg, A. M., Becker, R., Klötzer, S., Kolanko, L., Müller, S., & Rinck, M. (in preparation). Episodic affordances contribute to language comprehension.
Glenberg, A. M., Cattaneo, L., & Sato, M. (in preparation). Grounding abstract language in action? Beans!
Glenberg, A. M., Gutierrez, T., Levin, J. R., Japuntich, S., & Kaschak, M. P. (2004). Activity and imagined activity can enhance young children's reading comprehension. Journal of Educational Psychology, 96, 424–436.CrossRefGoogle Scholar
Glenberg, A. M., & Kaschak, M. P. (2002). Grounding language in action. Psychonomic Bulletin & Review, 9, 558–565.CrossRefGoogle ScholarPubMed
Glenberg, A. M., & Robertson, D. A. (1999). Indexical understanding of instructions. Discourse Processes, 28, 1–26.Google Scholar
Glenberg, A. M., & Robertson, D. A. (2000). Symbol grounding and meaning: A comparison of high-dimensional and embodied theories of meaning. Journal of Memory and Language, 43, 379–401.CrossRefGoogle Scholar
Goldberg, A. E. (1995). Constructions: A construction grammar approach to argument structure. Chicago: University of Chicago Press.Google Scholar
Gorniak, P. (2005). The affordance-based concept. Unpublished doctoral dissertation, Massachusetts Institute of Technology, Cambridge, MA.Google Scholar
Grush, R. (2004). The emulation theory of representation: Motor control, imagery, and perception. Behavioral and Brain Sciences, 27, 377–442.Google ScholarPubMed
Hauk, O., John, I. srude, & Pulvermüller, F. (2004). Somatotopic representation of action words in human motor and premotor cortex. Neuron, 41(2), 301–307.CrossRefGoogle ScholarPubMed
Havas, D. A., Glenberg, A. M., & Rinck, M. (2007). Emotion simulation during language comprehension. Psychonomic Bulletin & Review, 14, 436–441.CrossRefGoogle ScholarPubMed
Hommel, B., Muesseler, J., Aschersleben, G., & Prinz, W. (2001). The theory of event coding (TEC): A framework for perception and action planning. Behavioral and Brain Sciences, 24, 849–878.CrossRefGoogle ScholarPubMed
Iverson, J. M., & Goldin-Meadow, S. (2001). The resilience of gesture in talk: gesture in blind speakers and listeners. Developmental Science, 4, 416–422.CrossRefGoogle Scholar
Kaschak, M. P., & Glenberg, A. M. (2000). Constructing meaning: The role of affordances and grammatical constructions in sentence comprehension. Journal of Memory and Language, 43, 508–529.CrossRefGoogle Scholar
Kaschak, M. P., Madden, C. J., Therriault, D. J., Yaxley, R. H., Aveyard, M., Blanchard, A., & Zwaan, R. A. (2005). Perception of motion affects language processing. Cognition, 94(3), B79–B89.CrossRefGoogle ScholarPubMed
Kelly, S. D., Barr, D. J., Church, R. B., & Lynch, K. (1999). Offering a hand to pragmatic understanding: The role of speech and gesture in comprehension and memory. Journal of Memory and Language, 40, 577–592.CrossRefGoogle Scholar
Kohler, E., Keysers, C., Umiltà, M. A., Fogassi, L., Gallese, V., & Rizzolatti, G. (2002). Hearing sounds, understanding actions: Action representation in mirror neurons. Science, 297, 846–848.CrossRefGoogle ScholarPubMed
Llinas, R. (2001). The i of the vortex. Cambridge, MA: MIT Press.Google Scholar
Matlock, T. (2004). Fictive motion as cognitive simulation. Memory & Cognition, 32, 1389–1400.CrossRefGoogle ScholarPubMed
McNeill, D. (1992). Hand and mind: What gestures reveal about thought. Chicago: University of Chicago Press.Google Scholar
Masur, E. F. (1997). Maternal labeling of novel and familiar objects: Implications for children's development of lexical constraints. Journal of Child Language, 24, 427–439.CrossRefGoogle Scholar
Montessori, M. (1967). The absorbent mind. Translated from the Italian by Claude A. Claremount. New York: Holt, Rinehart, & Winston.Google Scholar
Noice, T., & Noice, H. (2006). What studies of actors and acting can tell us about memory and cognitive functioning. Current Directions in Psychological Science, 15, 14–18.CrossRefGoogle Scholar
Ochs, E., Gonzales, P., & Jacoby, S. (1996). “When I come down I'm in the domain state”: Grammar and graphic representation in the interpretive activity of physicists. In Schegloff, E. A. & Thompson, S. A. (Eds.), Interaction and grammar (pp. 328–369). Cambridge, UK: Cambridge University Press.Google Scholar
Pecher, D., Zeelenberg, R., & Barsalou, L. W. (2003). Verifying different-modality properties for concepts produces switching costs. Psychological Science, 14, 119–125.CrossRefGoogle ScholarPubMed
Pulvermüller, F. (2005). Brain mechanisms linking language and action. Nature Reviews Neuroscience, 6(7), 576–582.CrossRefGoogle ScholarPubMed
Pulvermüller, F., Shtyrov, Y., & Ilmoniemi, R. J. (2003). Spatio-temporal patterns of neural language processing: An MEG study using minimum-norm current estimates. Neuroimage, 20, 1020–1025.CrossRefGoogle Scholar
Rizzolatti, G., & Arbib, M. A. (1998). Language within our grasp. Trends in Neuroscience, 21, 188–194.CrossRefGoogle ScholarPubMed
Rizzolatti, G., & Craighero, L. (2004). The mirror-neuron system. Annual Review of Neuroscience, 27, 169–192.CrossRefGoogle ScholarPubMed
Roth, W.-M. (1999). Discourse and agency in school science laboratories. Discourse Processes, 28, 27–60.CrossRefGoogle Scholar
Schwartz, D. L., & Holton, D. L. (2000). Tool use and the effect of action on the imagination. Journal of Experimental Psychology: Learning, Memory, and Cognition, 26, 1655–1665.Google ScholarPubMed
Simon, J. R. (1990). The effects of an irrelevant directional cue on human information processing. In Proctor, R. W. & Reeve, T. G. (Eds.), Stimulus-response compatibility: An integrated perspective (pp. 31–86). Amsterdam: North-Holland.Google Scholar
Smith, L. B. (2005). Action alters shape categories. Cognitive Science, 29, 665–679.CrossRefGoogle ScholarPubMed
Strack, F., Martin, L. L., & Stepper, S. (1988). Inhibiting and facilitating condition of facial expressions: A non-obtrusive test of the facial feedback hypothesis. Journal of Personality and Social Psychology, 54, 768–777.CrossRefGoogle Scholar
Talmy, L. (1996). Fictive motion in language and “ception.” In Bloom, P., Peterson, M. A., Nadel, L., & Garrett, M. F. (Eds.), Language and space (pp. 211–276). Cambridge, MA: MIT Press.Google Scholar
Tettamanti, M., Buccino, G., Saccuman, M. C., Gallese, V., Danna, M., Scifo, P.Fazio, F., Rizzolatti, G., Cappa, S. F., & Perani, D. (2005). Listening to action-related sentences activates fronto-parietal motor circuits. Journal of Cognitive Neuroscience, 17, 273–281.CrossRefGoogle ScholarPubMed
Tomasello, M. (2000). Do young children have adult syntactic competence?Cognition, 74, 209–253.CrossRefGoogle Scholar
Valenzeno, L., Alibali, M. W., & Klatzky, R. (2003). Teachers' gestures facilitate students' learning: A lesson in symmetry. Contemporary Educational Psychology, 28(2): 187–204.CrossRefGoogle Scholar
Orden, G. C., Holden, J G., & Turvey, M. T. (2005). Human cognition and 1/f scaling. Journal of Experimental Psychology: General, 134, 117–123.CrossRefGoogle ScholarPubMed
Wilson, M., & Knoblich, G. (2005). The case for motor involvement in perceiving conspecifics. Psychological Bulletin, 131, 460–473.CrossRefGoogle ScholarPubMed
Wolpert, D. M., & Kawato, M. (1998). Multiple paired forward and inverse models for motor control. Neural Networks, 11, 1317–1329.CrossRefGoogle ScholarPubMed

Save book to Kindle

To save this book to your Kindle, first ensure coreplatform@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×