Hostname: page-component-76fb5796d-5g6vh Total loading time: 0 Render date: 2024-04-26T04:10:51.686Z Has data issue: false hasContentIssue false
  • English
  • Français

Preschoolers benefit from a clear sound-referent mapping to acquire nonnative phonology

Published online by Cambridge University Press:  11 November 2020

Núria Esteve-Gibert Open the ORCID record for Núria Esteve-Gibert [Opens in a new window]  and
Carmen Muñoz
Núria Esteve-Gibert*
Affiliation:
Universitat Oberta de Catalunya, and Universitat de Barcelona
Carmen Muñoz
Affiliation:
Universitat de Barcelona
*
*Corresponding author. E-mail: nesteveg@uoc.edu.
Get access Rights & Permissions [Opens in a new window]

Abstract

Previous studies have shown that visual information is a crucial input in early language learning. In the present study we examine what type of visual input helps preschoolers in acquiring nonnative phonological contrasts. Catalan/Spanish-speaking children (4–5 years, N = 47) participated in a task to assess their phonological discrimination abilities before and after a training. Three training conditions were presented: one with clear oral/visual speech information, one with an ostensive object-sound mapping, and one with a rich social interaction. Children’s looking patterns were tracked to examine their focus of interest while being trained. Results revealed that preschoolers’ discrimination abilities increase in all trained conditions, but the condition where the speaker created an ostensive object–sound mapping led to higher long-term gains (especially for younger children). Eye-tracking results further showed that children looked to the object of reference while being exposed to the novel phonological input, which may explain the higher learning gains in this condition. Our results indicate that preschoolers’ learning of nonnative phonological contrasts is particularly boosted when the speech input is accompanied by an object of reference that is signaled ostensively and contingently in the visual space, compared to when the visual space only contains clear oral/visual speech information or social interactivity cues.

Keywords

childrencontingencyphonologysecond language acquisitionvisual speech
Type
Original Article
Information
Applied Psycholinguistics , Volume 42 , Issue 1 , January 2021 , pp. 77 - 100
Check for updates
Copyright
© The Author(s), 2020. Published by Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Aliaga-Garcia, C. (2017). The effect of auditory and articulatory phonetic training on the perception and production of L2 vowels by Catalan-Spanish learners of English. PhD dissertation, Universitat de Barcelona.Google Scholar
Aliaga-Garcia, C., & Mora, J. C. (2009). Assessing the effects of phonetic training on L2 sound perception and production. In A Watkins, M. A., Rauber, A. S., & Baptista, B. O. (Eds.), Recent research in second language phonetics/phonology: Perception and production (pp. 2–31). Newcastle upon Tyne: Cambridge Scholars Publishing.Google Scholar
Alm, M., Behne, D. M., Wang, Y., & Eg, R. (2009). Audio-visual identification of place of articulation and voicing in white and babble noise. Journal of the Acoustical Society of America, 126, 377–387.CrossRefGoogle ScholarPubMed
Altmann, G. T. M., & Kamide, Y. (2004). Now you see it, now you don’t: Mediating the mapping between language and the visual world. In Henderson, J. & Ferreira, F. (Eds.), The interface between language, vision, and action: Eye movements and the visual world (pp. 347–386). New York: Psychology Press.Google Scholar
Bannard, C., & Tomasello, M. (2012). Can we dissociate contingency learning from social learning in word acquisition by 24-month-olds? PLOS ONE, 7, e49881.CrossRefGoogle ScholarPubMed
Bates, D., Maechler, M., Bolker, B., & Walker, S. (2015). Fitting linear mixed-effects models using lme4. Journal of Statistical Software, 67, 1–48.CrossRefGoogle Scholar
Best, C. T. (1993). Emergence of language-specific constraints in perception of non-native speech: A window on early phonological development. In De Boysson-Bardies, B., de Schonen, S., Jusczyk, P., MacNeilage, P., & Morton, J. (Eds.), Developmental neurocognition: Speech and face processing in the first year of life (pp. 289–304). Dordrecht: Academic Publishers.CrossRefGoogle Scholar
Best, C. T., & Tyler, M. D. (2007). Nonnative and second-language speech perception: Commonalities and complementarities. In Munro, M. J.& Bohn, O.-S. (Eds.), Second language speech learning: The role of language experience in speech perception and production (pp. 13–34). Amsterdam: Benjamins.CrossRefGoogle Scholar
Birulés, J., Bosch, L., Brieke, R., Pons, F., & Lewkowicz, D. J. (2019). Inside bilingualism: Language background modulates selective attention to a talker’s mouth. Developmental Science, 22, 1–12.CrossRefGoogle ScholarPubMed
Brooks, R., & Meltzoff, A. (2005). The development of gaze following and its relations to language. Developmental Science, 8, 535–543.CrossRefGoogle Scholar
Cebrian, J. (2006). Experience and the use of duration in the categorization of L2 vowels. Journal of Phonetics, 34, 372–387.CrossRefGoogle Scholar
Cebrian, J., & Carlet, A. (2012). Audiovisual perception of native and non-native sounds by native and non-native speakers 1. In Alegre, S. Martin, Moyer, M., Pladevall, E., & Tubau, S. (Eds.), At a time of crisis: English and American studies in Spain (pp. 300–307). Works from the 35th AEDEAN Conference UAB/Barcelona, November 14–16, 2011.Google Scholar
Csibra, G., & Gergely, G. (2009). Natural pedagogy. Trends in Cognitive Sciences, 13, 148–153.CrossRefGoogle ScholarPubMed
Erdener, D., & Burnham, D. (2013). The relationship between auditory-visual speech perception and language-specific speech perception at the onset of reading instruction in English-speaking children. Journal of Experimental Child Psychology, 116, 120–138.CrossRefGoogle ScholarPubMed
Erdener, D., & Burnham, D. (2018). Auditory–visual speech perception in three- and four-year-olds and its relationship to perceptual attunement and receptive vocabulary. Journal of Child Language, 45, 273–289.CrossRefGoogle ScholarPubMed
Erdener, V. D. (2007). Development of Auditory-Visual speech perception in young children. Unpublished doctoral thesis, Western Sydney University.Google Scholar
Esteve-Gibert, N., Borràs-Comes, J., Asor, E., Swerts, M., & Prieto, P. (2017). The timing of head movements: The role of prosodic heads and edges. Journal of the Acoustical Society of America, 141, 4727–4739.CrossRefGoogle ScholarPubMed
Esteve-Gibert, N., & Guellaï, B. (2018). Prosody in the auditory and visual domains: A developmental perspective. Frontiers in Psychology, 9, 1–10.CrossRefGoogle ScholarPubMed
Feldman, N. H., Myers, E. B., White, K. S., Griffith, T. L., & Morgan, J. L. (2013). Word-level information influences phonetic learning in adults and infants. Cognition, 127, 427–438.CrossRefGoogle ScholarPubMed
Fennell, C. T., & Waxman, S. R. (2010). What paradox? Referential cues allow for infant use of phonetic detail in word learning. Child Development, 81, 1376–1383.CrossRefGoogle ScholarPubMed
Fernald, A. (1993). Approval and disapproval: Infant responsiveness to vocal affect in familiar and unfamiliar languages. Child Development, 64, 657–674.CrossRefGoogle ScholarPubMed
Fernald, A., & Mazzie, C. (1991). Prosody and focus in speech to infants and adults. Developmental Psychology, 27, 209–221.CrossRefGoogle Scholar
Flege, J. (1989). Differences in inventory size affect the location but not the precision of tongue positioning in vowel production. Language and Speech, 32, 123–147.CrossRefGoogle Scholar
Gershkoff-Stowe, L., & Thelen, E. (2004). U-shaped changes in behavior: A dynamic systems perspective. Journal of Cognition and Development, 5, 11–36.CrossRefGoogle Scholar
Gick, B., & Derrick, D. (2009). Aero-tactile integration in speech perception. Nature, 462, 502–504.CrossRefGoogle ScholarPubMed
Gogate, L. J., Walker-Andrews, A. S., & Bahrick, L. E. (2001). The intersensory origins of word comprehension: An ecological-dynamic systems view. Developmental Science, 4, 1–18.CrossRefGoogle Scholar
Golinkoff, R. M., Can, D. D., Soderstrom, M., & Hirsh-Pasek, K. (2015). (Baby)talk to me: The social context of infant-directed speech and its effects on early language acquisition. Current Directions in Psychological Science, 24, 339–344.CrossRefGoogle Scholar
Hadar, U., Steiner, T. J., Grant, E. C., & Rose, F. C. (1983). Head movement correlates of juncture and stress at sentence level. Language and Speech, 26, 117–129.CrossRefGoogle ScholarPubMed
Hakuno, Y., Omori, T., Yamamoto, J., & Minagawa, Y. (2017). Social interaction facilitates word learning in preverbal infants: Word–object mapping and word segmentation. Infant Behavior and Development, 48(Part B), 65–77.CrossRefGoogle ScholarPubMed
Hall, G. F. (1991). Perceptual and associative learning. Oxford: Clarendon Press.CrossRefGoogle Scholar
Hanna, J. E., & Brennan, S. E. (2007). Speakers’ eye gaze disambiguates referring expressions early during face-to-face conversation. Journal of Memory and Language, 57, 596–615.CrossRefGoogle Scholar
Hardison, D. M. (2003). Acquisition of second-language speech: Effects of visual cues, context, and talker variability. Applied Psycholinguistics, 24, 495–522.CrossRefGoogle Scholar
Hazan, V., Sennema, A., Faulkner, A., Ortega-Llebaria, M., Iba, M., & Chung, H. (2006). The use of visual cues in the perception of non-native consonant contrasts. Journal of the Acoustical Society of America, 119, 1740–1751.CrossRefGoogle ScholarPubMed
Hollich, G. J., Hirsh-Pasek, K., & Golinkoff, R. M. (2000). Breaking the language barrier: An emergentist coalition model of word learning Monographs of the Society for Research in Child Development, 65, 1–135.CrossRefGoogle ScholarPubMed
Horst, J. S., & Hout, M. C. (2016). Novel Object & Unusual Name (NOUN) Database: A collection of novel images for use in experimental research. Behavior Research Methods, 48, 1393–1409.CrossRefGoogle ScholarPubMed
Ishi, C. T., Ishiguro, H., & Hagita, N. (2014). Analysis of relationship between head motion events and speech in dialogue conversations. Speech Communication, 57, 233–243.CrossRefGoogle Scholar
Krahmer, E., & Swerts, M. (2007). The effects of visual beats on prosodic prominence: Acoustic analyses, auditory perception and visual perception. Journal of Memory and Language, 57, 396–414.CrossRefGoogle Scholar
Kuhl, P. K. (2007). Is speech learning “gated” by the social brain? Developmental Science, 10, 110–120.CrossRefGoogle ScholarPubMed
Kuhl, P. K., Tsao, F.-M., & Liu, H.-M. (2003). Foreign-language experience in infancy: Effects of short-term exposure and social interaction on phonetic learning. Proceedings of the National Academy of Sciences USA, 100, 9096–9101.CrossRefGoogle ScholarPubMed
Lalonde, K., & Holt, R. F. (2015). Preschoolers benefit from visually salient speech cues. Journal of Speech, Language, and Hearing Research, 58, 135–150.CrossRefGoogle ScholarPubMed
Linebarger, D. L., & Vaala, S. E. (2010). Screen media and language development in infants and toddlers: An ecological perspective. Developmental Review, 30, 176–202.CrossRefGoogle Scholar
MacMillan, N. A., & Creelman, C. D. (2005) Detection theory: A user’s guide (2nd ed.). Mahwah, NJ: Erlbaum.Google Scholar
Marcus, G. F. (2004). What’s in a U? The shapes of cognitive development. Journal of Cognition and Development, 5, 119–122.CrossRefGoogle Scholar
Matin, E., Shao, K. C., & Boff, K. R. (1993). Saccadic overhead: Information-processing time with and without saccades. Perception and Psychophysics, 53, 372–380.CrossRefGoogle ScholarPubMed
McGillion, M., Herbert, J. S., Pine, J., Vihman, M., Keren-Portnoy, T., & Matthews, D. (2017). What paves the way to conventional language? The predictive value of babble, pointing, and socioeconomic status. Child Development, 88, 156–166.CrossRefGoogle ScholarPubMed
McGurk, H., & MacDonald, J. (1976). Hearing lips and seeing voices. Nature, 264, 746–748.CrossRefGoogle ScholarPubMed
Mermelshtine, R. (2017). Parent–child learning interactions: A review of the literature on scaffolding. British Journal of Educational Psychology, 87, 241–254.CrossRefGoogle ScholarPubMed
Metsala, J. L., & Walley, A. C. (1998). Spoken vocabulary growth and the segmental restructuring of lexical representations: Precursors to phonemic awareness and early reading ability. In Metsala, J. L. & Ehri, L. C. (Eds.), Word recognition in beginning literacy (pp. 89–120). Mahwah, NJ: LEA.Google Scholar
Moore, C., Angelopoulos, M., & Bennett, P. (1999). Word learning in the context of referential and salience cues. Developmental Psychology, 35, 60–68.CrossRefGoogle ScholarPubMed
Namy, L. L., & Waxman, S. R. (2000). Naming and exclaiming: Infants’ sensitivity to naming contexts. Journal of Cognition and Development, 1, 405–428.CrossRefGoogle Scholar
Nussenbaum, K., & Amso, D. (2015). An attentional Goldilocks effect: An optimal amount of social interactivity promotes word learning from video. Journal of Cognition and Development, 17, 30–40.CrossRefGoogle ScholarPubMed
Ortega-Llebaria, M., Faulkner, A., & Hazan, V. (2001). Auditory-visual L2 speech perception: Effects of visual cues and acoustic-phonetic context for Spanish learners of English. Speech, Hearing and Language: Work in Progress, 13, 3951.Google Scholar
Pons, F., Lewkowicz, D. J., Soto-Faraco, S., & Sebastián-Gallés, N. (2009). Narrowing of intersensory speech perception in infancy. Proceedings of the National Academy of Sciences, USA, 106, 10598–10602.CrossRefGoogle ScholarPubMed
R Core Team (2014). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. Retrieved from http://www.R-project.org/ Google Scholar
Romeo, R. R., Leonard, J. A., Robinson, S. T., West, M. R., Mackey, A. P., Rowe, M. L., & Gabrieli, J. D. (2018). Beyond the 30-million-word gap: children’s conversational exposure is associated with language-related brain function. Psychological Science, 29, 700–710.CrossRefGoogle ScholarPubMed
Roseberry, S., Hirsh-Pasek, K., & Golinkoff, R. M. (2014). Skype me! Socially contingent interactions help toddlers learn language. Child Development, 85, 956–970.CrossRefGoogle ScholarPubMed
Rowe, M. L., & Snow, C. E. (2020). Analyzing input quality along three dimensions: Interactive, linguistic, and conceptual. Journal of Child Language, 47, 5–21.CrossRefGoogle ScholarPubMed
Saint-Georges, C., Chetouani, M., Cassel, R., Apicella, F., Mahdhaoui, A., Muratori, F., … Cohen, D. (2013). Motherese in interaction: At the cross-road of emotion and cognition? A Systematic Review. PLOS ONE, 8, 1–18.CrossRefGoogle ScholarPubMed
Salverda, A. P., Kleinschmidt, D., & Tanenhaus, M. K. (2014). Immediate effects of anticipatory coarticulation in spoken-word recognition. Journal of Memory and Language, 71, 145–163.CrossRefGoogle ScholarPubMed
Schwartz, J. L., Berthommier, F., & Savariaux, C. (2004). Seeing to hear better: Evidence for early audio-visual interactions in speech identification. Cognition, 93, 69–78.CrossRefGoogle ScholarPubMed
Senju, A., & Csibra, G. (2008). Gaze following in human infants depends on communicative signals. Current Biology, 18, 668–671.CrossRefGoogle ScholarPubMed
Soderstrom, M. (2007). Beyond babytalk: Re-evaluating the nature and content of speech input to preverbal infants. Developmental Review, 27, 501–532.CrossRefGoogle Scholar
Spinelli, M., Fasolo, M., & Mesman, J. (2017). Does prosody make the difference? A meta-analysis on relations between prosodic aspects of infant-directed speech and infant outcomes. Developmental Review, 44, 1–18.CrossRefGoogle Scholar
Teinonen, T., Aslin, R. N., Alku, P., & Csibra, G. (2008). Visual speech contributes to phonetic learning in 6-month-old infants. Cognition, 108, 850–855.CrossRefGoogle ScholarPubMed
Ter Schure, S., Junge, C., & Boersma, P. (2016). Discriminating non-native vowels on the basis of multimodal, auditory or visual information: Effects on infants’ looking patterns and discrimination. Frontiers in Psychology, 7, 1–11.CrossRefGoogle ScholarPubMed
Thiessen, E. D. (2011). When variability matters more than meaning: The effect of lexical forms on use of phonemic contrasts. Developmental Psychology, 47, 1448–1458.CrossRefGoogle ScholarPubMed
Tomasello, M. (1995). Joint attention as social cognition. In C. M. & Dunham, P. (Ed.), Joint attention: Its origins and role in development (pp. 103–130). Mahwah, NJ: Erlbaum.Google Scholar
Triesch, J., Teuscher, C., Deak, G. O., & Carlson, E. (2006). Gaze following: Why (not) learn it? Developmental Science, 9, 125–147.CrossRefGoogle Scholar
Walley, A. C. (2008). Speech perception in childhood. In Pisoni, D. B. & Remez, R. E. (Eds.), The handbook of speech perception (pp. 1–37). Oxford: Blackwell.Google Scholar
Weikum, W. M., Vouloumanos, A., Navarra, J., Soto-Faraco, S., Sebastián-Gallés, N., & Werker, J. F. (2007). Visual language discrimination in infancy. Science, 316, 1159.CrossRefGoogle ScholarPubMed
Wu, R., Gopnik, A., Richardson, D. C., & Kirkham, N. Z. (2011). Infants learn about objects from statistics and people. Developmental Psychology, 47, 1220–1229.CrossRefGoogle ScholarPubMed
Wu, R., & Kirkham, N. Z. (2010). No two cues are alike: Depth of learning during infancy is dependent on what orients attention. Journal of Experimental Child Psychology, 107, 118–136.CrossRefGoogle ScholarPubMed
Wu, R., Tummeltshammer, K. S., Gliga, T., & Kirkham, N. Z. (2014). Ostensive signals support learning from novel attention cues during infancy. Frontiers in Psychology, 5, 251.CrossRefGoogle ScholarPubMed
Wu, Z., & Gros-Louis, J. (2014). Infants’ prelinguistic communicative acts and maternal responses: Relations to linguistic development. First Language, 34, 72–90.CrossRefGoogle Scholar
Yeung, H. H., Chen, L. M., & Werker, J. F. (2014). Referential labeling can facilitate phonetic learning in infancy. Child Development, 85, 1036–1049.CrossRefGoogle ScholarPubMed
Yeung, H. H., & Nazzi, T. (2014). Object labeling influences infant phonetic learning and generalization. Cognition, 132, 151–163.CrossRefGoogle ScholarPubMed
Yeung, H. H., & Werker, J. F. (2009). Learning words’ sounds before learning how words sound: 9-month-olds use distinct objects as cues to categorize speech information. Cognition, 113, 234–243.CrossRefGoogle ScholarPubMed
Yoon, J. M. D., Johnson, M. H., & Csibra, G. (2008). Communication-induced memory biases in preverbal infants. Proceedings of the National Academy of Sciences, USA, 105, 13690–13695.CrossRefGoogle ScholarPubMed
Yu, C., & Smith, L. B. (2012). Embodied attention and word learning by toddlers. Cognition, 125, 244–262.CrossRefGoogle ScholarPubMed