Switching between two concurrent tasks is an important ability of the mind. In a series of two experiments, we explored the role of activation (arousal and subjective significance) and emotional valence in shaping the effectiveness of switching between two cognitive tasks: gender-marking and emotional categorisations of verbal stimuli. We expected arousal to disrupt and subjective significance to boost the effectiveness of cognitive switching. We employed a paradigm that allowed us to present emotional words and measure the reaction latencies when a task given to the participants was switched; thus, the response was more costly than when continuing to respond to the same task. The first experiment, conducted with neutral words, showed that high subjective significance reduced reaction latencies in comparison with medium subjective significance. The second experiment showed a similar pattern only for neutral stimuli in the emotional categorisation task, but not for negative and positive stimuli. We did not find a clear effect of arousal or valence. The results of our studies suggest that subjective significance is independent of arousal in enhancing the cognitive control resources.

Arbib's How the brain got language is a major achievement in defining a trajectory for the evolution of complex imitation and the language-ready brain leading to human language. In addition to these capabilities, I will suggest that it is useful to consider two additional components of human brain function that are intricately related to the emergence of language. These are, first, the profound human motivation to represent and share the psychological states of others, and second, the related complex semantic system that represents the contents of what is communicated in language. In this sense, these two components represent part of what is under the iceberg, where language is the emerging tip.

Research using masked priming and parafoveal preview techniques has shown that visual letter similarity has an impact on word processing during the initial stages in Latin-derived scripts. However, these effects appear to be absent in Arabic. One reason for this discrepancy could be attributed to the distinctive features of the Arabic script, which includes numerous letters sharing a basic form while varying in the location or number of diacritics. To shed light on this issue, the present study employed Arabic letters rather than words in two masked priming experiments: an alphabetic decision task and a letter-matching task. Both experiments showed that visually similar letters were more effective as primes than visually dissimilar letters. These findings suggest that the processes of letter identification in Arabic and Latin scripts may be roughly alike, implying that differences in visual letter similarity across scripts may arise at later stages of processing.

Ideophones – imitative words using the stream of speech to simulate/depict the rise and fall of sensory perceptions and emotions and temporal experiences of completiveness, instantaneousness, and repetitiveness – have been characterized as semantically empty and context-dependent. The research reported here tested a simple schematic for the semantic categories of Pastaza Kichwa ideophones by tracking neurological responses to ideophones categorized as VISUAL, MOTION, and SOUND. Seventeen native speakers of Pastaza Kichwa listened to audio clips of ideophones extracted from sentential contexts. Subjects’ neural activity was assessed using functional near-infrared spectroscopy. Results demonstrate that these posited semantic categories activate areas of the brain associated with visualization, motion, and sound processing and production, respectively. This suggests that these ideophones convey semantic information related to these concepts, independent of context. This contrasts with what would be expected by theories suggesting that ideophones on their own are semantically empty. The data give rise to questions regarding whether any language contains only sound ideophones that do not carry additional sensory information and whether ideophones in previous studies treated strictly as sound ideophones might require greater specification of their semantics, specifically from a multisensorial perspective.

Distributional semantic representations were used to investigate crossmodal correspondences within language, offering a comprehensive analysis of how sensory experiences interconnect in linguistic constructs. By computing semantic proximity between words from different sensory modalities, a crossmodal semantic network was constructed, providing a general view of crossmodal correspondences in the English language. Community detection techniques were applied to unveil domains of experience where crossmodal correspondences were likely to manifest, while also considering the role of affective dimensions in shaping these domains. The study revealed the existence of an architecture of structured domains of experience in language, whereby crossmodal correspondences are deeply embedded. The present research highlights the roles of emotion and statistical associations in the organization of sensory concepts across modalities in language. The domains identified, including food, the body, the physical world and emotions/values, underscored the intricate interplay between the senses, emotion and semantic patterns. These findings align with the embodied lexicon hypothesis and the semantic coding hypothesis, emphasizing the capacity of language to capture and reflect crossmodal correspondences’ emotional and perceptual subtleties in the form of networks, while also revealing opportunities for further perceptual research on crossmodal correspondences and multisensory integration.

In discourse comprehension, if all goes well, people tend to create a rich and coherent mental representation of the events described in the text. To do so, referential and relational coherence must be established in order to construct a connected discourse. The objective of this follow-up eye-tracking study (N = 72) is to explore the existence of an interaction effect between two factors: (a) the extension of the referent (short and long antecedent), and (b) the semantic relation (counter-argumentative a pesar de, and causal por), when processing the neuter pronoun ello in texts written in Spanish. No previous study has systematically compared the on-line processing of texts in which different extensions of the encapsulated anaphoric antecedent by the neuter pronoun ello (‘this’ or ‘it’ in English) are presented in diverse marked semantic relations (causal and counter-argumentative). Based on three eye-tracking measures, we found distinctive patterns of reading behavior when anaphoric neuter reference and semantic relations must be processed conjointly in order to construct a coherent mental representation. The main findings show that reading longer and more complex antecedents encapsulated by the neutral pronouns ello exerts more cognitive effort in late processing (Look Back measure), particularly when simultaneously and in the same discourse construction there is an explicitly marked counter-argumentative semantic relation. Implications for theories of referential and relational coherence are discussed.

Words can be matched with the concept of sign (correspondence of a signifier to a signified) as long as they act as symbol-words endowed with some semantic self-sufficiency. But in discourse, they lose their wholeness as symbol-words and metamorphose into wording-symbols. They, suddenly, appear as mere signifier entities with a more or less loose allusion to their status as cultural symbols. In discourse, words are no longer signs but tools covering ephemeral collections of neurosemes: the link of the sign breaks as soon as discourse takes over. The referential potential is no longer the schematic meaning issued from culture, but the universe of discourse under construction. This is why any attempt to account for meaning in language must integrate the neural process of meaning creation. It is now established that meaning is not the result of language activity but the result of cognition. However, what language does, via discourse, is to make this meaning communicable. For all these reasons, the task of linguistics should be to investigate the relationship between cognition and linguistic output in order to shed light on all the cognitive traces left within the surface strings. The role of morphosyntax thus has to be re-evaluated in this light.

This study investigated the comprehension of plural morphosyntactic markers and its relationship with numerical comparison abilities in children with Down syndrome (DS). It evaluated 16 Spanish-speaking children with DS (mean verbal mental age = 3;6) and 16 typically developing children with similar receptive vocabulary (mean chronological age = 3;5). Children participated in two preferential looking tasks assessing their abilities to map singular and plural markers to their visual referents and to distinguish one object from more than one. Results showed that both groups of children correctly mapped plural markers to their referents but failed to map singular ones. Furthermore, results also indicated that both groups also looked at collections of more than one object with four objects but not at those with two. The eye movement patterns of children who looked at collections of more than one object suggest a counting-like strategy. These results indicate that comprehension of plural markers of children with DS is similar to that of their typically developing peers; however, it is not related to their numerical abilities.

In this article, I will comment on recent advances in the research on the intersection between language and action. On the basis of the argument proposed by Arbib, I will consider an evolutionary scenario according to which language emerged from a basic imitation mechanism devoted to action representation. I will review more appropriate data in patients who present with gesture and language disorders and add it to behavioral, neurophysiological, and neuroimaging evidence that suggests that specialized sensorimotor circuits underlie action processing and may ultimately even ground complex aspects of language. Finally, in the last part of the article, I will discuss some of the future research on the interwoven processes of production and comprehension that are involved in the predictive mechanisms of action and language.

We apply the largest-chunk segmentation algorithm to texts consisting of syllables as smallest units. The algorithm was proposed in Drienkó (2016, 2017a), where it was used for texts considered to have letters/characters as smallest units. The present study investigates whether the largest chunk segmentation strategy can result in higher precision of boundary inference when syllables are processed rather than characters. The algorithm looks for subsequent largest chunks that occur at least twice in the text, where text means a single sequence of characters, without punctuation or spaces. The results are quantified in terms of four precision metrics: Inference Precision, Alignment Precision, Redundancy, and Boundary Variability. We segment CHILDES texts in four languages: English, Hungarian, Mandarin, and Spanish. The data suggest that syllable-based segmentation enhances inference precision. Thus, our experiments (i) provide further support for the possible role of a cognitive largest-chunk segmentation strategy, and (ii) point to the syllable as a more optimal unit for segmentation than the letter/phoneme/character, (iii) in a cross-linguistic context.

Although there is a large body of research assessing whether exposure to narratives boosts social cognition immediately afterward, not much research has investigated the underlying mechanism of this putative effect. This experiment investigates the possibility that reading a narrative increases social curiosity directly afterward, which might explain the short-term boosts in social cognition reported by some others. We developed a novel measure of state social curiosity and collected data from participants (N = 222) who were randomly assigned to read an excerpt of narrative fiction or expository nonfiction. Contrary to our expectations, we found that those who read a narrative exhibited less social curiosity afterward than those who read an expository text. This result was not moderated by trait social curiosity. An exploratory analysis uncovered that the degree to which texts present readers with social targets predicted less social curiosity. Our experiment demonstrates that reading narratives, or possibly texts with social content in general, may engage and fatigue social-cognitive abilities, causing a temporary decrease in social curiosity. Such texts might also temporarily satisfy the need for social connection, temporarily reducing social curiosity. Both accounts are in line with theories describing how narratives result in better social cognition over the long term.

An open question in research on multimodal figuration is how to mitigate the analyst’s bias in identifying and interpreting metaphor and metonymy; an issue that determines the generalizability of the findings. Little is known about the causes that motivate different annotations. Inter-rater reliability tests are useful to investigate the sources of variation in annotations by independent researchers that can help inform and refine protocols.

Inspired by existing procedures for verbal, visual, and filmic metaphor identification, we formulated instructions to identify multimodal metaphor and metonymy and tested it against a corpus of 21 generic advertisements and 21 genre-specific advertisements (mobile phones). Two independent researchers annotated the advertisements in six rounds. A joint discussion followed each round to consider conflicting annotations and refine the protocol for the ensuing round.

By examining the evolution of inter-rater reliability results, we found that (1) we reached similar levels of agreement for the identification of metaphor and metonymy, although converging on the interpretation of metonymy was more difficult; (2) some genre specificities made it easier to agree on the annotations for mobile advertisements than for the general advertisements; and (3) there was a consistent increase in the kappa scores reaching substantial agreement by the sixth round.

In this study, our objective was to explore the impact of hearing loss on the conceptual system underlying word meaning. We collected perceptual strength norms for 200 Italian words from early deaf individuals with limited or no access to auditory information and compared them to existing norms from hearing individuals. For each word, participants provided perceptual strength ratings for each perceptual modality. Our results revealed a significant reduction of the auditory modality in the norms provided by deaf individuals compared to the hearing population. However, we did not observe an overall decrease in reported perceptual strength. Interestingly, we found a heightened involvement of other sensory modalities accompanied by reduced modality exclusivity in the conceptualization of words, indicating that deaf individuals heavily rely on information coming from the other perceptual modalities to form concepts. These findings suggest that hearing loss leads to a reorganisation of word conceptualization, characterised by increased multisensoriality. Importantly, although diminished, the auditory modality remains present, suggesting that deaf individuals can still infer auditory-associated knowledge about words to some extent.

As word formation can be conceptualized as an act of creativity with considerable space for differences among speakers, we present pilot research aimed at the examination of the role of Big-Five personality domains in the formation of new complex words. The sample consisted of 197 participants who underwent a word formation test and a personality assessment via The Next Big-Five Inventory. The results indicate that when ordinal regression is conducted with an aim of accounting for age and gender, open-mindedness is shown as a potentially important predictor – it positively predicted economy of expression and negatively predicted semantic transparency. Furthermore, a more nuanced approach differentiating three facets of open-mindedness shows that creative imagination predicted semantic transparency positively while esthetic sensitivity predicts semantic transparency negatively (the reverse is true for the economy of expression). These findings provide a promising starting point for future research.

Embodied imagery hypothesis proposes the activation of perceptual-motor systems during language processing. Previous studies primarily used concrete visual stimuli to investigate mental imagery in language processing by native speakers (NSs) and second language (L2) learners, but few studies employed schematic diagrams. The study aims to investigate mental imagery in processing prepositional phrases by English NSs and L2 learners. Using image-schematic diagrams as primes, we examine whether any mental imagery effect is modulated by target preposition (over, in), the abstractness of meaning (spatial, extended), and stimulus onset asynchrony (SOA; 1,040 ms, 2,040 ms). A total of 79 adult L2 learners and 100 NSs of English completed diagram–picture matching and semantic priming phrasal decision tasks. Results revealed interference effects on L2 processing of over phrases and under 2,040 ms SOA, but no such effects were observed in the NS group. The selective interference effects in L2 suggest different mental imagery patterns between L1 and L2 processing, and processing schematic diagram primes requires high cognitive demands, potentially leading to difficulties in integrating visual and linguistic information and making grammaticality judgments. The findings partially validate schematic diagrams as visual representations of concepts and suggest the need for further examination of schematic diagrams with varying degrees of complexity.

Studies on sentence processing in inflectional languages support that syntactic structure building functionally precedes semantic processing. Conversely, most EEG studies of Chinese sentence processing do not support the priority of syntax. One possible explanation is that the Chinese language lacks morphological inflections. Another explanation may be that the presentation of separate sentence components on individual screens in EEG studies disrupts syntactic framework construction during sentence reading. The present study investigated this explanation using a self-paced reading experiment mimicking rapid serial visual presentation in EEG studies and an eye-tracking experiment reflecting natural reading. In both experiments, Chinese ‘ba’ sentences were presented to Chinese young adults in four conditions that differed across the dimensions of syntactic and semantic congruency. Evidence supporting the functional priority of syntax over semantics was limited to only the natural reading context, in which syntactic violations blocked the processing of semantics. Additionally, we observed a later stage of integrating plausible semantics with a failed syntax. Together, our findings extend the functional priority of syntax to the Chinese language and highlight the importance of adopting more ecologically valid methods when investigating sentence reading.

Social hierarchical information impacts language comprehension. Nevertheless, the specific process underlying the integration of linguistic and extralinguistic sources of social hierarchical information has not been identified. For example, the Chinese social hierarchical verb 赡养, /shan4yang3/, ‘support: provide for the needs and comfort of one’s elders’, only allows its Agent to have a lower social status than the Patient. Using eye-tracking, we examined the precise time course of the integration of these semantic selectional restrictions of Chinese social hierarchical verbs and extralinguistic social hierarchical information during natural reading. A 2 (Verb Type: hierarchical vs. non-hierarchical) × 2 (Social Hierarchy Sequence: match vs. mismatch) design was constructed to investigate the effect of the interaction on early and late eye-tracking measures. Thirty-two participants (15 males; age range: 18–24 years) read sentences and judged the plausibility of each sentence. The results showed that violations of semantic selectional restrictions of Chinese social hierarchical verbs induced shorter first fixation duration but longer regression path duration and longer total reading time on sentence-final nouns (NP2). These differences were absent under non-hierarchical conditions. The results suggest that a mismatch between linguistic and extralinguistic social hierarchical information is immediately detected and processed.

The expression of manner has been extensively studied in the case of motion event descriptions, unveiling significant typological differences between satellite-framed and verb-framed languages and cognitive differences between speakers of these languages. However, far from being restricted to this semantic domain, the expression of manner extends to other types of event descriptions and across virtually all verb classes. In this paper, by considering all the means of expressing manner and grounding our research in a domain-independent definition of this component, we investigate the expression and the transfer of manner under high cognitive pressure as evidenced by corpus data from French–English (FE) and English–French (EF) simultaneous interpreting. Unexpectedly, both French and English displayed an overall cross-domain preference for the verbal-lexical coding of manner in event descriptions, while still differing in the degree to which it was favored. In addition, although our study does not allow a direct measure of cognitive load, the FE interpreters transfer more manner from the source to the target speeches than the EF interpreters do, despite high pressure on cognitive resources, supporting the claim that manner can be cognitively more salient and accessible for English than for French speakers, not only in the domain of motion but also at a more general level, potentially in any semantic domain.