scholarly journals From Affordances to Abstract Words: The Flexibility of Sensorimotor Grounding

2021 ◽  
Vol 11 (10) ◽  
pp. 1304
Author(s):  
Claudia Mazzuca ◽  
Chiara Fini ◽  
Arthur Henri Michalland ◽  
Ilenia Falcinelli ◽  
Federico Da Rold ◽  
...  

The sensorimotor system plays a critical role in several cognitive processes. Here, we review recent studies documenting this interplay at different levels. First, we concentrate on studies that have shown how the sensorimotor system is flexibly involved in interactions with objects. We report evidence demonstrating how social context and situations influence affordance activation, and then focus on tactile and kinesthetic components in body–object interactions. Then, we turn to word use, and review studies that have shown that not only concrete words, but also abstract words are grounded in the sensorimotor system. We report evidence that abstract concepts activate the mouth effector more than concrete concepts, and discuss this effect in light of studies on adults, children, and infants. Finally, we pinpoint possible sensorimotor mechanisms at play in the acquisition and use of abstract concepts. Overall, we show that the involvement of the sensorimotor system is flexibly modulated by context, and that its role can be integrated and flanked by that of other systems such as the linguistic system. We suggest that to unravel the role of the sensorimotor system in cognition, future research should fully explore the complexity of this intricate, and sometimes slippery, relation.

Author(s):  
Claudia Mazzuca ◽  
Chiara Fini ◽  
Arthur Henri Michalland ◽  
Ilenia Falcinelli ◽  
Federico Da Rold ◽  
...  

Recent research has shown that the sensorimotor system plays a significant role in a variety of cognitive processes. In this paper, we will review recent studies performed in our lab (Body Action Language Lab, BALLAB) or in labs with which we collaborate, showing the involvement of the sensorimotor system at different levels. With the purpose of expounding on this aspect, we focus on studies that highlight two main characteristics of the involvement of the sensorimotor systems. First, we concentrate on the flexibility of sensorimotor grounding during interaction with objects. We report evidence showing how social context and current situations influence affordance activation. We then focus on the tactile and kinesthetic involvement in body-object interaction. Second, we illustrate flexible sensorimotor grounding in word use. We review studies showing that not only concrete words, like “bottle,” but also abstract words, like “freedom,” “thinking,” and “perhaps,” are grounded in the sensorimotor system. We report evidence showing that abstract words activate sensory modalities and involve the mouth effector more than concrete words due to their privileged relationship with language, both outer and inner speech. We discuss the activation of the mouth sensorimotor system in light of studies on adults (e.g., studies employing articulatory suppression), children (e.g., studies on the effects of pacifier use on word acquisition and processing), and infants (e.g. studies on emergence of new words). Finally, we pinpoint possible mechanisms at play in the acquisition and use of abstract concepts. We argue that with abstract concepts, we rely more on other people to learn or negotiate the meaning of words; we have called this mechanism social metacognition.Social metacognition is bidirectionally linked to our sensorimotor system. On the one hand, linguistic explanations constitute a primary source of grounding that may be re-enacted when retrieving a concept, for example through inner speech. On the other hand, it leads us to feel closer and be more synchronous in movement with others, who can help us understand the meaning of very complex words. Overall, we show that the sensorimotor system provides a grounding basis not only for objects and concrete words but also for more abstract and concrete ones. We conclude by arguing that future research should address and deepen two different and interrelated aspects concerning the involvement of the sensorimotor system during object and word processing. First, the sensorimotor system is flexibly modulated by the context, as studies on affordances reveal. Second, the sensorimotor system can be involved at different levels, and its role can be integrated and flanked by that of other systems, like the linguistic one, as studies on abstract concepts clearly show. We urge future research aimed at unravelling the role of the sensorimotor system in cognition to fully explore the complexity of this intricate-and sometimes slippery-relation.


2021 ◽  
pp. 174702182110536
Author(s):  
Chiara Fini ◽  
Gian Daniele Zannino ◽  
Matteo Orsoni ◽  
Giovanni Augusto Carlesimo ◽  
Mariagrazia Benassi ◽  
...  

Compared to concrete concepts, like “book”, abstract concepts expressed by words like “justice” are more detached from sensorial experiences, even though they are also grounded in sensorial modalities. Abstract concepts lack a single object as referent and are characterized by higher variability both within and across participants. According to the Word as Social Tool (WAT) proposal, owing to their complexity, abstract concepts need to be processed with the help of inner language. Inner language can namely help participants to re-explain to themselves the meaning of the word, to keep information active in working memory, and to prepare themselves to ask information from more competent people. While previous studies have demonstrated that the mouth is involved during abstract concepts’ processing, both the functional role and the mechanisms underlying this involvement still need to be clarified. We report an experiment in which participants were required to evaluate whether 78 words were abstract or concrete by pressing two different pedals. During the judgment task, they were submitted, in different blocks, to a baseline, an articulatory suppression, and a manipulation condition. In the last two conditions, they had to repeat a syllable continually and to manipulate a softball with their dominant hand. Results showed that articulatory suppression slowed down the processing of abstract more than that of concrete words. Overall results confirm the WAT proposal’s hypothesis that abstract concepts processing involves the mouth motor system and specifically inner speech. We discuss the implications for current theories of conceptual representation.


2016 ◽  
Vol 6 (3) ◽  
pp. 121-126 ◽  
Author(s):  
Svetlana Anatolyevna Osokina

The purpose of the paper is to prove that for a child the system of abstract concepts grows from the “material work” with the language. Using the case study method to a particular child we prove that little children can use rather complicated abstract words without knowing the concepts of these words. Children may use such words in proper grammar forms and correct collocations but they can’t explain the meaning of the words or give wrong explanation. It makes us think that in language acquisition process the language knowledge system is being developed earlier than the conceptual system of words meaning but we must understand what language knowledge consists of in this case and what it actually is. Implications for future research include further study of language knowledge system as having its own value independently from concept system of knowledge. Keywords: language acquisition, infant speech, language knowledge system, case study.


2018 ◽  
Author(s):  
Claudia Mazzuca ◽  
Luisa Lugli ◽  
Roberto Nicoletti ◽  
Anna M Borghi

According to embodied and grounded theories concepts are grounded in sensorimotor systems. The majority of evidence supporting these views concerns concepts referring to objects or actions, while evidence on abstract concepts is more scarce. Explaining how abstract concepts, as “freedom”, are represented, would however be pivotal for grounded theories. According to some recent proposals, abstract concepts are grounded evoking both sensorimotor and linguistic experience, thus activating the mouth motor system more than concrete concepts. Two experiments are reported, aimed at verifying whether abstract, concrete and emotional words activate the mouth and hand effectors. In both experiments participants performed first a lexical decision, then a recognition task. In Experiment 1 participants responded by pressing a button either with the mouth or with the hand, in Experiment 2 responses were given with the foot, while a button held either in the mouth or in the hand was used to respond to catch-trials. Abstract words were slower to process in both tasks (concreteness effect). Across the tasks and experiments, emotional concepts had instead a fluctuating pattern, different from those of both concrete and abstract concepts, suggesting that they cannot be considered as a subset of abstract concepts. The interaction between kind of concept (abstract, concrete and emotional) and effector (mouth, hand) was not significant in the lexical decision task, likely because it emerged only with tasks implying a deeper processing level. It reached significance, instead, in the accuracy analyses of the recognition tasks. In both experiments abstract concepts yielded less errors in the mouth than in the hand condition, supporting our main prediction. Emotional concepts had instead a more variable pattern. Overall, our findings indicate that different kinds of concepts differently activate the mouth and hand effectors, but they also suggests that concepts activate effectors in a flexible and task-dependent way.


2021 ◽  
Vol 11 (17) ◽  
pp. 8241
Author(s):  
Erhan Sezerer ◽  
Selma Tekir

Over the last few years, there has been an increase in the studies that consider experiential (visual) information by building multi-modal language models and representations. It is shown by several studies that language acquisition in humans starts with learning concrete concepts through images and then continues with learning abstract ideas through the text. In this work, the curriculum learning method is used to teach the model concrete/abstract concepts through images and their corresponding captions to accomplish multi-modal language modeling/representation. We use the BERT and Resnet-152 models on each modality and combine them using attentive pooling to perform pre-training on the newly constructed dataset, which is collected from the Wikimedia Commons based on concrete/abstract words. To show the performance of the proposed model, downstream tasks and ablation studies are performed. The contribution of this work is two-fold: A new dataset is constructed from Wikimedia Commons based on concrete/abstract words, and a new multi-modal pre-training approach based on curriculum learning is proposed. The results show that the proposed multi-modal pre-training approach contributes to the success of the model.


Author(s):  
Malte R. Henningsen-Schomers ◽  
Friedemann Pulvermüller

AbstractA neurobiologically constrained deep neural network mimicking cortical areas relevant for sensorimotor, linguistic and conceptual processing was used to investigate the putative biological mechanisms underlying conceptual category formation and semantic feature extraction. Networks were trained to learn neural patterns representing specific objects and actions relevant to semantically ‘ground’ concrete and abstract concepts. Grounding sets consisted of three grounding patterns with neurons representing specific perceptual or action-related features; neurons were either unique to one pattern or shared between patterns of the same set. Concrete categories were modelled as pattern triplets overlapping in their ‘shared neurons’, thus implementing semantic feature sharing of all instances of a category. In contrast, abstract concepts had partially shared feature neurons common to only pairs of category instances, thus, exhibiting family resemblance, but lacking full feature overlap. Stimulation with concrete and abstract conceptual patterns and biologically realistic unsupervised learning caused formation of strongly connected cell assemblies (CAs) specific to individual grounding patterns, whose neurons were spread out across all areas of the deep network. After learning, the shared neurons of the instances of concrete concepts were more prominent in central areas when compared with peripheral sensorimotor ones, whereas for abstract concepts the converse pattern of results was observed, with central areas exhibiting relatively fewer neurons shared between pairs of category members. We interpret these results in light of the current knowledge about the relative difficulty children show when learning abstract words. Implications for future neurocomputational modelling experiments as well as neurobiological theories of semantic representation are discussed.


2017 ◽  
Vol 2017 ◽  
pp. 1-8 ◽  
Author(s):  
Maria Luisa Lorusso ◽  
Michele Burigo ◽  
Alessandro Tavano ◽  
Anna Milani ◽  
Sara Martelli ◽  
...  

It has been shown that abstract concepts are more difficult to process and are acquired later than concrete concepts. We analysed the percentage of concrete words in the narrative lexicon of individuals with Williams Syndrome (WS) as compared to individuals with Down Syndrome (DS) and typically developing (TD) peers. The cognitive profile of WS is characterized by visual-spatial difficulties, while DS presents with predominant impairments in linguistic abilities. We predicted that if linguistic abilities are crucial to the development and use of an abstract vocabulary, DS participants should display a higher concreteness index than both Williams Syndrome and typically developing individuals. Results confirm this prediction, thus supporting the hypothesis of a crucial role of linguistic processes in abstract language acquisition. Correlation analyses suggest that a maturational link exists between the level of abstractness in narrative production and syntactic comprehension.


2021 ◽  
Author(s):  
Linda Espey ◽  
Marta Ghio ◽  
Christian Bellebaum ◽  
Laura Bechtold

This study aimed to investigate the acquisition and representation of novel abstract concepts grounded in linguistic and emotional experience. In five linguistic training sessions, participants learned emotional and neutral abstract concepts and either engaged in explicit mental imagery (n = 32) or lexico-semantic processing (n = 34) with the linguistic material. After training, a high lexical decision and semantic judgment accuracy showed that participants successfully acquired the novel concepts. A feature production task showed that emotional concepts were generally enriched by a surplus of (emotion) features, and neutral concepts by relatively more cognition features. More features led to a higher LDT accuracy but not to faster reactions, which cannot be fully explained by noise due to the online assessment as, descriptively, more features slowed down reactions in participants, who did the imagery task and accelerated them for those, who did the rephrasing task. Our findings support the notion that linguistic and emotional information are crucial for grounding abstract concepts, and that this grounding does not rely on explicit imagery. Future research might combine the linguistic training paradigm with controlled reaction time and electrophysiological measurements to further corroborate the experiential grounding of abstract words.


2018 ◽  
Author(s):  
Claudia Mazzuca ◽  
Luisa Lugli ◽  
Roberto Nicoletti ◽  
Anna M Borghi

According to embodied and grounded theories concepts are grounded in sensorimotor systems. The majority of evidence supporting these views concerns concepts referring to objects or actions, while evidence on abstract concepts is more scarce. Explaining how abstract concepts, as “freedom”, are represented, would however be pivotal for grounded theories. According to some recent proposals, abstract concepts are grounded evoking both sensorimotor and linguistic experience, thus activating the mouth motor system more than concrete concepts. Two experiments are reported, aimed at verifying whether abstract, concrete and emotional words activate the mouth and hand effectors. In both experiments participants performed first a lexical decision, then a recognition task. In Experiment 1 participants responded by pressing a button either with the mouth or with the hand, in Experiment 2 responses were given with the foot, while a button held either in the mouth or in the hand was used to respond to catch-trials. Abstract words were slower to process in both tasks (concreteness effect). Across the tasks and experiments, emotional concepts had instead a fluctuating pattern, different from those of both concrete and abstract concepts, suggesting that they cannot be considered as a subset of abstract concepts. The interaction between kind of concept (abstract, concrete and emotional) and effector (mouth, hand) was not significant in the lexical decision task, likely because it emerged only with tasks implying a deeper processing level. It reached significance, instead, in the accuracy analyses of the recognition tasks. In both experiments abstract concepts yielded less errors in the mouth than in the hand condition, supporting our main prediction. Emotional concepts had instead a more variable pattern. Overall, our findings indicate that different kinds of concepts differently activate the mouth and hand effectors, but they also suggests that concepts activate effectors in a flexible and task-dependent way.


PeerJ ◽  
2018 ◽  
Vol 6 ◽  
pp. e5987 ◽  
Author(s):  
Claudia Mazzuca ◽  
Luisa Lugli ◽  
Mariagrazia Benassi ◽  
Roberto Nicoletti ◽  
Anna M. Borghi

According to embodied and grounded theories, concepts are grounded in sensorimotor systems. The majority of evidence supporting these views concerns concepts referring to objects or actions, while evidence on abstract concepts is more scarce. Explaining how abstract concepts such as “freedom” are represented would thus be pivotal for grounded theories. According to some recent proposals, abstract concepts are grounded in both sensorimotor and linguistic experience, thus they activate the mouth motor system more than concrete concepts. Two experiments are reported, aimed at verifying whether abstract, concrete and emotional words activate the mouth and the hand effectors. In both experiments participants performed first a lexical decision, then a recognition task. In Experiment 1 participants responded by pressing a button either with the mouth or with the hand, in Experiment 2 responses were given with the foot, while a button held either in the mouth or in the hand was used to respond to catch-trials. Abstract words were slower to process in both tasks (concreteness effect). Across the tasks and experiments, emotional concepts had instead a fluctuating pattern, different from those of both concrete and abstract concepts, suggesting that they cannot be considered as a subset of abstract concepts. The interaction between type of concept (abstract, concrete and emotional) and effector (mouth, hand) was not significant in the lexical decision task, likely because it emerged only with tasks implying a deeper processing level. It reached significance, instead, in the recognition tasks. In both experiments abstract concepts were facilitated in the mouth condition compared to the hand condition, supporting our main prediction. Emotional concepts instead had a more variable pattern. Overall, our findings indicate that various kinds of concepts differently activate the mouth and hand effectors, but they also suggest that concepts activate effectors in a flexible and task-dependent way.


Sign in / Sign up

Export Citation Format

Share Document