Quantifying children's sensorimotor experience: Child body-object interaction ratings for 3,359 English words

Body-object interaction (BOI) ratings measure how easily the human body can physically interact with a word's referent. Previous research has found that words higher in BOI tend to be processed more quickly and accurately in tasks such as lexical decision, semantic decision, and syntactic classification, suggesting that sensorimotor information is an important aspect of lexical knowledge. However, limited research has examined the importance of sensorimotor information from a developmental perspective. One barrier to addressing such theoretical questions has been a lack of semantic dimension ratings that take into account child sensorimotor experience. The goal of the current study was to collect Child BOI rating norms. Parents of children aged 5 – 9-years-old were asked to rate words according to how easily an average 6-year-old child can interact with each word’s referent. The relationships of Child and Adult BOI ratings with other lexical semantic dimensions were assessed, as well as the relationships of Child and Adult BOI ratings with age of acquisition. Child BOI ratings were more strongly related to valence and sensory experience ratings than Adult BOI ratings and were a better predictor of three different measures of age of acquisition. The results suggest that child-centric ratings such as those reported here provide a more sensitive measure of children’s experience that can be used to address theoretical questions in embodied cognition from a developmental perspective.

Does Embodiment of Verbs Influence Predicate Metaphor Processing in a Second Language? Evidence From Picture Priming

Distinct from nominal metaphors, predicate metaphors entail metaphorical abstraction from concrete verbs, which generally involve more action and stronger motor simulation than nouns. It remains unclear whether and how the concrete, embodied aspects of verbs are connected with abstract, disembodied thinking in the brains of L2 learners. Since English predicate metaphors are unfamiliar to Chinese L2 learners, the study of embodiment effect on English predicate metaphor processing may provide new evidence for embodied cognition and categorization models that remain controversial, and offer practical insights into L2 metaphor processing and pedagogy. Hence, we aim to investigate whether the embodiment of verbs, via the activation of sensorimotor information, influences two groups of L2 learners during their comprehension of conventional and novel predicate metaphors. The results show a significant effect of embodiment: a stronger facilitation for novel predicate metaphors in both higher-level and lower-level groups, and a weaker facilitation for conventional predicate metaphors in the lower-level group. The findings demonstrate preliminary evidence for a graded effect of embodiment on predicate metaphors processing, modulated by L2 proficiency and metaphor novelty. The study supports a hybrid view of embodied cognition and reveals that sensorimotor aspects of verbs may be the intermediate entity involved in the indirect categorization.

Beta-frequency electrophysiological bursts: BOLD correlates and relationships with psychotic illness

AimsTo identify the BOLD (blood oxygenation level dependent) correlates of bursts of beta frequency band electrophysiological activity, and to compare BOLD responses between healthy controls and patients with psychotic illness.The post movement beta rebound (PMBR) is a transient increase in power in the beta frequency band (13-30 Hz), recorded with methods such as electroencephalography (EEG), following the completion of a movement. PMBR size is reduced in patients with schizophrenia and inversely correlated with severity of illness. PMBR size is inversely correlated with measures of schizotypy in non-clinical groups. Therefore, beta-band activity may reflect a fundamental neural process whose disruption plays an important role in the pathophysiology of schizophrenia. Recent work has found that changes in beta power reflect changes in the probability-of-occurrence of transient bursts of beta-frequency activity. Understanding the generators of beta bursts could help unravel the pathophysiology of psychotic illness and thus identify novel treatment targets.MethodEEG data were recorded simultaneously with BOLD data measured with 3T functional magnetic resonance imaging (fMRI), whilst participants performed an n-back working memory task. We included seventy-eight participants – 32 patients with schizophrenia, 16 with bipolar disorder and 30 healthy controls. Beta bursts were identified in the EEG data using a thresholding method and burst timings were used as markers in an event-related fMRI design convolved with a conventional haemodynamic response function. A region of interest analysis compared beta-event-related BOLD activity between patients and controls.ResultBeta bursts phasically activated brain regions implicated in coding task-relevant content (specifically, regions involved in the phonological representation of letter stimuli, as well as areas representing motor responses). Further, bursts were associated with suppression of tonically-active regions. In the EEG, PMBR was greater in controls than patients, and, in patients, PMBR size was positively correlated with Global Assessment of Functioning scores, and negatively correlated with persisting symptoms of disorganisation and performance on a digit symbol substition test. Despite this, patients showed greater, more extensive, burst-related BOLD activation than controls.ConclusionOur findings are consistent with a recent model in which beta bursts serve to reactivate latently-maintained, task-relevant, sensorimotor information. The increased BOLD response associated with bursts in patients, despite reduced PMBR, could reflect inefficiency of burst-mediated cortical synchrony, or it may suggest that the sensorimotor information reactivated by beta bursts is less precisely specified in psychosis. We propose that dysfunction of the mechanisms by which beta bursts reactivate task-relevant content can manifest as disorganisation and working memory deficits, and may contribute to persisting symptoms and impairment in psychosis.

Fine Motor Skills and Lexical Processing in Children and Adults

Children’s fine motor skills (FMS) link to cognitive development, however, research on their involvement in language processing, also with adults, is scarce. Lexical items are processed differently depending on the degree of sensorimotor information inherent in the words’ meanings, such as whether these imply a body-object interaction (BOI) or a body-part association (i.e., hand, arm, mouth, foot). Accordingly, three studies examined whether lexical processing was affected by FMS, BOIness, and body-part associations in children (study 1, n = 77) and adults (study 2, n = 80; study 3, n = 71). Analyses showed a differential link between FMS and lexical processing as a function of age. Whereas response latencies indicated that children’s FMS were associated with “hand” words, adults’ FMS linked to the broader concept of BOI. Findings have implications for shared activation theories positing that FMS support lexical processing.

Simulating Semantics: Are Individual Differences in Motor Imagery Related to Sensorimotor Effects in Language Processing?

In embodied theories of semantic representation, the processes and mechanisms of modal simulations that are engaged during semantic processing have tended to be under-specified. We investigated the possibility that motor imagery may be a mechanism of simulation, using an individual differences approach. In this pre-registered study, we assessed motor imagery abilities (n = 161) with implicit and explicit measures and identified two latent factors. We then examined whether those factors account for significant variations in sensorimotor effects observed in three different language tasks: a lexical decision task, syntactic classification task, and sentence-picture verification task. In the language tasks, when all participants were considered together, we replicated some previously reported sensorimotor effects (e.g., body-object interaction, BOI, effects in semantic processing, wherein words associated with more sensorimotor information were processed more quickly than words associated with less sensorimotor information) and did not replicate others (e.g., BOI effects in the LDT, congruency effects in SPVT). There were no significant relationships between imagery factor scores and sensorimotor effects. A follow-up analysis using scores from each motor imagery measure revealed a significant interaction between hand movement imagery and BOI effects in the syntactic classification task, with those higher in this imagery ability showing a larger BOI effect. This latter result may suggest that specific types of motor imagery are related to sensorimotor effects in semantic processing, however further investigation is needed. In general, our findings provide little support for the possibility that motor imagery is an underlying mechanism of sensorimotor simulation during language processing.

Language Increases Working Memory Capacity for Object Concepts

[Draft version, 04/03/21. This paper has not been peer reviewed. Please do not copy or cite without author's permission] The linguistic-simulation approach to cognition predicts that language can enable more efficient conceptual processing than purely sensorimotor-affective simulations of concepts. We tested the implications of this approach in working memory, where use of linguistic labels (i.e., words and phrases) could enable more efficient representation of concepts in a limited-capacity store than representation via full sensorimotor simulation; a proposal called linguistic bootstrapping. In four pre-registered experiments using a nonverbal recognition memory paradigm, we asked participants to remember sequences of real-world objects, and used articulatory suppression to selectively block implicit activation of linguistic labels, which we predicted would impair object memory performance. We found that blocking access to language at encoding impaired memory accuracy, though not latency, and that this impairment was not simply dual-task load. Results show that a sequence of up to 10 contextually-situated object concepts can be held in working memory when language is blocked, but this capacity increases to 12 objects when language is available. The findings support the linguistic bootstrapping hypothesis that working memory for familiar object concepts normally relies on language, and that implicitly-retrieved object labels, used as linguistic placeholders, enhance the achievable capacity of working memory beyond what sensorimotor information alone can accomplish.

How using brain-machine interfaces influences the human sense of agency

Brain-machine interfaces (BMI) allows individuals to control an external device by controlling their own brain activity, without requiring bodily or muscle movements. Performing voluntary movements is associated with the experience of agency (“sense of agency”) over those movements and their outcomes. When people voluntarily control a BMI, they should likewise experience a sense of agency. However, using a BMI to act presents several differences compared to normal movements. In particular, BMIs lack sensorimotor feedback, afford lower controllability and are associated with increased cognitive fatigue. Here, we explored how these different factors influence the sense of agency across two studies in which participants learned to control a robotic hand through motor imagery decoded online through electroencephalography. We observed that the lack of sensorimotor information when using a BMI did not appear to influence the sense of agency. We further observed that experiencing lower control over the BMI reduced the sense of agency. Finally, we observed that the better participants controlled the BMI, the greater was the appropriation of the robotic hand, as measured by body-ownership and agency scores. Results are discussed based on existing theories on the sense of agency in light of the importance of BMI technology for patients using prosthetic limbs.