scholarly journals Computational mechanisms for neural representation of words

2021 ◽  
Author(s):  
Ze Fu ◽  
Xiaosha Wang ◽  
Xiaoying Wang ◽  
Huichao Yang ◽  
Jiahuan Wang ◽  
...  

A critical way for humans to acquire, represent and communicate information is through language, yet the underlying computation mechanisms through which language contributes to our word meaning representations are poorly understood. We compared three major types of word computation mechanisms from large language corpus (simple co-occurrence, graph-space relations and neural-network-vector-embedding relations) in terms of the association of words’ brain activity patterns, measured by two functional magnetic resonance imaging (fMRI) experiments. Word relations derived from a graph-space representation, and not neural-network-vector-embedding, had unique explanatory power for the neural activity patterns in brain regions that have been shown to be particularly sensitive to language processes, including the anterior temporal lobe (capturing graph-common-neighbors), inferior frontal gyrus, and posterior middle/inferior temporal gyrus (capturing graph-shortest-path). These results were robust across different window sizes and graph sizes and were relatively specific to language inputs. These findings highlight the role of cumulative language inputs in organizing word meaning neural representations and provide a mathematical model to explain how different brain regions capture different types of language-derived information.

2021 ◽  
Author(s):  
Rohan Saha ◽  
Jennifer Campbell ◽  
Janet F. Werker ◽  
Alona Fyshe

Infants start developing rudimentary language skills and can start understanding simple words well before their first birthday. This development has also been shown primarily using Event Related Potential (ERP) techniques to find evidence of word comprehension in the infant brain. While these works validate the presence of semantic representations of words (word meaning) in infants, they do not tell us about the mental processes involved in the manifestation of these semantic representations or the content of the representations. To this end, we use a decoding approach where we employ machine learning techniques on Electroencephalography (EEG) data to predict the semantic representations of words found in the brain activity of infants. We perform multiple analyses to explore word semantic representations in two groups of infants (9-month-old and 12-month-old). Our analyses show significantly above chance decodability of overall word semantics, word animacy, and word phonetics. As we analyze brain activity, we observe that participants in both age groups show signs of word comprehension immediately after word onset, marked by our model's significantly above chance word prediction accuracy. We also observed strong neural representations of word phonetics in the brain data for both age groups, some likely correlated to word decoding accuracy and others not. Lastly, we discover that the neural representations of word semantics are similar in both infant age groups. Our results on word semantics, phonetics, and animacy decodability, give us insights into the evolution of neural representation of word meaning in infants.


2021 ◽  
Vol 12 (1) ◽  
Author(s):  
Meir Meshulam ◽  
Liat Hasenfratz ◽  
Hanna Hillman ◽  
Yun-Fei Liu ◽  
Mai Nguyen ◽  
...  

AbstractDespite major advances in measuring human brain activity during and after educational experiences, it is unclear how learners internalize new content, especially in real-life and online settings. In this work, we introduce a neural approach to predicting and assessing learning outcomes in a real-life setting. Our approach hinges on the idea that successful learning involves forming the right set of neural representations, which are captured in canonical activity patterns shared across individuals. Specifically, we hypothesized that learning is mirrored in neural alignment: the degree to which an individual learner’s neural representations match those of experts, as well as those of other learners. We tested this hypothesis in a longitudinal functional MRI study that regularly scanned college students enrolled in an introduction to computer science course. We additionally scanned graduate student experts in computer science. We show that alignment among students successfully predicts overall performance in a final exam. Furthermore, within individual students, we find better learning outcomes for concepts that evoke better alignment with experts and with other students, revealing neural patterns associated with specific learned concepts in individuals.


2009 ◽  
Vol 21 (10) ◽  
pp. 2007-2018 ◽  
Author(s):  
Marcus Meinzer ◽  
Tobias Flaisch ◽  
Lotte Wilser ◽  
Carsten Eulitz ◽  
Brigitte Rockstroh ◽  
...  

As we age, our ability to select and to produce words changes, yet we know little about the underlying neural substrate of word-finding difficulties in old adults. This study was designed to elucidate changes in specific frontally mediated retrieval processes involved in word-finding difficulties associated with advanced age. We implemented two overt verbal (semantic and phonemic) fluency tasks during fMRI and compared brain activity patterns of old and young adults. Performance during the phonemic task was comparable for both age groups and mirrored by strongly left-lateralized (frontal) activity patterns. On the other hand, a significant drop of performance during the semantic task in the older group was accompanied by additional right (inferior and middle) frontal activity, which was negatively correlated with performance. Moreover, the younger group recruited different subportions of the left inferior frontal gyrus for both fluency tasks, whereas the older participants failed to show this distinction. Thus, functional integrity and efficient recruitment of left frontal language areas seems to be critical for successful word retrieval in old age.


2020 ◽  
Vol 61 (10) ◽  
pp. 1388-1397
Author(s):  
Yi Cheng ◽  
Li Yan ◽  
Liqun Hu ◽  
Hongyun Wu ◽  
Xin Huang ◽  
...  

Background Previous studies have linked high myopia (HM) to brain activity, and the difference between HM and low myopia (LM) can be assessed. Purpose To study the differences in functional networks of brain activity between HM and LM by the voxel-level degree centrality (DC) method. Material and Methods Twenty-eight patients with HM (10 men, 18 women), 18 patients with LM (4 men, 14 women), and 59 healthy controls (27 men, 32 women) were enrolled in this study. The voxel-level DC method was used to assess spontaneous brain activity. Correlation analysis was used to explore the change of average DC value in different brain regions, in order to analyze differences in brain activity between HM and LM. Results DC values of the right cerebellum anterior lobe/brainstem, right parahippocampal gyrus, and left caudate in HM patients were significantly higher than those in LM patients ( P < 0.05). In contrast, DC values of the left medial frontal gyrus, right inferior frontal gyrus, left middle frontal gyrus, and left inferior parietal lobule were significantly lower in patients with HM ( P < 0.05). However, there was no correlation between behavior and average DC values in different brain regions ( P < 0.05). Conclusion Different changes in brain regions between HM and LM may indicate differences in neural mechanisms between HM and LM. DC values could be useful as biomarkers for differences in brain activity between patients with HM and LM. This study provides a new method to assess differences in functional networks of brain activity between patients with HM and LM.


2015 ◽  
Vol 27 (7) ◽  
pp. 1376-1387 ◽  
Author(s):  
Jessica Bulthé ◽  
Bert De Smedt ◽  
Hans P. Op de Beeck

In numerical cognition, there is a well-known but contested hypothesis that proposes an abstract representation of numerical magnitude in human intraparietal sulcus (IPS). On the other hand, researchers of object cognition have suggested another hypothesis for brain activity in IPS during the processing of number, namely that this activity simply correlates with the number of visual objects or units that are perceived. We contrasted these two accounts by analyzing multivoxel activity patterns elicited by dot patterns and Arabic digits of different magnitudes while participants were explicitly processing the represented numerical magnitude. The activity pattern elicited by the digit “8” was more similar to the activity pattern elicited by one dot (with which the digit shares the number of visual units but not the magnitude) compared to the activity pattern elicited by eight dots, with which the digit shares the represented abstract numerical magnitude. A multivoxel pattern classifier trained to differentiate one dot from eight dots classified all Arabic digits in the one-dot pattern category, irrespective of the numerical magnitude symbolized by the digit. These results were consistently obtained for different digits in IPS, its subregions, and many other brain regions. As predicted from object cognition theories, the number of presented visual units forms the link between the parietal activation elicited by symbolic and nonsymbolic numbers. The current study is difficult to reconcile with the hypothesis that parietal activation elicited by numbers would reflect a format-independent representation of number.


2015 ◽  
Vol 2015 ◽  
pp. 1-11 ◽  
Author(s):  
Yu-Chen Chen ◽  
Jian Zhang ◽  
Xiao-Wei Li ◽  
Wenqing Xia ◽  
Xu Feng ◽  
...  

Objective. Subjective tinnitus is hypothesized to arise from aberrant neural activity; however, its neural bases are poorly understood. To identify aberrant neural networks involved in chronic tinnitus, we compared the resting-state functional magnetic resonance imaging (fMRI) patterns of tinnitus patients and healthy controls.Materials and Methods. Resting-state fMRI measurements were obtained from a group of chronic tinnitus patients (n=29) with normal hearing and well-matched healthy controls (n=30). Regional homogeneity (ReHo) analysis and functional connectivity analysis were used to identify abnormal brain activity; these abnormalities were compared to tinnitus distress.Results. Relative to healthy controls, tinnitus patients had significant greater ReHo values in several brain regions including the bilateral anterior insula (AI), left inferior frontal gyrus, and right supramarginal gyrus. Furthermore, the left AI showed enhanced functional connectivity with the left middle frontal gyrus (MFG), while the right AI had enhanced functional connectivity with the right MFG; these measures were positively correlated with Tinnitus Handicap Questionnaires (r=0.459,P=0.012andr=0.479,P=0.009, resp.).Conclusions. Chronic tinnitus patients showed abnormal intra- and interregional synchronization in several resting-state cerebral networks; these abnormalities were correlated with clinical tinnitus distress. These results suggest that tinnitus distress is exacerbated by attention networks that focus on internally generated phantom sounds.


2022 ◽  
Author(s):  
Tie Sun ◽  
Hui-Ye Shu ◽  
Jie-Li Wu ◽  
Ting Su ◽  
Yu-Ji Liu ◽  
...  

Objective: The local characteristics of spontaneous brain activity in patients with dry eye (DE) and its relationship with clinical characteristics were evaluated using the amplitude of low-frequency fluctuations (ALFF) method. Methods: A total of 27 patients with DE (10 males and 17 females) and 28 healthy controls (HCs) (10 males and 18 females) were recruited, matched according to sex, age, weight, and height, classified into the DE and HC groups, and examined using functional magnetic resonance imaging scans. Spontaneous brain activity changes were recorded using ALFF technology. Data were recorded and plotted on the receiver operating characteristic curve, reflecting changes in activity in different brain areas. Finally, Pearson correlation analysis was used to calculate the potential relationship between spontaneous brain activity abnormalities in multiple brain regions and clinical features in patients with DE. GraphPad Prism 8 (GraphPad Software, Inc.) was used to analyze the linear correlation between the Hospital Anxiety and Depression Scale and ALFF value. Results: Compared with HCs, the ALFF values of patients with DE were decreased in the right middle frontal gyrus/right inferior orbitofrontal cortex, left triangle inferior frontal gyrus, left middle frontal gyrus, and right superior frontal gyrus. In contrast, the ALFF value of patients with DE was increased in the left calcarine. Conclusion: There are significant fluctuations in the ALFF value of specific brain regions in patients with DE versus HCs. This corroborates previous evidence showing that the symptoms of ocular surface damage in patients with DE are related to dysfunction in specific brain areas.


Author(s):  
Maria Tsantani ◽  
Nikolaus Kriegeskorte ◽  
Katherine Storrs ◽  
Adrian Lloyd Williams ◽  
Carolyn McGettigan ◽  
...  

AbstractFaces of different people elicit distinct functional MRI (fMRI) patterns in several face-selective brain regions. Here we used representational similarity analysis to investigate what type of identity-distinguishing information is encoded in three face-selective regions: fusiform face area (FFA), occipital face area (OFA), and posterior superior temporal sulcus (pSTS). We used fMRI to measure brain activity patterns elicited by naturalistic videos of famous face identities, and compared their representational distances in each region with models of the differences between identities. Models included low-level to high-level image-computable properties and complex human-rated properties. We found that the FFA representation reflected perceived face similarity, social traits, and gender, and was well accounted for by the OpenFace model (deep neural network, trained to cluster faces by identity). The OFA encoded low-level image-based properties (pixel-wise and Gabor-jet dissimilarities). Our results suggest that, although FFA and OFA can both discriminate between identities, the FFA representation is further removed from the image, encoding higher-level perceptual and social face information.


2018 ◽  
Author(s):  
Paloma Díaz-Gutiérrez ◽  
Juan E. Arco ◽  
Sonia Alguacil ◽  
Carlos González-García ◽  
María Ruz

AbstractPrior personal information is highly relevant during social interactions. Such knowledge aids in the prediction of others, and it affects choices even when it is unrelated to actual behaviour. In this investigation, we aimed to study the neural representation of positive and negative personal expectations, how these impact subsequent choices, and the effect of mismatches between expectations and encountered behaviour. We employed functional Magnetic Resonance Imaging in combination with a version of the Ultimatum Game (UG) where participants were provided with information about their partners’ moral traits previous to their fair or unfair offers. Univariate and multivariate analyses revealed the implication of the supplementary motor area (SMA) and inferior frontal gyrus (IFG) in the representation of expectations about the partners in the game. Further, these regions also represented the valence of expectations, together with the ventromedial prefrontal cortex (vmPFC). Importantly, the performance of multivariate classifiers in these clusters correlated with a behavioural choice bias to accept more offers following positive descriptions, highlighting the impact of the valence on the expectations on participants’ economic decisions. Altogether, our results suggest that expectations based on social information guide future interpersonal decisions and that the neural representation of such expectations in the vmPFC is related to their influence on behaviour.


2021 ◽  
Author(s):  
Yoshiharu Ikutani ◽  
Takeshi D. Itoh ◽  
Takatomi Kubo

AbstractThe understanding of brain activity during program comprehension have advanced thanks to noninvasive neuroimaging techniques, such as functional magnetic resonance imaging (fMRI). However, individual neuroimaging studies of program comprehension often provided inconsistent results and made it difficult to identify the neural bases. To identify the essential brain regions, this study performed a small meta-analysis on recent fMRI studies of program comprehension using multilevel kernel density analysis (MKDA). Our analysis identified a set of brain regions consistently activated in various program comprehension tasks. These regions consisted of three clusters, each of which centered at the left inferior frontal gyrus pars triangularis (IFG Tri), posterior part of middle temporal gyrus (pMTG), and right middle frontal gyrus (MFG). Additionally, subsequent analyses revealed relationships among the activation patterns in the previous studies and multiple cognitive functions. These findings suggest that program comprehension mainly recycles the language-related networks and partially employs other domain-general resources in the human brain.


Sign in / Sign up

Export Citation Format

Share Document