Measuring distribution in distributed representations

1996 ◽  
Vol 3 (2) ◽  
pp. 73-79 ◽  
Author(s):  
Antony Browne
Keyword(s):  
Distributed Representations

scholarly journals Neural Components of Reading Revealed by Distributed and Symbolic Computational Models

2020 ◽  
Vol 1 (4) ◽  
pp. 381-401
Author(s):  
Ryan Staples ◽  
William W. Graves
Keyword(s):  
Neural Activity ◽  
Neural Coding ◽  
Computational Models ◽  
Ann Model ◽  
Distributed Representations ◽  
Neural Data ◽  
Cognitive Components ◽  
Components Of Reading ◽  
Artificial Neural Network Ann ◽  
Models Of Reading

Determining how the cognitive components of reading—orthographic, phonological, and semantic representations—are instantiated in the brain has been a long-standing goal of psychology and human cognitive neuroscience. The two most prominent computational models of reading instantiate different cognitive processes, implying different neural processes. Artificial neural network (ANN) models of reading posit nonsymbolic, distributed representations. The dual-route cascaded (DRC) model instead suggests two routes of processing, one representing symbolic rules of spelling–to–sound correspondence, the other representing orthographic and phonological lexicons. These models are not adjudicated by behavioral data and have never before been directly compared in terms of neural plausibility. We used representational similarity analysis to compare the predictions of these models to neural data from participants reading aloud. Both the ANN and DRC model representations corresponded to neural activity. However, the ANN model representations correlated to more reading-relevant areas of cortex. When contributions from the DRC model were statistically controlled, partial correlations revealed that the ANN model accounted for significant variance in the neural data. The opposite analysis, examining the variance explained by the DRC model with contributions from the ANN model factored out, revealed no correspondence to neural activity. Our results suggest that ANNs trained using distributed representations provide a better correspondence between cognitive and neural coding. Additionally, this framework provides a principled approach for comparing computational models of cognitive function to gain insight into neural representations.

Distributed Representations of Diseases based on Co-occurrence Relationship

2021 ◽  
pp. 115418
Author(s):  
Haoqing Wang ◽  
Huiyu Mai ◽  
Zhi-hong Deng ◽  
Chao Yang ◽  
Luxia Zhang ◽  
...  
Keyword(s):  
Distributed Representations

Fake News Detection Using Recurrent Neural Networks and Distributed Representations for the Portuguese Language

2021 ◽  
Author(s):  
Guilherme Zanini Moreira ◽  
Marcelo Romero ◽  
Manassés Ribeiro
Keyword(s):  
Neural Networks ◽  
Recurrent Neural Networks ◽  
Short Term Memory ◽  
Classification Performance ◽  
Fake News ◽  
Distributed Representations ◽  
Memory Network ◽  
Long Short Term Memory ◽  
Media Channels ◽  
Damage Rule

After the advent of Web, the number of people who abandoned traditional media channels and started receiving news only through social media has increased. However, this caused an increase of the spread of fake news due to the ease of sharing information. The consequences are various, with one of the main ones being the possible attempts to manipulate public opinion for elections or promotion of movements that can damage rule of law or the institutions that represent it. The objective of this work is to perform fake news detection using Distributed Representations and Recurrent Neural Networks (RNNs). Although fake news detection using RNNs has been already explored in the literature, there is little research on the processing of texts in Portuguese language, which is the focus of this work. For this purpose, distributed representations from texts are generated with three different algorithms (fastText, GloVe and word2vec) and used as input features for a Long Short-term Memory Network (LSTM). The approach is evaluated using a publicly available labelled news dataset. The proposed approach shows promising results for all the three distributed representation methods for feature extraction, with the combination word2vec+LSTM providing the best results. The results of the proposed approach shows a better classification performance when compared to simple architectures, while similar results are obtained when the approach is compared to deeper architectures or more complex methods.

scholarly journals Category representations in the brain are both discretely localized and widely distributed

2018 ◽  
Vol 119 (6) ◽  
pp. 2256-2264 ◽  
Author(s):  
Zarrar Shehzad ◽  
Gregory McCarthy
Keyword(s):  
Functional Mri ◽  
Brain Connectivity ◽  
Strong Support ◽  
Brain Regions ◽  
Distributed Representations ◽  
Domain Specific ◽  
Category Information ◽  
Shared Information ◽  
Unique Domain ◽  
The Brain

Whether category information is discretely localized or represented widely in the brain remains a contentious issue. Initial functional MRI studies supported the localizationist perspective that category information is represented in discrete brain regions. More recent fMRI studies using machine learning pattern classification techniques provide evidence for widespread distributed representations. However, these latter studies have not typically accounted for shared information. Here, we find strong support for distributed representations when brain regions are considered separately. However, localized representations are revealed by using analytical methods that separate unique from shared information among brain regions. The distributed nature of shared information and the localized nature of unique information suggest that brain connectivity may encourage spreading of information but category-specific computations are carried out in distinct domain-specific regions. NEW & NOTEWORTHY Whether visual category information is localized in unique domain-specific brain regions or distributed in many domain-general brain regions is hotly contested. We resolve this debate by using multivariate analyses to parse functional MRI signals from different brain regions into unique and shared variance. Our findings support elements of both models and show information is initially localized and then shared among other regions leading to distributed representations being observed.

Sign in / Sign up

Export Citation Format

Share Document