Chat Response Generation Based on Semantic Prediction Using Distributed Representations of Words

2019 ◽  
pp. 301-306
Author(s):  
Kazuaki Furumai ◽  
Tetsuya Takiguchi ◽  
Yasuo Ariki
Keyword(s):  
Distributed Representations

scholarly journals Neural Components of Reading Revealed by Distributed and Symbolic Computational Models

2020 ◽  
Vol 1 (4) ◽  
pp. 381-401
Author(s):  
Ryan Staples ◽  
William W. Graves
Keyword(s):  
Neural Activity ◽  
Neural Coding ◽  
Computational Models ◽  
Ann Model ◽  
Distributed Representations ◽  
Neural Data ◽  
Cognitive Components ◽  
Components Of Reading ◽  
Artificial Neural Network Ann ◽  
Models Of Reading

Determining how the cognitive components of reading—orthographic, phonological, and semantic representations—are instantiated in the brain has been a long-standing goal of psychology and human cognitive neuroscience. The two most prominent computational models of reading instantiate different cognitive processes, implying different neural processes. Artificial neural network (ANN) models of reading posit nonsymbolic, distributed representations. The dual-route cascaded (DRC) model instead suggests two routes of processing, one representing symbolic rules of spelling–to–sound correspondence, the other representing orthographic and phonological lexicons. These models are not adjudicated by behavioral data and have never before been directly compared in terms of neural plausibility. We used representational similarity analysis to compare the predictions of these models to neural data from participants reading aloud. Both the ANN and DRC model representations corresponded to neural activity. However, the ANN model representations correlated to more reading-relevant areas of cortex. When contributions from the DRC model were statistically controlled, partial correlations revealed that the ANN model accounted for significant variance in the neural data. The opposite analysis, examining the variance explained by the DRC model with contributions from the ANN model factored out, revealed no correspondence to neural activity. Our results suggest that ANNs trained using distributed representations provide a better correspondence between cognitive and neural coding. Additionally, this framework provides a principled approach for comparing computational models of cognitive function to gain insight into neural representations.

Distributed Representations of Diseases based on Co-occurrence Relationship

2021 ◽  
pp. 115418
Author(s):  
Haoqing Wang ◽  
Huiyu Mai ◽  
Zhi-hong Deng ◽  
Chao Yang ◽  
Luxia Zhang ◽  
...  
Keyword(s):  
Distributed Representations

Measuring distribution in distributed representations

1996 ◽  
Vol 3 (2) ◽  
pp. 73-79 ◽  
Author(s):  
Antony Browne
Keyword(s):  
Distributed Representations

Fake News Detection Using Recurrent Neural Networks and Distributed Representations for the Portuguese Language

2021 ◽  
Author(s):  
Guilherme Zanini Moreira ◽  
Marcelo Romero ◽  
Manassés Ribeiro
Keyword(s):  
Neural Networks ◽  
Recurrent Neural Networks ◽  
Short Term Memory ◽  
Classification Performance ◽  
Fake News ◽  
Distributed Representations ◽  
Memory Network ◽  
Long Short Term Memory ◽  
Media Channels ◽  
Damage Rule

After the advent of Web, the number of people who abandoned traditional media channels and started receiving news only through social media has increased. However, this caused an increase of the spread of fake news due to the ease of sharing information. The consequences are various, with one of the main ones being the possible attempts to manipulate public opinion for elections or promotion of movements that can damage rule of law or the institutions that represent it. The objective of this work is to perform fake news detection using Distributed Representations and Recurrent Neural Networks (RNNs). Although fake news detection using RNNs has been already explored in the literature, there is little research on the processing of texts in Portuguese language, which is the focus of this work. For this purpose, distributed representations from texts are generated with three different algorithms (fastText, GloVe and word2vec) and used as input features for a Long Short-term Memory Network (LSTM). The approach is evaluated using a publicly available labelled news dataset. The proposed approach shows promising results for all the three distributed representation methods for feature extraction, with the combination word2vec+LSTM providing the best results. The results of the proposed approach shows a better classification performance when compared to simple architectures, while similar results are obtained when the approach is compared to deeper architectures or more complex methods.

Sign in / Sign up

Export Citation Format

Share Document