A Cognitive Framework for Core Language Understanding and its Computational Implementation

2012 ◽  
Vol 6 (1) ◽  
pp. 1-20 ◽  
Author(s):  
L. Massey
Keyword(s):  
Short Term Memory ◽  
Human Cognition ◽  
Long Term Memory ◽  
Neural Activation ◽  
Language Understanding ◽  
Term Memory ◽  
Text Document ◽  
Cognitive Framework ◽  
Computational Implementation ◽  
Core Language

The author argues that the cognitive processes underlying language understanding may not be logico-deductive or inductive, at least not for basic forms of understanding such as the ability to determine the topics of a text document. To demonstrate this point, they present a human cognition inspired framework for core language understanding and its computational implementation. The framework exploits word related knowledge stored in Long Term Memory (LTM) as well as Short Term Memory (STM) limited capacity, neuromorphic spreading activation and neural activation decay to derive the topics of text. The computational model implementing the framework shows the potential of the approach by establishing that the topics generated by the model are as good as those generated by humans.

scholarly journals Mental Mechanisms for Topics Identification

2014 ◽  
Vol 2014 ◽  
pp. 1-11
Author(s):  
Louis Massey
Keyword(s):  
Baseline Level ◽  
Short Term Memory ◽  
Decay Rates ◽  
Neural Systems ◽  
Long Term Memory ◽  
Neural Activation ◽  
Main Hypothesis ◽  
Term Memory

Topics identification (TI) is the process that consists in determining the main themes present in natural language documents. The current TI modeling paradigm aims at acquiring semantic information from statistic properties of large text datasets. We investigate the mental mechanisms responsible for the identification of topics in a single document given existing knowledge. Our main hypothesis is that topics are the result of accumulated neural activation of loosely organized information stored in long-term memory (LTM). We experimentally tested our hypothesis with a computational model that simulates LTM activation. The model assumes activation decay as an unavoidable phenomenon originating from the bioelectric nature of neural systems. Since decay should negatively affect the quality of topics, the model predicts the presence of short-term memory (STM) to keep the focus of attention on a few words, with the expected outcome of restoring quality to a baseline level. Our experiments measured topics quality of over 300 documents with various decay rates and STM capacity. Our results showed that accumulated activation of loosely organized information was an effective mental computational commodity to identify topics. It was furthermore confirmed that rapid decay is detrimental to topics quality but that limited capacity STM restores quality to a baseline level, even exceeding it slightly.

Conceptual short-term memory (CSTM) supports core claims of Christiansen and Chater

2016 ◽  
Vol 39 ◽  
Author(s):  
Mary C. Potter
Keyword(s):  
Working Memory ◽  
Rapid Serial Visual Presentation ◽  
Language Comprehension ◽  
Short Term Memory ◽  
Visual Presentation ◽  
Long Term Memory ◽  
Short Term ◽  
Term Memory ◽  
Use Of Knowledge

AbstractRapid serial visual presentation (RSVP) of words or pictured scenes provides evidence for a large-capacity conceptual short-term memory (CSTM) that momentarily provides rich associated material from long-term memory, permitting rapid chunking (Potter 1993; 2009; 2012). In perception of scenes as well as language comprehension, we make use of knowledge that briefly exceeds the supposed limits of working memory.

Comparison of Auditory, Language, Memory, and Attention Abilities in Children With and Without Listening Difficulties

2020 ◽  
Vol 29 (4) ◽  
pp. 710-727
Author(s):  
Beula M. Magimairaj ◽  
Naveen K. Nagaraj ◽  
Alexander V. Sergeev ◽  
Natalie J. Benafield
Keyword(s):  
Auditory Processing ◽  
Short Term Memory ◽  
Group Differences ◽  
Long Term Memory ◽  
Short Term ◽  
Significant Group ◽  
Term Memory ◽  
Memory And Attention ◽  
Speed And Accuracy

Objectives School-age children with and without parent-reported listening difficulties (LiD) were compared on auditory processing, language, memory, and attention abilities. The objective was to extend what is known so far in the literature about children with LiD by using multiple measures and selective novel measures across the above areas. Design Twenty-six children who were reported by their parents as having LiD and 26 age-matched typically developing children completed clinical tests of auditory processing and multiple measures of language, attention, and memory. All children had normal-range pure-tone hearing thresholds bilaterally. Group differences were examined. Results In addition to significantly poorer speech-perception-in-noise scores, children with LiD had reduced speed and accuracy of word retrieval from long-term memory, poorer short-term memory, sentence recall, and inferencing ability. Statistically significant group differences were of moderate effect size; however, standard test scores of children with LiD were not clinically poor. No statistically significant group differences were observed in attention, working memory capacity, vocabulary, and nonverbal IQ. Conclusions Mild signal-to-noise ratio loss, as reflected by the group mean of children with LiD, supported the children's functional listening problems. In addition, children's relative weakness in select areas of language performance, short-term memory, and long-term memory lexical retrieval speed and accuracy added to previous research on evidence-based areas that need to be evaluated in children with LiD who almost always have heterogenous profiles. Importantly, the functional difficulties faced by children with LiD in relation to their test results indicated, to some extent, that commonly used assessments may not be adequately capturing the children's listening challenges. Supplemental Material https://doi.org/10.23641/asha.12808607

The Acute Effect of Alcohol on Various Memory Processes

2010 ◽  
Vol 24 (4) ◽  
pp. 249-252 ◽  
Author(s):  
Márk Molnár ◽  
Roland Boha ◽  
Balázs Czigler ◽  
Zsófia Anna Gaál
Keyword(s):  
Low Dose ◽  
Short Term Memory ◽  
Acute Effect ◽  
Long Term Memory ◽  
Term Memory ◽  
Memory Processes ◽  
Different Types ◽  
The Brain ◽  
Legal Consequences

This review surveys relevant and recent data of the pertinent literature regarding the acute effect of alcohol on various kinds of memory processes with special emphasis on working memory. The characteristics of different types of long-term memory (LTM) and short-term memory (STM) processes are summarized with an attempt to relate these to various structures in the brain. LTM is typically impaired by chronic alcohol intake but according to some data a single dose of ethanol may have long lasting effects if administered at a critically important age. The most commonly seen deleterious acute effect of alcohol to STM appears following large doses of ethanol in conditions of “binge drinking” causing the “blackout” phenomenon. However, with the application of various techniques and well-structured behavioral paradigms it is possible to detect, albeit occasionally, subtle changes of cognitive processes even as a result of a low dose of alcohol. These data may be important for the consideration of legal consequences of low-dose ethanol intake in conditions such as driving, etc.

scholarly journals EXPRESS: Two Variations and One Similarity in Memory Functions Deployed by Mice and Humans to Support Foraging

2021 ◽  
pp. 174702182110105
Author(s):  
Spencer Talbot ◽  
Todor Gerdjikov ◽  
Carlo De Lillo
Keyword(s):  
Working Memory ◽  
Brain Function ◽  
Visual Cues ◽  
Brain Structures ◽  
Human Cognition ◽  
Foraging Efficiency ◽  
Long Term Memory ◽  
Memory Functions ◽  
Term Memory

Assessing variations in cognitive function between humans and animals is vital for understanding the idiosyncrasies of human cognition and for refining animal models of human brain function and disease. We determined memory functions deployed by mice and humans to support foraging with a search task acting as a test battery. Mice searched for food from the top of poles within an open-arena. Poles were divided into groups based on visual cues and baited according to different schedules. White and black poles were baited in alternate trials. Striped poles were never baited. The requirement of the task was to find all baits in each trial. Mice’s foraging efficiency, defined as the number of poles visited before all baits were retrieved, improved with practice. Mice learnt to avoid visiting un-baited poles across trials (Long-term memory) and revisits to poles within each trial (Working memory). Humans tested with a virtual-reality version of the task outperformed mice in foraging efficiency, working memory and exploitation of the temporal pattern of rewards across trials. Moreover, humans, but not mice, reduced the number of possible movement sequences used to search the set of poles. For these measures interspecies differences were maintained throughout three weeks of testing. By contrast, long-term-memory for never-rewarded poles was similar in mice and humans after the first week of testing. These results indicate that human cognitive functions relying upon archaic brain structures may be adequately modelled in mice. Conversely, modelling in mice fluid skills likely to have developed specifically in primates, requires caution.

scholarly journals An Approach toward the Development of a Functional Encoding Model of Short Term Memory during Reading

1978 ◽  
Vol 10 (2) ◽  
pp. 141-148
Author(s):  
Mary Anne Herndon
Keyword(s):  
Cluster Analysis ◽  
Storage Capacity ◽  
Short Term Memory ◽  
Long Term Memory ◽  
Short Term ◽  
Processing Efficiency ◽  
Term Memory ◽  
Information Unit ◽  
Subsequent Storage

In a model of the functioning of short term memory, the encoding of information for subsequent storage in long term memory is simulated. In the encoding process, semantically equivalent paragraphs are detected for recombination into a macro information unit. This recombination process can be used to relieve the limited storage capacity constraint of short term memory and subsequently increase processing efficiency. The results of the simulation give a favorable indication of the success for the use of cluster analysis as a tool to simulate the encoding function in the detection of semantically similar paragraphs.

scholarly journals Remember like humans

2017 ◽  
Vol 14 (1) ◽  
pp. 172988141769231 ◽  
Author(s):  
Ning An ◽  
Shi-Ying Sun ◽  
Xiao-Guang Zhao ◽  
Zeng-Guang Hou
Keyword(s):  
Short Term Memory ◽  
Three Dimensional ◽  
Sensory Memory ◽  
Long Term Memory ◽  
Observation Model ◽  
Two Dimensional ◽  
Short Term ◽  
Term Memory ◽  
Memory Register

Visual tracking is a challenging computer vision task due to the significant observation changes of the target. By contrast, the tracking task is relatively easy for humans. In this article, we propose a tracker inspired by the cognitive psychological memory mechanism, which decomposes the tracking task into sensory memory register, short-term memory tracker, and long-term memory tracker like humans. The sensory memory register captures information with three-dimensional perception; the short-term memory tracker builds the highly plastic observation model via memory rehearsal; the long-term memory tracker builds the highly stable observation model via memory encoding and retrieval. With the cooperative models, the tracker can easily handle various tracking scenarios. In addition, an appearance-shape learning method is proposed to update the two-dimensional appearance model and three-dimensional shape model appropriately. Extensive experimental results on a large-scale benchmark data set demonstrate that the proposed method outperforms the state-of-the-art two-dimensional and three-dimensional trackers in terms of efficiency, accuracy, and robustness.

Moderate to heavy infections ofTrichuris trichiuraaffect cognitive function in Jamaican school children

Parasitology ◽  
1992 ◽  
Vol 104 (3) ◽  
pp. 539-547 ◽  
Author(s):  
C. Nokes ◽  
S. M. Grantham-McGregor ◽  
A. W. Sawyer ◽  
E. S. Cooper ◽  
B. A. Robinson ◽  
...  
Keyword(s):  
Cognitive Function ◽  
School Children ◽  
Cognitive Functions ◽  
Short Term Memory ◽  
Control Group ◽  
Long Term Memory ◽  
Double Blind ◽  
Term Memory ◽  
Confounding Variables ◽  
Placebo Trial

A double-blind placebo trial was conducted to determine the effect of moderate to high loads ofTrichuris trichiura(whipworm) infection on the cognitive functions of 159 school children (age 9–12 years) in Jamaica. Infected children were randomly assigned to Treatment or Placebo groups. A third group of randomly selected uninfected children were assigned to a Control for comparative purposes. The improvement in cognitive function was evaluated using a stepwise multiple linear regression, designed to control for any confounding variables. The expulsion of worms led to a significant improvement in tests of auditory short-term memory (P< 0.02;P< 0.01), and a highly significant improvement in the scanning and retrieval of long-term memory (P< 0.001). After 9 weeks, treated children were no longer significantly different from an uninfected Control group in these three tests of cognitive function. The removal ofT. trichiurawas more important thanAscaris lumbricoidesin determining this improvement. The results suggest that whipworm infection has an adverse effect on certain cognitive functions which is reversible by therapy.

Automatic phase identification of earthquake based on the UBDN deep network

2021 ◽  
pp. 1-10
Author(s):  
Jianxian Cai ◽  
Xun Dai ◽  
Zhitao Gao ◽  
Yan Shi
Keyword(s):  
Seismic Data ◽  
Short Term Memory ◽  
Long Term Memory ◽  
Phase Identification ◽  
S Wave ◽  
Traditional Methods ◽  
Term Memory ◽  
Seismic Stations ◽  
2008 Wenchuan Earthquake ◽  
Deep Network

Seismic data obtained from seismic stations are the major source of the information used to forecast earthquakes. With the growth in the number of seismic stations, the size of the dataset has also increased. Traditionally, STA/LTA and AIC method have been applied to process seismic data. However, the enormous size of the dataset reduces accuracy and increases the rate of missed detection of the P and S wave phase when using these traditional methods. To tackle these issues, we introduce the novel U-net-Bidirectional Long-Term Memory Deep Network (UBDN) which can automatically and accurately identify the P and S wave phases from seismic data. The U-net based UBDN strongly maintains the U-net’s high accuracy in edge detection for extracting seismic phase features. Meanwhile, it also reduces the missed detection rate by applying the Bidirectional Long Short-Term Memory (Bi-LSTM) mode that processes timing signals to establish the relationship between seismic phase features. Experimental results using the Stanford University seismic dataset and data from the 2008 Wenchuan earthquake aftershock confirm that the proposed UBDN method is very accurate and has a lower rate of missed phase detection, outperforming solutions that adapt traditional methods by an order of magnitude in terms of error percentage.

scholarly journals The Relative Kicking Frequency of Infants Born Full-term and Preterm During Learning and Short-term and Long-term Memory Periods of the Mobile Paradigm

2005 ◽  
Vol 85 (1) ◽  
pp. 8-18 ◽  
Author(s):  
Jill C Heathcock ◽  
Anjana N Bhat ◽  
Michele A Lobo ◽  
James (Cole) Galloway
Keyword(s):  
Gestational Age ◽  
Short Term Memory ◽  
Full Term ◽  
Long Term Memory ◽  
Early Assessment ◽  
Short Term ◽  
Term Memory ◽  
Lack Of Control ◽  
Specific Manner

Abstract Background and Purpose. Infants born preterm differ in their spontaneous kicking, as well as their learning and memory abilities in the mobile paradigm, compared with infants born full-term. In the mobile paradigm, a supine infant's ankle is tethered to a mobile so that leg kicks cause a proportional amount of mobile movement. The purpose of this study was to investigate the relative kicking frequency of the tethered (right) and nontethered (left) legs in these 2 groups of infants. Subjects. Ten infants born full-term and 10 infants born preterm (&lt;33 weeks gestational age, &lt;2,500 g) and 10 comparison infants participated in the study. Methods. The relative kicking frequencies of the tethered and nontethered legs were analyzed during learning and short-term and long-term memory periods of the mobile paradigm. Results. Infants born full-term showed an increase in the relative kicking frequency of the tethered leg during the learning period and the short-term memory period but not for the long-term memory period. Infants born preterm did not show a change in kicking pattern for learning or memory periods, and consistently kicked both legs in relatively equal amounts. Discussion and Conclusion. Infants born full-term adapted their baseline kicking frequencies in a task-specific manner to move the mobile and then retained this adaptation for the short-term memory period. In contrast, infants born preterm showed no adaptation, suggesting a lack of purposeful leg control. This lack of control may reflect a general decrease in the ability of infants born preterm to use their limb movements to interact with their environment. As such, the mobile paradigm may be clinically useful in the early assessment and intervention of infants born preterm and at risk for future impairment.

Sign in / Sign up

Export Citation Format

Share Document