scholarly journals A unified mechanism to support innate and learned use of visual landmark guidance in insects

2021 ◽  
Author(s):  
Roman Goulard ◽  
Cornelia Buehlmann ◽  
Jeremy E. Niven ◽  
Paul Graham ◽  
Barbara Webb
Keyword(s):  
Visual Memory ◽  
Short Term Memory ◽  
Central Complex ◽  
Mushroom Bodies ◽  
Cue Integration ◽  
Short Term ◽  
Innate Behaviour ◽  
Local Vector ◽  
Multisensory Information

AbstractInsects can navigate efficiently in both novel and familiar environments, and this requires flexiblity in how they are guided by sensory cues. A prominent landmark, for example, can ellicit strong innate behaviours (attraction or menotaxis) but can also be used through learning as a specific directional cue to sustain navigation memory. However, the mechanisms that allow both pathways to co-exist, interact or override each other are largely unknown. Here we propose a model for behavioural integration based on the neuroanatomy of the central complex (CX) and adapted to control landmark guided behaviours. We consider a reward signal provided either by an innate attraction to landmarks or a long-term visual memory that modulates the formation of a local vector memory in the CX. Using an operant strategy for a simulated agent exploring a simple arena world with a single cue, we show how the short-term memory generated can support both innate and learned steering behaviour. In addition, we show how this architecture is consistent with observed effects of unilateral mushroom bodies (MB) lesions in ants that cause a reversion to innate behaviour. We suggest the formation of a directional memory in the CX can be interpreted as transforming rewarding (positive or negative) sensory signals into a geometrical attractiveness (or repulsion) mapping of the environment. We discuss how this scheme might represent an ideal way to combine multisensory information gathered during the exploration of an environment and support optimized cue integration.

scholarly journals A unified mechanism for innate and learned visual landmark guidance in the insect central complex

2021 ◽  
Vol 17 (9) ◽  
pp. e1009383
Author(s):  
Roman Goulard ◽  
Cornelia Buehlmann ◽  
Jeremy E. Niven ◽  
Paul Graham ◽  
Barbara Webb
Keyword(s):  
Visual Memory ◽  
Short Term Memory ◽  
Central Complex ◽  
Mushroom Bodies ◽  
Cue Integration ◽  
Short Term ◽  
Innate Behaviour ◽  
Local Vector ◽  
Multisensory Information

Insects can navigate efficiently in both novel and familiar environments, and this requires flexiblity in how they are guided by sensory cues. A prominent landmark, for example, can elicit strong innate behaviours (attraction or menotaxis) but can also be used, after learning, as a specific directional cue as part of a navigation memory. However, the mechanisms that allow both pathways to co-exist, interact or override each other are largely unknown. Here we propose a model for the behavioural integration of innate and learned guidance based on the neuroanatomy of the central complex (CX), adapted to control landmark guided behaviours. We consider a reward signal provided either by an innate attraction to landmarks or a long-term visual memory in the mushroom bodies (MB) that modulates the formation of a local vector memory in the CX. Using an operant strategy for a simulated agent exploring a simple world containing a single visual cue, we show how the generated short-term memory can support both innate and learned steering behaviour. In addition, we show how this architecture is consistent with the observed effects of unilateral MB lesions in ants that cause a reversion to innate behaviour. We suggest the formation of a directional memory in the CX can be interpreted as transforming rewarding (positive or negative) sensory signals into a mapping of the environment that describes the geometrical attractiveness (or repulsion). We discuss how this scheme might represent an ideal way to combine multisensory information gathered during the exploration of an environment and support optimal cue integration.

Short-term visual memory

1983 ◽  
Vol 302 (1110) ◽  
pp. 295-309 ◽  
Keyword(s):  
Visual Memory ◽  
Spatial Information ◽  
Short Term Memory ◽  
Mental Arithmetic ◽  
Long Term Memory ◽  
Short Term ◽  
Position Effects ◽  
Term Memory ◽  
Short Term Visual Memory

Serial position effects in visual memory are presented as evidence for a short-term memory for visuo-spatial information that is not plausibly explained in terms of either verbal or sensory representations. This is called visualization, and is distinguished from long-term visual memory. Cases of head injury are reported in which long-term memory is affected but not visualization. In contrast with this, mental arithmetic interferes with visualization but not with long-term memory. Further studies are reported that throw doubt on the earlier explanation of this interference in terms of competition for a central executive or strategic coordinator. The significance of these findings is discussed in relation to a proposal for classifying the main kinds of information represented in higher visuo-spatial cognition.

Conceptual short-term memory (CSTM) supports core claims of Christiansen and Chater

2016 ◽  
Vol 39 ◽  
Author(s):  
Mary C. Potter
Keyword(s):  
Working Memory ◽  
Rapid Serial Visual Presentation ◽  
Language Comprehension ◽  
Short Term Memory ◽  
Visual Presentation ◽  
Long Term Memory ◽  
Short Term ◽  
Term Memory ◽  
Use Of Knowledge

AbstractRapid serial visual presentation (RSVP) of words or pictured scenes provides evidence for a large-capacity conceptual short-term memory (CSTM) that momentarily provides rich associated material from long-term memory, permitting rapid chunking (Potter 1993; 2009; 2012). In perception of scenes as well as language comprehension, we make use of knowledge that briefly exceeds the supposed limits of working memory.

Comparison of Auditory, Language, Memory, and Attention Abilities in Children With and Without Listening Difficulties

2020 ◽  
Vol 29 (4) ◽  
pp. 710-727
Author(s):  
Beula M. Magimairaj ◽  
Naveen K. Nagaraj ◽  
Alexander V. Sergeev ◽  
Natalie J. Benafield
Keyword(s):  
Auditory Processing ◽  
Short Term Memory ◽  
Group Differences ◽  
Long Term Memory ◽  
Short Term ◽  
Significant Group ◽  
Term Memory ◽  
Memory And Attention ◽  
Speed And Accuracy

Objectives School-age children with and without parent-reported listening difficulties (LiD) were compared on auditory processing, language, memory, and attention abilities. The objective was to extend what is known so far in the literature about children with LiD by using multiple measures and selective novel measures across the above areas. Design Twenty-six children who were reported by their parents as having LiD and 26 age-matched typically developing children completed clinical tests of auditory processing and multiple measures of language, attention, and memory. All children had normal-range pure-tone hearing thresholds bilaterally. Group differences were examined. Results In addition to significantly poorer speech-perception-in-noise scores, children with LiD had reduced speed and accuracy of word retrieval from long-term memory, poorer short-term memory, sentence recall, and inferencing ability. Statistically significant group differences were of moderate effect size; however, standard test scores of children with LiD were not clinically poor. No statistically significant group differences were observed in attention, working memory capacity, vocabulary, and nonverbal IQ. Conclusions Mild signal-to-noise ratio loss, as reflected by the group mean of children with LiD, supported the children's functional listening problems. In addition, children's relative weakness in select areas of language performance, short-term memory, and long-term memory lexical retrieval speed and accuracy added to previous research on evidence-based areas that need to be evaluated in children with LiD who almost always have heterogenous profiles. Importantly, the functional difficulties faced by children with LiD in relation to their test results indicated, to some extent, that commonly used assessments may not be adequately capturing the children's listening challenges. Supplemental Material https://doi.org/10.23641/asha.12808607

scholarly journals A Novel LSTM Model with Interaction Dual Attention for Radar Echo Extrapolation

2021 ◽  
Vol 13 (2) ◽  
pp. 164
Author(s):  
Chuyao Luo ◽  
Xutao Li ◽  
Yongliang Wen ◽  
Yunming Ye ◽  
Xiaofeng Zhang
Keyword(s):  
Short Term Memory ◽  
Weather Forecast ◽  
Vital Role ◽  
Data Sets ◽  
Short Term ◽  
Learning Techniques ◽  
Radar Echo ◽  
Hidden States ◽  
Better Than

The task of precipitation nowcasting is significant in the operational weather forecast. The radar echo map extrapolation plays a vital role in this task. Recently, deep learning techniques such as Convolutional Recurrent Neural Network (ConvRNN) models have been designed to solve the task. These models, albeit performing much better than conventional optical flow based approaches, suffer from a common problem of underestimating the high echo value parts. The drawback is fatal to precipitation nowcasting, as the parts often lead to heavy rains that may cause natural disasters. In this paper, we propose a novel interaction dual attention long short-term memory (IDA-LSTM) model to address the drawback. In the method, an interaction framework is developed for the ConvRNN unit to fully exploit the short-term context information by constructing a serial of coupled convolutions on the input and hidden states. Moreover, a dual attention mechanism on channels and positions is developed to recall the forgotten information in the long term. Comprehensive experiments have been conducted on CIKM AnalytiCup 2017 data sets, and the results show the effectiveness of the IDA-LSTM in addressing the underestimation drawback. The extrapolation performance of IDA-LSTM is superior to that of the state-of-the-art methods.

scholarly journals Two Stage Continuous Gesture Recognition Based on Deep Learning

Electronics ◽  
2021 ◽  
Vol 10 (5) ◽  
pp. 534
Author(s):  
Huogen Wang
Keyword(s):  
Gesture Recognition ◽  
Large Scale ◽  
Short Term Memory ◽  
Short Term ◽  
Hand Motion ◽  
Spatiotemporal Features ◽  
Spatiotemporal Information ◽  
Video Frames ◽  
Depth Sequences

The paper proposes an effective continuous gesture recognition method, which includes two modules: segmentation and recognition. In the segmentation module, the video frames are divided into gesture frames and transitional frames by using the information of hand motion and appearance, and continuous gesture sequences are segmented into isolated sequences. In the recognition module, our method exploits the spatiotemporal information embedded in RGB and depth sequences. For the RGB modality, our method adopts Convolutional Long Short-Term Memory Networks to learn long-term spatiotemporal features from short-term spatiotemporal features obtained from a 3D convolutional neural network. For the depth modality, our method converts a sequence into Dynamic Images and Motion Dynamic Images through weighted rank pooling and feed them into Convolutional Neural Networks, respectively. Our method has been evaluated on both ChaLearn LAP Large-scale Continuous Gesture Dataset and Montalbano Gesture Dataset and achieved state-of-the-art performance.

scholarly journals An Approach toward the Development of a Functional Encoding Model of Short Term Memory during Reading

1978 ◽  
Vol 10 (2) ◽  
pp. 141-148
Author(s):  
Mary Anne Herndon
Keyword(s):  
Cluster Analysis ◽  
Storage Capacity ◽  
Short Term Memory ◽  
Long Term Memory ◽  
Short Term ◽  
Processing Efficiency ◽  
Term Memory ◽  
Information Unit ◽  
Subsequent Storage

In a model of the functioning of short term memory, the encoding of information for subsequent storage in long term memory is simulated. In the encoding process, semantically equivalent paragraphs are detected for recombination into a macro information unit. This recombination process can be used to relieve the limited storage capacity constraint of short term memory and subsequently increase processing efficiency. The results of the simulation give a favorable indication of the success for the use of cluster analysis as a tool to simulate the encoding function in the detection of semantically similar paragraphs.

scholarly journals Remember like humans

2017 ◽  
Vol 14 (1) ◽  
pp. 172988141769231 ◽  
Author(s):  
Ning An ◽  
Shi-Ying Sun ◽  
Xiao-Guang Zhao ◽  
Zeng-Guang Hou
Keyword(s):  
Short Term Memory ◽  
Three Dimensional ◽  
Sensory Memory ◽  
Long Term Memory ◽  
Observation Model ◽  
Two Dimensional ◽  
Short Term ◽  
Term Memory ◽  
Memory Register

Visual tracking is a challenging computer vision task due to the significant observation changes of the target. By contrast, the tracking task is relatively easy for humans. In this article, we propose a tracker inspired by the cognitive psychological memory mechanism, which decomposes the tracking task into sensory memory register, short-term memory tracker, and long-term memory tracker like humans. The sensory memory register captures information with three-dimensional perception; the short-term memory tracker builds the highly plastic observation model via memory rehearsal; the long-term memory tracker builds the highly stable observation model via memory encoding and retrieval. With the cooperative models, the tracker can easily handle various tracking scenarios. In addition, an appearance-shape learning method is proposed to update the two-dimensional appearance model and three-dimensional shape model appropriately. Extensive experimental results on a large-scale benchmark data set demonstrate that the proposed method outperforms the state-of-the-art two-dimensional and three-dimensional trackers in terms of efficiency, accuracy, and robustness.

Sign in / Sign up

Export Citation Format

Share Document