Spatio-temporal Memory for Navigation in a Mushroom Body Model

AbstractInsects, despite relatively small brains, can perform complex navigation tasks such as memorising a visual route. The exact format of visual memory encoded by neural systems during route learning and following is still unclear. Here we propose that interconnections between Kenyon cells in the Mushroom Body (MB) could encode spatio-temporal memory of visual motion experienced when moving along a route. In our implementation, visual motion is sensed using an event-based camera mounted on a robot, and learned by a biologically constrained spiking neural network model, based on simplified MB architecture and using modified leaky integrate-and-fire neurons. In contrast to previous image-matching models where all memories are stored in parallel, the continuous visual flow is inherently sequential. Our results show that the model can distinguish learned from unlearned route segments, with some tolerance to internal and external noise, including small displacements. The neural response can also explain observed behaviour taken to support sequential memory in ant experiments. However, obtaining comparable robustness to insect navigation might require the addition of biomimetic pre-processing of the input stream, and determination of the appropriate motor strategy to exploit the memory output.

Download Full-text

Spatio-Temporal Memory for Navigation in a Mushroom Body Model

Biomimetic and Biohybrid Systems - Lecture Notes in Computer Science ◽

10.1007/978-3-030-64313-3_39 ◽

2020 ◽

pp. 415-426

Author(s):

Le Zhu ◽

Michael Mangan ◽

Barbara Webb

Keyword(s):

Mushroom Body ◽

Temporal Memory ◽

Body Model ◽

Spatio Temporal

Download Full-text

Spatio-temporal memory streaming

ACM SIGARCH Computer Architecture News ◽

10.1145/1555815.1555766 ◽

2009 ◽

Vol 37 (3) ◽

pp. 69-80 ◽

Cited By ~ 20

Author(s):

Stephen Somogyi ◽

Thomas F. Wenisch ◽

Anastasia Ailamaki ◽

Babak Falsafi

Keyword(s):

Temporal Memory ◽

Spatio Temporal

Download Full-text

A Spatio-Temporal Memory Based on SOMs with Activity Diffusion

Kohonen Maps ◽

10.1016/b978-044450270-4/50020-6 ◽

1999 ◽

pp. 253-265 ◽

Cited By ~ 9

Author(s):

Neil R. Euliano ◽

Jose C. Principe

Keyword(s):

Temporal Memory ◽

Spatio Temporal

Download Full-text

The Genesis of Visual Memory through Strong Perceptual Representations: Tracking the Spatio-Temporal Neural Trace of Memorability

Journal of Vision ◽

10.1167/18.10.368 ◽

2018 ◽

Vol 18 (10) ◽

pp. 368

Author(s):

Caitlin Mullin ◽

Yalda Mohsenzadeh ◽

Dimitrios Pantazis ◽

Aude Oliva

Keyword(s):

Visual Memory ◽

Perceptual Representations ◽

Spatio Temporal

Download Full-text

A Role for Visual Memory in Vocabulary Development: A Systematic Review and Meta-Analysis

10.31234/osf.io/4qyvs ◽

2021 ◽

Author(s):

Hayley E Pickering ◽

Jessica L Peters ◽

Sheila Crewther

Keyword(s):

Systematic Review ◽

Language Learning ◽

Visual Memory ◽

Meta Analysis ◽

Vocabulary Development ◽

Stream Processing ◽

Visual Stream ◽

New Words ◽

Ventral Visual Stream ◽

Spatio Temporal

Literature examining the role of visual memory in vocabulary development during childhood is limited, despite it being well known that preverbal infants rely on their visual abilities to form memories and learn new words. Hence, this systematic review and meta-analysis utilised a cognitive neuroscience perspective to examine the association between visual memory and vocabulary development, including moderators such as age and task selection, in neurotypical children aged 2- to 12-years. Visual memory tasks were classified as spatio-temporal span tasks, visuo-perceptual or spatial concurrent array tasks, and executive judgment tasks. Visuo-perceptual concurrent array tasks expected to rely on ventral visual stream processing showed a moderate association with vocabulary, while tasks measuring spatio-temporal spans expected to be associated with dorsal visual stream processing, and executive judgments (central executive), showed only weak correlations with vocabulary. These findings have important implications for all health professionals and researchers interested in language, as they can support the development of more targeted language learning interventions that require ventral visual stream processing.

Download Full-text

A hippocampal model for behavioral time acquisition and fast bidirectional replay of spatio-temporal memory sequences

10.1101/343988 ◽

2018 ◽

Author(s):

Marcelo Matheus Gauy ◽

Johannes Lengler ◽

Hafsteinn Einarsson ◽

Florian Meier ◽

Felix Weissenberger ◽

...

Keyword(s):

Functional Role ◽

Long Term Memory ◽

Temporal Memory ◽

Synfire Chains ◽

Dendritic Spikes ◽

Spatio Temporal ◽

Time Acquisition ◽

Global Inhibition

AbstractThe hippocampus is known to play a crucial role in the formation of long-term memory. For this, fast replays of previously experienced activities during sleep or after reward experiences are believed to be crucial. But how such replays are generated is still completely unclear. In this paper we propose a possible mechanism for this: we present a model that can store experienced trajectories on a behavioral timescale after a single run, and can subsequently bidirectionally replay such trajectories, thereby omitting any specifics of the previous behavior like speed, etc, but allowing repetitions of events, even with different subsequent events. Our solution builds on well-known concepts, one-shot learning and synfire chains, enhancing them by additional mechanisms using global inhibition and disinhibition. For replays our approach relies on dendritic spikes and cholinergic modulation, as supported by experimental data. We also hypothesize a functional role of disinhibition as a pacemaker during behavioral time.

Download Full-text

A-20 Do Children With LD and/or ADHD Differ at Baseline on a Pediatric Measure Used to Assess Concussion?

Archives of Clinical Neuropsychology ◽

10.1093/arclin/acaa036.20 ◽

2020 ◽

Vol 35 (5) ◽

pp. 616-616

Author(s):

S Friedman ◽

R S Moser ◽

P Schatz

Keyword(s):

Visual Memory ◽

Group Analysis ◽

Symptom Reporting ◽

Neurocognitive Performance ◽

Children With Adhd ◽

Word Memory ◽

Sequential Memory ◽

Neurocognitive Measures ◽

Rapid Processing ◽

Memory Word

Abstract Objective To examine differences at baseline between children with ADHD and/or LD vs. children with neither ADHD/LD on 1) neurocognitive scores and 2) child- and parent-reported concussion symptoms. Method Retrospective data was obtained for 1856 children ages 5–11 who were assessed at baseline using ImPACT Pediatric. Groups were determined based on parent-reported diagnosis of their child at baseline (ADHD and/or LD vs. neither ADHD/LD), and groups were compared on the four factor scores: Sequential Memory, Word Memory, Visual Memory, and Rapid Processing and on child- and parent-reported concussion symptoms using a series of ANOVAs. Results ANOVAs revealed that children with ADHD and/or LD performed significantly worse than children without ADHD/LD on Sequential Memory (F(1,1845) = 69.86, p < .001)) and Word Memory (F(1,1853) = 10.36, p = .001)). In contrast, children with ADHD and/or LD performed significantly better on the neurocognitive measures of Visual Memory [(F(1,1845) = 4.94, p = .026)] and Rapid Processing [(F(1,1853) = 20.35, p < .001). Symptom reporting was significantly greater in the ADHD and/or LD group for both child (F(1,1853) = 30.21, p < .001) and parent (F(1,1853) = 34.64, p < .001) reported symptoms. Conclusions The current study demonstrated differences at baseline in children on neurocognitive performance and concussion symptom reporting based on diagnostic group. Analysis of symptom reporting suggested that children with pre-existing diagnoses of ADHD and/or LD and their parents may report concussion-like symptoms at baseline, prior to ever experiencing a concussion. This finding has clinical implications for interpretation of post-concussion symptoms without a baseline comparison in children with pre-existing diagnoses such as ADHD and/or LD.

Download Full-text

Bio-Inspired Dynamical Tools for Analyzing Cognition

Encyclopedia of Artificial Intelligence ◽

10.4018/978-1-59904-849-9.ch040 ◽

2011 ◽

pp. 256-261

Author(s):

Manuel G. Bedia ◽

Juan M. Corchado ◽

Luis F. Castillo

Keyword(s):

Intelligent Systems ◽

Large Body ◽

Temporal Coding ◽

Experimental Investigations ◽

Insect Brain ◽

Volterra Systems ◽

Sequential Memory ◽

Spatio Temporal ◽

The Relationship ◽

Longterm Memory

The knowledge about higher brain centres in insects and how they affect the insect’s behaviour has increased significantly in recent years by theoretical and experimental investigations. Nowadays, a large body of evidence suggests that higher brain centres of insects are important for learning, short-term, longterm memory and play an important role for context generalisation (Bazhenof et al., 2001). Related to these subjects, one of the most interesting goals to achieve would be to understand the relationship between sequential memory encoding processes and the higher brain centres in insects in order to develop a general “insect-brain” control architecture to be implemented on simple robots. In this contribution, it is showed a review of the most important and recent results related to spatio-temporal coding and it is suggested the possibility to use continuous recurrent neural networks (CRNNs) (that can be used to model non-linear systems, in particular Lotka-Volterra systems) in order to find out a way to model simple cognitive systems from an abstract viewpoint. After showing the typical and interesting behaviors that emerge in appropriate Lotka- Volterra systems (in particular, winnerless competition processes) next sections deal with a brief discussion about the intelligent systems inspired in studies coming from the biology.

Download Full-text

Spatio-temporal learning by the ant ectatomma ruidum

Journal of Experimental Biology ◽

10.1242/jeb.202.14.1897 ◽

1999 ◽

Vol 202 (14) ◽

pp. 1897-1907 ◽

Cited By ~ 1

Author(s):

B. Schatz ◽

J.P. Lachaud ◽

G. Beugnon

Keyword(s):

Food Delivery ◽

Temporal Memory ◽

Feeding Sites ◽

Spatial Changes ◽

Daily Schedule ◽

Ectatomma Ruidum ◽

Temporal And Spatial ◽

Spatio Temporal ◽

Field And Laboratory Conditions ◽

Temporal Learning

We tested, under field and laboratory conditions, whether the neotropical ant Ectatomma ruidum Roger can learn several associations between temporal and spatial changes in the daily pattern of food availability. Honey was shuffled between two or three feeding sites following a fixed daily schedule. Foragers learnt to associate particular sites with the specific times at which food was available, individually marked ants being observed on the correct sites at the correct times. Some ants anticipated the time of food delivery by approximately 30 min, and it was not necessary for them to be rewarded at the first stage of the sequence of food collection to continue their search for honey according to the correct schedule of reward. Ants also followed the same schedule when no honey was supplied at each stage of the sequence, and they stayed at the expected unrewarded site for a period equivalent to the reward period of the corresponding training phase, indicating that they had learnt when and for how long the food was available. Thus, ants rely on their spatio-temporal memory rather than on local cues coming from the honey source to guide them.

Download Full-text