How to measure local active information storage in neural systems

Author(s):  
Michael Wibral ◽  
Joseph T. Lizier ◽  
Viola Priesemann
Entropy ◽  
2021 ◽  
Vol 23 (2) ◽  
pp. 167
Author(s):  
Patricia Wollstadt ◽  
Martina Hasenjäger ◽  
Christiane B. Wiebel-Herboth

Entropy-based measures are an important tool for studying human gaze behavior under various conditions. In particular, gaze transition entropy (GTE) is a popular method to quantify the predictability of a visual scanpath as the entropy of transitions between fixations and has been shown to correlate with changes in task demand or changes in observer state. Measuring scanpath predictability is thus a promising approach to identifying viewers’ cognitive states in behavioral experiments or gaze-based applications. However, GTE does not account for temporal dependencies beyond two consecutive fixations and may thus underestimate the actual predictability of the current fixation given past gaze behavior. Instead, we propose to quantify scanpath predictability by estimating the active information storage (AIS), which can account for dependencies spanning multiple fixations. AIS is calculated as the mutual information between a processes’ multivariate past state and its next value. It is thus able to measure how much information a sequence of past fixations provides about the next fixation, hence covering a longer temporal horizon. Applying the proposed approach, we were able to distinguish between induced observer states based on estimated AIS, providing first evidence that AIS may be used in the inference of user states to improve human–machine interaction.


PLoS ONE ◽  
2021 ◽  
Vol 16 (3) ◽  
pp. e0248166
Author(s):  
Christiane B. Wiebel-Herboth ◽  
Matti Krüger ◽  
Patricia Wollstadt

Scan pattern analysis has been discussed as a promising tool in the context of real-time gaze-based applications. In particular, information-theoretic measures of scan path predictability, such as the gaze transition entropy (GTE), have been proposed for detecting relevant changes in user state or task demand. These measures model scan patterns as first-order Markov chains, assuming that only the location of the previous fixation is predictive of the next fixation in time. However, this assumption may not be sufficient in general, as recent research has shown that scan patterns may also exhibit more long-range temporal correlations. Thus, we here evaluate the active information storage (AIS) as a novel information-theoretic approach to quantifying scan path predictability in a dynamic task. In contrast to the GTE, the AIS provides means to statistically test and account for temporal correlations in scan path data beyond the previous last fixation. We compare AIS to GTE in a driving simulator experiment, in which participants drove in a highway scenario, where trials were defined based on an experimental manipulation that encouraged the driver to start an overtaking maneuver. Two levels of difficulty were realized by varying the time left to complete the task. We found that individual observers indeed showed temporal correlations beyond a single past fixation and that the length of the correlation varied between observers. No effect of task difficulty was observed on scan path predictability for either AIS or GTE, but we found a significant increase in predictability during overtaking. Importantly, for participants for which the first-order Markov chain assumption did not hold, this was only shown using AIS but not GTE. We conclude that accounting for longer time horizons in scan paths in a personalized fashion is beneficial for interpreting gaze pattern in dynamic tasks.


2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Ruomin Zhu ◽  
Joel Hochstetter ◽  
Alon Loeffler ◽  
Adrian Diaz-Alvarez ◽  
Tomonobu Nakayama ◽  
...  

AbstractNeuromorphic systems comprised of self-assembled nanowires exhibit a range of neural-like dynamics arising from the interplay of their synapse-like electrical junctions and their complex network topology. Additionally, various information processing tasks have been demonstrated with neuromorphic nanowire networks. Here, we investigate the dynamics of how these unique systems process information through information-theoretic metrics. In particular, Transfer Entropy (TE) and Active Information Storage (AIS) are employed to investigate dynamical information flow and short-term memory in nanowire networks. In addition to finding that the topologically central parts of networks contribute the most to the information flow, our results also reveal TE and AIS are maximized when the networks transitions from a quiescent to an active state. The performance of neuromorphic networks in memory and learning tasks is demonstrated to be dependent on their internal dynamical states as well as topological structure. Optimal performance is found when these networks are pre-initialised to the transition state where TE and AIS are maximal. Furthermore, an optimal range of information processing resources (i.e. connectivity density) is identified for performance. Overall, our results demonstrate information dynamics is a valuable tool to study and benchmark neuromorphic systems.


2021 ◽  
pp. 3724-3732
Author(s):  
Amenah D. Abbood ◽  
Ammar A. Hasan ◽  
Baraa A. Attea

     In the last few years, the literature conferred a great interest in studying the feasibility of using memristive devices for computing. Memristive devices are important in structure, dynamics, as well as functionalities of artificial neural networks (ANNs) because of their resemblance to biological learning in synapses and neurons regarding switching characteristics of their resistance. Memristive architecture consists of a number of metastable switches (MSSs). Although the literature covered a variety of memristive applications for general purpose computations, the effect of low or high conductance of each MSS was unclear. This paper focuses on finding a potential criterion to calculate the conductance of each MMS rather than the whole conductance as reported in the literature. Anti-Hebbian and Hebbian (AHaH) learning rules are used to mimic the changes in memristance of the memristors. This research will concentrate on the effect of conductance on an individual MSS to simulate the nanotechnology devices of the memristors. A single synapse is presented by a couple of memristors to mimic its resistance switching. The learning circuit of artificial synapses could be used in many applications, such as image processing and neural networks, for pattern classification of synapses, represented by a map of the memeristors. These synapses are essential elements for data processing and information storage in both real and artificial neural systems.


Author(s):  
D. E. Speliotis

The interaction of electron beams with a large variety of materials for information storage has been the subject of numerous proposals and studies in the recent literature. The materials range from photographic to thermoplastic and magnetic, and the interactions with the electron beam for writing and reading the information utilize the energy, or the current, or even the magnetic field associated with the electron beam.


Sign in / Sign up

Export Citation Format

Share Document