CHAPTER VI. Optimal Systems with Active Information Storage

Entropy ◽  
2021 ◽  
Vol 23 (2) ◽  
pp. 167
Author(s):  
Patricia Wollstadt ◽  
Martina Hasenjäger ◽  
Christiane B. Wiebel-Herboth

Entropy-based measures are an important tool for studying human gaze behavior under various conditions. In particular, gaze transition entropy (GTE) is a popular method to quantify the predictability of a visual scanpath as the entropy of transitions between fixations and has been shown to correlate with changes in task demand or changes in observer state. Measuring scanpath predictability is thus a promising approach to identifying viewers’ cognitive states in behavioral experiments or gaze-based applications. However, GTE does not account for temporal dependencies beyond two consecutive fixations and may thus underestimate the actual predictability of the current fixation given past gaze behavior. Instead, we propose to quantify scanpath predictability by estimating the active information storage (AIS), which can account for dependencies spanning multiple fixations. AIS is calculated as the mutual information between a processes’ multivariate past state and its next value. It is thus able to measure how much information a sequence of past fixations provides about the next fixation, hence covering a longer temporal horizon. Applying the proposed approach, we were able to distinguish between induced observer states based on estimated AIS, providing first evidence that AIS may be used in the inference of user states to improve human–machine interaction.


PLoS ONE ◽  
2021 ◽  
Vol 16 (3) ◽  
pp. e0248166
Author(s):  
Christiane B. Wiebel-Herboth ◽  
Matti Krüger ◽  
Patricia Wollstadt

Scan pattern analysis has been discussed as a promising tool in the context of real-time gaze-based applications. In particular, information-theoretic measures of scan path predictability, such as the gaze transition entropy (GTE), have been proposed for detecting relevant changes in user state or task demand. These measures model scan patterns as first-order Markov chains, assuming that only the location of the previous fixation is predictive of the next fixation in time. However, this assumption may not be sufficient in general, as recent research has shown that scan patterns may also exhibit more long-range temporal correlations. Thus, we here evaluate the active information storage (AIS) as a novel information-theoretic approach to quantifying scan path predictability in a dynamic task. In contrast to the GTE, the AIS provides means to statistically test and account for temporal correlations in scan path data beyond the previous last fixation. We compare AIS to GTE in a driving simulator experiment, in which participants drove in a highway scenario, where trials were defined based on an experimental manipulation that encouraged the driver to start an overtaking maneuver. Two levels of difficulty were realized by varying the time left to complete the task. We found that individual observers indeed showed temporal correlations beyond a single past fixation and that the length of the correlation varied between observers. No effect of task difficulty was observed on scan path predictability for either AIS or GTE, but we found a significant increase in predictability during overtaking. Importantly, for participants for which the first-order Markov chain assumption did not hold, this was only shown using AIS but not GTE. We conclude that accounting for longer time horizons in scan paths in a personalized fashion is beneficial for interpreting gaze pattern in dynamic tasks.


2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Ruomin Zhu ◽  
Joel Hochstetter ◽  
Alon Loeffler ◽  
Adrian Diaz-Alvarez ◽  
Tomonobu Nakayama ◽  
...  

AbstractNeuromorphic systems comprised of self-assembled nanowires exhibit a range of neural-like dynamics arising from the interplay of their synapse-like electrical junctions and their complex network topology. Additionally, various information processing tasks have been demonstrated with neuromorphic nanowire networks. Here, we investigate the dynamics of how these unique systems process information through information-theoretic metrics. In particular, Transfer Entropy (TE) and Active Information Storage (AIS) are employed to investigate dynamical information flow and short-term memory in nanowire networks. In addition to finding that the topologically central parts of networks contribute the most to the information flow, our results also reveal TE and AIS are maximized when the networks transitions from a quiescent to an active state. The performance of neuromorphic networks in memory and learning tasks is demonstrated to be dependent on their internal dynamical states as well as topological structure. Optimal performance is found when these networks are pre-initialised to the transition state where TE and AIS are maximal. Furthermore, an optimal range of information processing resources (i.e. connectivity density) is identified for performance. Overall, our results demonstrate information dynamics is a valuable tool to study and benchmark neuromorphic systems.


Author(s):  
D. E. Speliotis

The interaction of electron beams with a large variety of materials for information storage has been the subject of numerous proposals and studies in the recent literature. The materials range from photographic to thermoplastic and magnetic, and the interactions with the electron beam for writing and reading the information utilize the energy, or the current, or even the magnetic field associated with the electron beam.


Author(s):  
T. P. Nolan

Thin film magnetic media are being used as low cost, high density forms of information storage. The development of this technology requires the study, at the sub-micron level, of morphological, crystallographic, and magnetic properties, throughout the depth of the deposited films. As the microstructure becomes increasingly fine, widi grain sizes approaching 100Å, the unique characterization capabilities of transmission electron microscopy (TEM) have become indispensable to the analysis of such thin film magnetic media.Films were deposited at 225°C, on two NiP plated Al substrates, one polished, and one circumferentially textured with a mean roughness of 55Å. Three layers, a 750Å chromium underlayer, a 600Å layer of magnetic alloy of composition Co84Cr14Ta2, and a 300Å amorphous carbon overcoat were then sputter deposited using a dc magnetron system at a power of 1kW, in a chamber evacuated below 10-6 torr and filled to 12μm Ar pressure. The textured medium is presently used in industry owing to its high coercivity, Hc, and relatively low noise. One important feature is that the coercivity in the circumferential read/write direction is significandy higher than that in the radial direction.


Sign in / Sign up

Export Citation Format

Share Document