The Perceptual Neural Trace of Memorable Unseen Scenes

ABSTRACTSome scenes are more memorable than others: they cement in minds with consistencies across observers and time scales. While memory mechanisms are traditionally associated with the end stages of perception, recent behavioral studies suggest that the features driving these memorability effects are extracted early on, and in an automatic fashion. This raises the question: is the neural signal of memorability detectable during early perceptual encoding phases of visual processing? Using the high temporal resolution of magnetoencephalography (MEG), during a rapid serial visual presentation (RSVP) task, we traced the neural temporal signature of memorability across the brain. We found an early and prolonged memorability related signal recruiting a network of regions in both dorsal and ventral streams, detected outside of the constraints of subjective awareness. This enhanced encoding could be the key to successful storage and recognition.

Download Full-text

Improved Neural Signal Classification in a Rapid Serial Visual Presentation Task Using Active Learning

IEEE Transactions on Neural Systems and Rehabilitation Engineering ◽

10.1109/tnsre.2015.2502323 ◽

2016 ◽

Vol 24 (3) ◽

pp. 333-343 ◽

Cited By ~ 29

Author(s):

Amar R. Marathe ◽

Vernon J. Lawhern ◽

Dongrui Wu ◽

David Slayback ◽

Brent J. Lance

Keyword(s):

Active Learning ◽

Rapid Serial Visual Presentation ◽

Visual Presentation ◽

Signal Classification ◽

Neural Signal

Download Full-text

Interruption of Late Visual Processing Causes an Attentional Blink

Perception ◽

10.1068/v970161 ◽

1997 ◽

Vol 26 (1_suppl) ◽

pp. 134-134

Author(s):

A Ehrenstein ◽

B G Breitmeyer ◽

K K Pritchard ◽

M Hiscock ◽

J Crisan

Keyword(s):

Attentional Blink ◽

Rapid Serial Visual Presentation ◽

Visual Processing ◽

Visual Presentation ◽

Masking Effect ◽

Backward Masking ◽

Spatially Distributed ◽

Display Location

When the task is to detect two letter targets in a stream of non-letter (digit) distractors in rapid serial visual presentation, an attentional blink (AB; ie a deficit in the detection of a second target when it follows the first by approximately 100 – 500 ms) is often found to occur. In a series of four experiments with different numbers of display positions, with or without masking, we show that: (1) the AB, which occurs when all items are presented at the same display location, is reduced when targets and distractors are presented randomly dispersed over 4 or 9 adjacent locations; (2) the AB is reduced with the spatially distributed presentation even when backward masks are used in all possible stimulus locations and when the location of the next item in the sequence is predictable; (3) the AB is not due to either a location-specific forward or backward masking effect occurring at early levels in visual processing. We conclude that the AB is primarily a function of the interruption of late visual processing produced when the item following the first target occurs at the same location. It seems that, in order for the AB to occur, the item following the first target must be presented at the same location as that target so that it can serve both as a distractor and as a mask interrupting or interfering with late visual processing.

Download Full-text

High-temporal resolution optical observations of the gamma-ray blazar PG 1553+113

Proceedings of the International Astronomical Union ◽

10.1017/s1743921310015991 ◽

2010 ◽

Vol 6 (S275) ◽

pp. 190-191

Author(s):

I. Andruchow ◽

J. A. Combi ◽

S. A. Cellone ◽

A. J. Muñoz-Arjonilla ◽

G. E. Romero ◽

...

Keyword(s):

Time Scales ◽

Temporal Resolution ◽

Gamma Ray ◽

Position Angle ◽

Optical Observations ◽

High Temporal Resolution ◽

Night Time ◽

Differential Photometry ◽

Optical Wavelengths ◽

Optical Flux

AbstractWe present here the results of an observational photo-polarimetry campaign at optical wavelengths of the blazar PG 1553+113, which was recently detected at very high energies (>100 GeV) by the H.E.S.S and MAGIC γ-ray experiments.Our high-temporal resolution data show significant variations in the linear polarization percentage and position angle at inter-night time-scales, while at shorter (intra-night) time-scales both parameters varied less significantly, if at all. Simultaneous differential photometry (at the B and R bands) shows no significant variability in the total optical flux.

Download Full-text

Dynamic Electrode-to-Image (DETI) Mapping Reveals the Human Brain’s Spatiotemporal Code of Visual Information

10.1101/2021.02.19.431983 ◽

2021 ◽

Author(s):

Bruce C. Hansen ◽

Michelle R. Greene ◽

David J. Field

Keyword(s):

Temporal Resolution ◽

Visual Information ◽

Neural Code ◽

High Temporal Resolution ◽

Visual Code ◽

Neural Signals ◽

Intelligent Behavior ◽

Spatiotemporal Visualization ◽

State Space Theory ◽

The Brain

AbstractA chief goal of systems neuroscience is to understand how the brain encodes information in our visual environments. Understanding that neural code is crucial to explaining how visual content is transformed via subsequent semantic representations to enable intelligent behavior. Although the visual code is not static, this reality is often obscured in voxel-wise encoding models of BOLD signals due to fMRI’s poor temporal resolution. We leveraged the high temporal resolution of EEG to develop an encoding technique based in state-space theory. This approach maps neural signals to each pixel within a given image and reveals location-specific transformations of the visual code, providing a spatiotemporal signature for the image at each electrode. This technique offers a spatiotemporal visualization of the evolution of the neural code of visual information thought impossible to obtain from EEG and promises to provide insight into how visual meaning is developed through dynamic feedforward and recurrent processes.

Download Full-text

Ultrasound functional neuroimaging reveals propagation of task-related brain activity in behaving primates

10.1101/464487 ◽

2018 ◽

Author(s):

Alexandre Dizeux ◽

Marc Gesnik ◽

Harry Ahnine ◽

Kevin Blaize ◽

Fabrice Arcizet ◽

...

Keyword(s):

Temporal Resolution ◽

Large Scale ◽

Functional Neuroimaging ◽

Anterior Cingulate ◽

Global Network ◽

High Temporal Resolution ◽

Wide Field ◽

Spatiotemporal Resolution ◽

Macro Scale ◽

The Brain

ABSTRACTIn recent decades, neuroimaging has played an invaluable role in improving the fundamental understanding of the brain. At the macro scale, neuroimaging modalities such as MRI, EEG, and MEG, exploit a wide field of view to explore the brain as a global network of interacting regions. However, this comes at the price of either limited spatiotemporal resolution or limited sensitivity. At the micro scale, electrophysiology is used to explore the dynamic aspects of neuronal activity with a very high temporal resolution. However, this modality requires a statistical averaging of several tens of single task responses. A large-scale neuroimaging modality of sufficient spatial and temporal resolution and sensitivity to study brain region activation dynamically would open new territories of possibility in neuroscienceWe show that neurofunctional ultrasound imaging (fUS) is both able to assess brain activation during single cognitive tasks within superficial and deeper areas of the frontal cortex areas, and image the directional propagation of information within and between these regions. Equipped with an fUS device, two macaque rhesus monkeys were instructed before a stimulus appeared to rest (fixation) or to look towards (saccade) or away (antisaccade) from a stimulus. Our results identified an abrupt transient change in activity for all acquisitions in the supplementary eye field (SEF) when the animals were required to change a rule regarding the task cued by a stimulus. Simultaneous imaging in the anterior cingulate cortex and SEF revealed a time delay in the directional functional connectivity of 0.27 ± 0.07 s and 0.9 ± 0.2 s for animals S and Y, respectively. These results provide initial evidence that recording cerebral hemodynamics over large brain areas at a high spatiotemporal resolution and sensitivity with neurofunctional ultrasound can reveal instantaneous monitoring of endogenous brain signals and behavior.

Download Full-text

EEG-Based Identity Authentication Framework Using Face Rapid Serial Visual Presentation with Optimized Channels

Sensors ◽

10.3390/s19010006 ◽

2018 ◽

Vol 19 (1) ◽

pp. 6 ◽

Cited By ~ 9

Author(s):

Ying Zeng ◽

Qunjian Wu ◽

Kai Yang ◽

Li Tong ◽

Bin Yan ◽

...

Keyword(s):

Rapid Serial Visual Presentation ◽

Visual Presentation ◽

Specific Model ◽

Identity Authentication ◽

Event Related Potential ◽

Time Interval ◽

Electroencephalogram Eeg ◽

The Brain ◽

Biometric Trait ◽

Over Time

Electroencephalogram (EEG) signals, which originate from neurons in the brain, have drawn considerable interests in identity authentication. In this paper, a face image-based rapid serial visual presentation (RSVP) paradigm for identity authentication is proposed. This paradigm combines two kinds of biometric trait, face and EEG, together to evoke more specific and stable traits for authentication. The event-related potential (ERP) components induced by self-face and non-self-face (including familiar and not familiar) are investigated, and significant differences are found among different situations. On the basis of this, an authentication method based on Hierarchical Discriminant Component Analysis (HDCA) and Genetic Algorithm (GA) is proposed to build subject-specific model with optimized fewer channels. The accuracy and stability over time are evaluated to demonstrate the effectiveness and robustness of our method. The averaged authentication accuracy of 94.26% within 6 s can be achieved by our proposed method. For a 30-day averaged time interval, our method can still reach the averaged accuracy of 88.88%. Experimental results show that our proposed framework for EEG-based identity authentication is effective, robust, and stable over time.

Download Full-text

Uncovering Dynamic Brain Reconfiguration in MEG Working Memory n-Back Task Using Topological Data Analysis

Brain Sciences ◽

10.3390/brainsci9060144 ◽

2019 ◽

Vol 9 (6) ◽

pp. 144 ◽

Cited By ~ 1

Author(s):

Ali Nabi Duman ◽

Ahmet Emin Tatar ◽

Harun Pirim

Keyword(s):

Working Memory ◽

Data Analysis ◽

Response Time ◽

Temporal Resolution ◽

Generative Models ◽

Topological Data Analysis ◽

High Temporal Resolution ◽

The Brain ◽

Back Task ◽

Topological Data

The increasing availability of high temporal resolution neuroimaging data has increased the efforts to understand the dynamics of neural functions. Until recently, there are few studies on generative models supporting classification and prediction of neural systems compared to the description of the architecture. However, the requirement of collapsing data spatially and temporally in the state-of-the art methods to analyze functional magnetic resonance imaging (fMRI), electroencephalogram (EEG) and magnetoencephalography (MEG) data cause loss of important information. In this study, we addressed this issue using a topological data analysis (TDA) method, called Mapper, which visualizes evolving patterns of brain activity as a mathematical graph. Accordingly, we analyzed preprocessed MEG data of 83 subjects from Human Connectome Project (HCP) collected during working memory n-back task. We examined variation in the dynamics of the brain states with the Mapper graphs, and to determine how this variation relates to measures such as response time and performance. The application of the Mapper method to MEG data detected a novel neuroimaging marker that explained the performance of the participants along with the ground truth of response time. In addition, TDA enabled us to distinguish two task-positive brain activations during 0-back and 2-back tasks, which is hard to detect with the other pipelines that require collapsing the data in the spatial and temporal domain. Further, the Mapper graphs of the individuals also revealed one large group in the middle of the stimulus detecting the high engagement in the brain with fine temporal resolution, which could contribute to increase spatiotemporal resolution by merging different imaging modalities. Hence, our work provides another evidence to the effectiveness of the TDA methods for extracting subtle dynamic properties of high temporal resolution MEG data without the temporal and spatial collapse.

Download Full-text

Rapid visual processing of picture stimuli by pigeons in an RSVP (rapid serial visual presentation) task.

Journal of Experimental Psychology Animal Learning and Cognition ◽

10.1037/xan0000132 ◽

2017 ◽

Vol 43 (2) ◽

pp. 127-138 ◽

Cited By ~ 1

Author(s):

Masako Jitsumori ◽

Tomokazu Ushitani

Keyword(s):

Rapid Serial Visual Presentation ◽

Visual Processing ◽

Visual Presentation ◽

Picture Stimuli ◽

Rapid Visual Processing

Download Full-text

Rapid serial visual presentation: An approach to design

Information Visualization ◽

10.1177/1473871612439643 ◽

2012 ◽

Vol 11 (4) ◽

pp. 301-318 ◽

Cited By ~ 5

Author(s):

Mark Witkowski ◽

Robert Spence

Keyword(s):

Experimental Evidence ◽

Rapid Serial Visual Presentation ◽

Visual Processing ◽

Video Recording ◽

Line Drawing ◽

Visual Presentation ◽

Specific Class ◽

Image Size ◽

Image Presentation ◽

Wide Range

A familiar action in the physical world is the riffling of a book’s pages in order to gain, in a very short time, some idea about its content. That action is appropriately termed rapid serial visual presentation (RSVP). A computational embodiment of RSVP can provide such a variety of possible image presentation modes and flexibility of control as to offer a powerful tool to support a wide range of tasks involving the presentation of a collection of images. Those images can be conventional pictures (e.g. the Mona Lisa), the current image of a television channel, a frame of a video recording, the layout of a letterhead or page, a line drawing, a logo or the layout and shape of some text as in a motorway sign. Although our understanding of RSVP is not complete, sufficient experimental evidence and application experience is now available to lead to a useful set of guidelines for the interaction designer interested in exploiting its potential. These guidelines relate to six specific areas of design: the design style, the rate at which images are presented, image size on screen, the value of user control, image density on screen and image overlap. In this paper those guidelines are presented and justified by experimental evidence, much of it, unsurprisingly, emerging from the nature of human visual processing. In formulating the guidelines we fully acknowledge the importance, in a practical application, of aesthetic considerations; likewise, we take account of the need to minimise constraints on the creativity of the interaction designer. While RSVP addresses a specific class of tasks, we suggest that the principles discussed in this paper will have a broader relevance to image presentation techniques.

Download Full-text