scholarly journals Decoding images in the mind’s eye: The temporal dynamics of visual imagery

2019 ◽  
Author(s):  
Sophia M. Shatek ◽  
Tijl Grootswagers ◽  
Amanda K. Robinson ◽  
Thomas A. Carlson
Keyword(s):  
Mental Imagery ◽  
Visual Processing ◽  
Temporal Dynamics ◽  
Brain Activity ◽  
Brain Regions ◽  
Time Resolved ◽  
Santa Claus ◽  
Physical Stimuli ◽  
Multivariate Pattern ◽  
The Mind

AbstractMental imagery is the ability to generate images in the mind in the absence of sensory input. Both perceptual visual processing and internally generated imagery engage large, overlapping networks of brain regions. However, it is unclear whether they are characterized by similar temporal dynamics. Recent magnetoencephalography work has shown that object category information was decodable from brain activity during mental imagery, but the timing was delayed relative to perception. The current study builds on these findings, using electroencephalography to investigate the dynamics of mental imagery. Sixteen participants viewed two images of the Sydney Harbour Bridge and two images of Santa Claus. On each trial, they viewed a sequence of the four images and were asked to imagine one of them, which was cued retroactively by its temporal location in the sequence. Time-resolved multivariate pattern analysis was used to decode the viewed and imagined stimuli. Our results indicate that the dynamics of imagery processes are more variable across, and within, participants compared to perception of physical stimuli. Although category and exemplar information was decodable for viewed stimuli, there were no informative patterns of activity during mental imagery. The current findings suggest stimulus complexity, task design and individual differences may influence the ability to successfully decode imagined images. We discuss the implications of these results for our understanding of the neural processes underlying mental imagery.

scholarly journals Decoding Images in the Mind’s Eye: The Temporal Dynamics of Visual Imagery

Vision ◽  
2019 ◽  
Vol 3 (4) ◽  
pp. 53
Author(s):  
Sophia M. Shatek ◽  
Tijl Grootswagers ◽  
Amanda K. Robinson ◽  
Thomas A. Carlson
Keyword(s):  
Mental Imagery ◽  
Visual Processing ◽  
Temporal Dynamics ◽  
Brain Activity ◽  
Brain Regions ◽  
Time Resolved ◽  
Santa Claus ◽  
Multivariate Pattern ◽  
The Mind ◽  
Mind's Eye

Mental imagery is the ability to generate images in the mind in the absence of sensory input. Both perceptual visual processing and internally generated imagery engage large, overlapping networks of brain regions. However, it is unclear whether they are characterized by similar temporal dynamics. Recent magnetoencephalography work has shown that object category information was decodable from brain activity during mental imagery, but the timing was delayed relative to perception. The current study builds on these findings, using electroencephalography to investigate the dynamics of mental imagery. Sixteen participants viewed two images of the Sydney Harbour Bridge and two images of Santa Claus. On each trial, they viewed a sequence of the four images and were asked to imagine one of them, which was cued retroactively by its temporal location in the sequence. Time-resolved multivariate pattern analysis was used to decode the viewed and imagined stimuli. Although category and exemplar information was decodable for viewed stimuli, there were no informative patterns of activity during mental imagery. The current findings suggest stimulus complexity, task design and individual differences may influence the ability to successfully decode imagined images. We discuss the implications of these results in the context of prior findings of mental imagery.

scholarly journals Changes to information in working memory depend on distinct removal operations

2020 ◽  
Vol 11 (1) ◽  
Author(s):  
Hyojeong Kim ◽  
Harry R. Smolker ◽  
Louisa L. Smith ◽  
Marie T. Banich ◽  
Jarrod A. Lewis-Peacock
Keyword(s):  
Working Memory ◽  
Brain Activity ◽  
Brain Regions ◽  
New Information ◽  
Multivariate Pattern ◽  
The Mind ◽  
Unwanted Thoughts

AbstractHolding information in working memory is essential for cognition, but removing unwanted thoughts is equally important. Here we use multivariate pattern analyses of brain activity to demonstrate the successful manipulation and removal of information from working memory using different strategies including suppressing a specific thought, replacing a thought with a different one, and clearing the mind of all thought. These strategies are supported by distinct brain regions and have differential consequences for allowing new information to be encoded.

scholarly journals Resting‐State EEG Microstates Parallel Age‐Related Differences in Allocentric Spatial Working Memory Performance

2021 ◽  
Author(s):  
Adeline Jabès ◽  
Giuliana Klencklen ◽  
Paolo Ruggeri ◽  
Christoph M. Michel ◽  
Pamela Banta Lavenex ◽  
...  
Keyword(s):  
Older Adults ◽  
Working Memory ◽  
Resting State ◽  
Cognitive Aging ◽  
Temporal Dynamics ◽  
Spatial Working Memory ◽  
Brain Activity ◽  
Memory Performance ◽  
Brain Regions ◽  
Age Related

AbstractAlterations of resting-state EEG microstates have been associated with various neurological disorders and behavioral states. Interestingly, age-related differences in EEG microstate organization have also been reported, and it has been suggested that resting-state EEG activity may predict cognitive capacities in healthy individuals across the lifespan. In this exploratory study, we performed a microstate analysis of resting-state brain activity and tested allocentric spatial working memory performance in healthy adult individuals: twenty 25–30-year-olds and twenty-five 64–75-year-olds. We found a lower spatial working memory performance in older adults, as well as age-related differences in the five EEG microstate maps A, B, C, C′ and D, but especially in microstate maps C and C′. These two maps have been linked to neuronal activity in the frontal and parietal brain regions which are associated with working memory and attention, cognitive functions that have been shown to be sensitive to aging. Older adults exhibited lower global explained variance and occurrence of maps C and C′. Moreover, although there was a higher probability to transition from any map towards maps C, C′ and D in young and older adults, this probability was lower in older adults. Finally, although age-related differences in resting-state EEG microstates paralleled differences in allocentric spatial working memory performance, we found no evidence that any individual or combination of resting-state EEG microstate parameter(s) could reliably predict individual spatial working memory performance. Whether the temporal dynamics of EEG microstates may be used to assess healthy cognitive aging from resting-state brain activity requires further investigation.

Building the Arrow of Time… Over Time: A Sequence of Brain Activity Mapping Imagined Events in Time and Space

2018 ◽  
Vol 29 (10) ◽  
pp. 4398-4414 ◽  
Author(s):  
Baptiste Gauthier ◽  
Karin Pestke ◽  
Virginie van Wassenhove
Keyword(s):  
Brain Activity ◽  
Brain Regions ◽  
Spatial Task ◽  
Brain Response ◽  
Time And Space ◽  
Time Resolved ◽  
The Future ◽  
Spatial Dimensions ◽  
Future Events ◽  
Neural Signatures

Abstract When moving, the spatiotemporal unfolding of events is bound to our physical trajectory, and time and space become entangled in episodic memory. When imagining past or future events, or being in different geographical locations, the temporal and spatial dimensions of mental events can be independently accessed and manipulated. Using time-resolved neuroimaging, we characterized brain activity while participants ordered historical events from different mental perspectives in time (e.g., when imagining being 9 years in the future) or in space (e.g., when imagining being in Cayenne). We describe 2 neural signatures of temporal ordinality: an early brain response distinguishing whether participants were mentally in the past, the present or the future (self-projection in time), and a graded activity at event retrieval, indexing the mental distance between the representation of the self in time and the event. Neural signatures of ordinality and symbolic distances in time were distinct from those observed in the homologous spatial task: activity indicating spatial order and distances overlapped in latency in distinct brain regions. We interpret our findings as evidence that the conscious representation of time and space share algorithms (egocentric mapping, distance, and ordinality computations) but different implementations with a distinctive status for the psychological “time arrow.”

scholarly journals The Temporal Dynamics of Object Processing in Visual Cortex during the Transition from Distributed to Focused Spatial Attention

2011 ◽  
Vol 23 (12) ◽  
pp. 4094-4105 ◽  
Author(s):  
Chien-Te Wu ◽  
Melissa E. Libertus ◽  
Karen L. Meyerhoff ◽  
Marty G. Woldorff
Keyword(s):  
Visual Cortex ◽  
Spatial Attention ◽  
Cognitive Neuroscience ◽  
Visual Processing ◽  
Object Representation ◽  
Temporal Dynamics ◽  
Brain Activity ◽  
Object Processing ◽  
Electrical Brain Activity

Several major cognitive neuroscience models have posited that focal spatial attention is required to integrate different features of an object to form a coherent perception of it within a complex visual scene. Although many behavioral studies have supported this view, some have suggested that complex perceptual discrimination can be performed even with substantially reduced focal spatial attention, calling into question the complexity of object representation that can be achieved without focused spatial attention. In the present study, we took a cognitive neuroscience approach to this problem by recording cognition-related brain activity both to help resolve the questions about the role of focal spatial attention in object categorization processes and to investigate the underlying neural mechanisms, focusing particularly on the temporal cascade of these attentional and perceptual processes in visual cortex. More specifically, we recorded electrical brain activity in humans engaged in a specially designed cued visual search paradigm to probe the object-related visual processing before and during the transition from distributed to focal spatial attention. The onset times of the color popout cueing information, indicating where within an object array the subject was to shift attention, was parametrically varied relative to the presentation of the array (i.e., either occurring simultaneously or being delayed by 50 or 100 msec). The electrophysiological results demonstrate that some levels of object-specific representation can be formed in parallel for multiple items across the visual field under spatially distributed attention, before focal spatial attention is allocated to any of them. The object discrimination process appears to be subsequently amplified as soon as focal spatial attention is directed to a specific location and object. This set of novel neurophysiological findings thus provides important new insights on fundamental issues that have been long-debated in cognitive neuroscience concerning both object-related processing and the role of attention.

scholarly journals The representational dynamics of visual objects in rapid serial visual processing streams

2018 ◽  
Author(s):  
Tijl Grootswagers ◽  
Amanda K. Robinson ◽  
Thomas A. Carlson
Keyword(s):  
Visual Processing ◽  
Temporal Dynamics ◽  
Target Selection ◽  
Presentation Rate ◽  
Stimulus Presentation ◽  
Human Vision ◽  
Object Representations ◽  
Daily Lives ◽  
Multivariate Pattern ◽  
Rapid Serial Visual Processing

AbstractIn our daily lives, we are bombarded with a stream of rapidly changing visual input. Humans have the remarkable capacity to detect and identify objects in fast-changing scenes. Yet, when studying brain representations, stimuli are generally presented in isolation. Here, we studied the dynamics of human vision using a combination of fast stimulus presentation rates, electroencephalography and multivariate decoding analyses. Using a presentation rate of 5 images per second, we obtained the representational structure of a large number of stimuli, and showed the emerging abstract categorical organisation of this structure. Furthermore, we could separate the temporal dynamics of perceptual processing from higher-level target selection effects. In a second experiment, we used the same paradigm at 20Hz to show that shorter image presentation limits the categorical abstraction of object representations. Our results show that applying multivariate pattern analysis to every image in rapid serial visual processing streams has unprecedented potential for studying the temporal dynamics of the structure of representations in the human visual system.

scholarly journals Neural correlates of perceiving and interpreting engraved prehistoric patterns as human production: effect of archaeological expertise.

2021 ◽  
Author(s):  
Mathilde Salagnon ◽  
Sandrine Cremona ◽  
Marc Joliot ◽  
Francesco d'Errico ◽  
Emmanuel Mellet
Keyword(s):  
Decision Making ◽  
Visual Processing ◽  
Visual Analysis ◽  
Brain Activity ◽  
Occipital Cortex ◽  
Brain Regions ◽  
Salience Network ◽  
Natural Processes ◽  
And Control ◽  
Lateral Occipital Cortex

It has been suggested that engraved abstract patterns dating from the Middle and Lower Palaeolithic served as means of representation and communication. Identifying the brain regions involved in visual processing of these engravings can provide insights into their function. In this study, brain activity was measured during perception of the earliest known Palaeolithic engraved patterns and compared to natural patterns mimicking human-made engravings. Participants were asked to categorise marks as being intentionally made by humans or due to natural processes (e.g. erosion, root etching). To simulate the putative familiarity of our ancestors with the marks, the responses of expert archaeologists and control participants were compared, allowing characterisation of the effect of previous knowledge on both behaviour and brain activity in perception of the marks. Besides a set of regions common to both groups and involved in visual analysis and decision-making, the experts exhibited greater activity in the inferior part of the lateral occipital cortex, ventral occipitotemporal cortex, and medial thalamic regions. These results are consistent with those reported in visual expertise studies, and confirm the importance of the integrative visual areas in the perception of the earliest abstract engravings. The attribution of a natural rather than human origin to the marks elicited greater activity in the salience network in both groups, reflecting the uncertainty and ambiguity in the perception of, and decision-making for, natural patterns. The activation of the salience network might also be related to the process at work in the attribution of an intention to the marks. The primary visual area was not specifically involved in the visual processing of engravings, which argued against its central role in the emergence of engraving production.

scholarly journals Local sleep homeostasis in the avian brain: convergence of sleep function in mammals and birds?

2011 ◽  
Vol 278 (1717) ◽  
pp. 2419-2428 ◽  
Author(s):  
John A. Lesku ◽  
Alexei L. Vyssotski ◽  
Dolores Martinez-Gonzalez ◽  
Christiane Wilzeck ◽  
Niels C. Rattenborg
Keyword(s):  
Slow Wave ◽  
Rem Sleep ◽  
Visual Processing ◽  
Slow Wave Sleep ◽  
Brain Activity ◽  
Brain Regions ◽  
Avian Brain ◽  
Brain Functioning ◽  
Sleep Homeostasis ◽  
Local Sleep

The function of the brain activity that defines slow wave sleep (SWS) and rapid eye movement (REM) sleep in mammals is unknown. During SWS, the level of electroencephalogram slow wave activity (SWA or 0.5–4.5 Hz power density) increases and decreases as a function of prior time spent awake and asleep, respectively. Such dynamics occur in response to waking brain use, as SWA increases locally in brain regions used more extensively during prior wakefulness. Thus, SWA is thought to reflect homeostatically regulated processes potentially tied to maintaining optimal brain functioning. Interestingly, birds also engage in SWS and REM sleep, a similarity that arose via convergent evolution, as sleeping reptiles and amphibians do not show similar brain activity. Although birds deprived of sleep show global increases in SWA during subsequent sleep, it is unclear whether avian sleep is likewise regulated locally. Here, we provide, to our knowledge, the first electrophysiological evidence for local sleep homeostasis in the avian brain. After staying awake watching David Attenborough's The Life of Birds with only one eye, SWA and the slope of slow waves (a purported marker of synaptic strength) increased only in the hyperpallium—a primary visual processing region—neurologically connected to the stimulated eye. Asymmetries were specific to the hyperpallium, as the non-visual mesopallium showed a symmetric increase in SWA and wave slope. Thus, hypotheses for the function of mammalian SWS that rely on local sleep homeostasis may apply also to birds.

The Effects of Presentation Rate During Word and Pseudoword Reading: A Comparison of PET and fMRI

2000 ◽  
Vol 12 (supplement 2) ◽  
pp. 145-156 ◽  
Author(s):  
Andrea Mechelli ◽  
Karl J. Friston ◽  
Cathy J. Price
Keyword(s):  
Visual Processing ◽  
Word Processing ◽  
Brain Activity ◽  
Presentation Rate ◽  
Word Type ◽  
Brain Regions ◽  
Design Parameters ◽  
Specific Rate ◽  
Precentral Gyrus ◽  
Stimulus Rate

The effect of stimulus rate and its interaction with stimulus type on brain activity during reading was investigated using functional magnetic resonance imaging (fMRI). This (i) enabled the segregation of brain regions showing differential responses, (ii) identified the optimum experimental design parameters for maximizing sensitivity, and (iii) allowed us to evaluate further the sources of discrepancy between positron emission tomography (PET) and fMRI signals. The effect of visual word rate has already been investigated in a previous PET study. However, rate effects can be very different in PET and fMRI, as seen in previous studies of auditory word processing. In this work, we attempt to replicate rate-sensitive activations observed with PET using fMRI. Our objective was to characterize the discrepancies in regionally specific rate-sensitive effects between the two imaging modalities. Subjects were presented with words and pseudowords at varying rates while performing a silent reading task. The analysis specifically identified regions showing (i) an effect of stimulus rate on brain activity during reading; (ii) modulation of this effect by word type; and (iii) increased activity during reading relative to rest, but with no dependence on stimulus rate. The results identified similar effects of rate for words and pseudowords (no interactions between rate and word type reached significance). Irrespective of word type, strong positive linear effects of rate (i.e., activity increasing with rate) were detected in visual areas, right superior temporal gyrus, and bilateral precentral gyrus. These findings replicate the results of the previous PET study, confirming that activation in regions associated with visual processing and response generation increases with the number of stimuli. Likewise, we detected rate-independent effects reported in the previous PET study in bilateral anterior middle temporal, inferior frontal, and superior parietal regions. These results differentiate the functionally specific responses in rate-dependent and rate-independent areas. However, for negative effects of rate, fMRI did not replicate the effects seen in PET, suggesting some form of hemodynamic “rectification.” The discussion focuses on differences between evoked rCBF and BOLD signals.

scholarly journals Inferior parietal lobule and early visual areas support elicitation of individualized meanings during narrative listening

2018 ◽  
Author(s):  
S. Saalasti ◽  
J. Alho ◽  
M. Bar ◽  
E. Glerean ◽  
T. Honkela ◽  
...  
Keyword(s):  
Individual Differences ◽  
Mental Imagery ◽  
Latent Semantic Analysis ◽  
Semantic Analysis ◽  
Brain Activity ◽  
Brain Regions ◽  
Inferior Parietal Lobule ◽  
Semantic Representations ◽  
Visual Areas ◽  
Parietal Lobule

AbstractWhen listening to a narrative, the verbal expressions translate into meanings and flow of mental imagery, at best vividly immersing the keen listener into the sights, sounds, scents, objects, actions, and events in the story. However, the same narrative can be heard quite differently based on differences in listeners’ previous experiences and knowledge, as the semantics and mental imagery elicited by words and phrases in the story vary extensively between any given two individuals. Here, we capitalized on such inter-individual differences to disclose brain regions that support transformation of narrative into individualized propositional meanings and associated mental imagery by analyzing brain activity associated with behaviorally-assessed individual meanings elicited by a narrative. Sixteen subjects listed words best describing what had come to their minds during each 3–5 sec segment of an eight-minute narrative that they listened during fMRI of brain hemodynamic activity. Similarities in these word listings between subjects, estimated using latent-semantic analysis combined with WordNet knowledge, predicted similarities in brain hemodynamic activity in supramarginal and angular gyri as well as in cuneus. Our results demonstrate how inter-individual differences in semantic representations can be measured and utilized to identify specific brain regions that support the elicitation of individual propositional meanings and the associated mental imagery when one listens to a narrative.

Sign in / Sign up

Export Citation Format

Share Document