The Beep-Speed Illusion: Non-Spatial Tones Increase Perceived Speed of Visual Objects in a Forced-Choice Paradigm

We introduce a new audio-visual illusion revealing the interplay between audio-visual integration and selective visual attention. This illusion involves two simultaneously moving objects that change their motion trajectory occasionally, but only the direction changes of one object are accompanied by spatially uninformative tones. We observed a selective increase in perceived object speed of the audio-visually synchronized object by measuring the point of subjective equality in a forced-choice paradigm. The illusory increase in perceived speed of the audio-visually synchronized object persisted when preventing eye movements. Using temporally matched color changes of the synchronized object also increased the perceived speed. Yet, using color changes of a surrounding frame instead of tones had no effect on perceived speed ruling out simple alertness explanations. Thus, in contrast to coinciding tones, visual coincidences only elicit illusory increases in perceived speed when the coincidence provided spatial information. Taken together, our pattern of results suggests that audio-visual synchrony attracts visual attention towards the coinciding visual object, leading to an increase in speed-perception and thus shedding new light on the interplay between attention and multisensory feature integration. We discuss potential limitations such as the choice of paradigm and outline prospective research question to further investigate the effect of audio-visual integration on perceived object speed.

Infants’ Selective Visual Attention Is Dependent on Maternal Affect and Emotional Context

Development of selective attention during the first year of life is critical to cognitive and socio-emotional skills. It is also a period that the average child’s interactions with their mother dominate their social environment. This study examined how maternal negative affect and an emotion face prime (mother/stranger) jointly effect selective visual attention. Results from linear mixed-effects modeling showed that 9-month olds (N=70) were faster to find a visual search target after viewing a fearful face (regardless of familiarity) or their mother’s angry face. For mothers with high negative affect, infants’ attention was further impacted by fearful faces, resulting in faster search times. Face emotion interacted with mother’s negative affect, demonstrating a capacity to influence what infants attend in their environment.

Spatial Separation and Working Memory Capacity Affect Selective Visual Attention in the Periphery

The current study aimed to examine the effects of spatial separation and working memory capacity on selective visual attention. We investigated differences in the ability to identify the two covertly attended stimuli that appeared either along one of the meridians (e.g., both along the horizontal) or along two of the meridians (e.g., one along the horizontal and one along the vertical) in the attention-window task. Two visual stimuli in the periphery could be perceived along wider extents of the attentional focus’ meridians (horizontal, vertical, and diagonal) when they were located along the same meridian (e.g., horizontal) compared to two different ones (e.g., horizontal and vertical). Subjects with high working memory capacity outperformed subjects with lower working memory capacity in both conditions and stimuli presented on two meridians were less accurately perceived. The findings support the proposal that individual differences in working memory capacity are important for selective spatial visual attention.

Methylphenidate as a causal test of translational and basic neural coding hypotheses

SUMMARYMost systems neuroscience studies fall into one of two categories: basic science work aimed at understanding the relationship between neurons and behavior, or translational work aimed at developing treatments for neuropsychiatric disorders. Here we use these two approaches to inform and enhance each other. Our study both tests hypotheses about basic science neural coding principles and elucidates the neuronal mechanisms underlying new, clinically relevant behavioral effects of systemically administered methylphenidate (Ritalin). We discovered that orally administered methylphenidate, used clinically to treat Attention Deficit Hyperactivity Disorder (ADHD) and generally to enhance cognition (Lakhan & Kirchgessner, 2012; Maher, 2008), increases spatially selective visual attention, enhancing visual performance at only the attended location. And as predicted by our previous work (Ni et al., 2018), we found that this causal manipulation enhances vision in rhesus macaques specifically when it decreases the mean correlated variability of neurons in visual area V4. Our findings demonstrate that the visual system is a platform for understanding the neural underpinnings of both complex cognitive processes (basic science) and neuropsychiatric disorders (translation). Addressing basic science hypotheses, our results are consistent with a scenario in which methylphenidate has cognitively specific effects by working through naturally selective cognitive mechanisms. Clinically, our findings suggest that the often staggeringly specific symptoms of neuropsychiatric disorders may be caused and treated by leveraging general mechanisms.

Change not State: Perceptual coupling in multistable displays reflects transient bias induced by perceptual change

We investigated how changes in dynamic spatial context influence visual perception. Specifically, we reexamined the perceptual coupling phenomenon when two multistable displays viewed simultaneously tend to be in the same dominant state and switch in accord. Current models assume this interaction reflecting mutual bias produced by a dominant perceptual state. In contrast, we demonstrate that influence of spatial context is strongest when perception changes. First, we replicated earlier work using bistable kinetic-depth effect displays, then extended it by employing asynchronous presentation to show that perceptual coupling cannot be accounted for by the static context provided by perceptually dominant states. Next, we demonstrated that perceptual coupling reflects transient bias induced by perceptual change, both in ambiguous and disambiguated displays. We used a hierarchical Bayesian model to characterize its timing, demonstrating that the transient bias is induced 50–70 ms after the exogenous trigger event and decays within ~200–300 ms. Both endogenous and exogenous switches led to quantitatively and qualitatively similar perceptual consequences, activating similar perceptual reevaluation mechanisms within a spatial surround. We explain how they can be understood within a transient selective visual attention framework or using local lateral connections within sensory representations. We suggest that observed perceptual effects reflect general mechanisms of perceptual inference for dynamic visual scene perception.

Information Bottleneck Approach to Spatial Attention Learning

The selective visual attention mechanism in the human visual system (HVS) restricts the amount of information to reach visual awareness for perceiving natural scenes, allowing near real-time information processing with limited computational capacity. This kind of selectivity acts as an ‘Information Bottleneck (IB)’, which seeks a trade-off between information compression and predictive accuracy. However, such information constraints are rarely explored in the attention mechanism for deep neural networks (DNNs). In this paper, we propose an IB-inspired spatial attention module for DNN structures built for visual recognition. The module takes as input an intermediate representation of the input image, and outputs a variational 2D attention map that minimizes the mutual information (MI) between the attention-modulated representation and the input, while maximizing the MI between the attention-modulated representation and the task label. To further restrict the information bypassed by the attention map, we quantize the continuous attention scores to a set of learnable anchor values during training. Extensive experiments show that the proposed IB-inspired spatial attention mechanism can yield attention maps that neatly highlight the regions of interest while suppressing backgrounds, and bootstrap standard DNN structures for visual recognition tasks (e.g., image classification, fine-grained recognition, cross-domain classification). The attention maps are interpretable for the decision making of the DNNs as verified in the experiments. Our code is available at this https URL.

Lancaster_etal_2021_JRR_preprint

Background: The purpose of this study was to examine the relationship between selective visual attention (SVA), reading decoding, listening comprehension, and reading comprehension in children with and without a reading disorder.Methods: We used longitudinal data from the Avon Longitudinal Study of Parents and Children (ALSPAC). We split children into four groups: Typical Readers, Dyslexics, Poor Comprehenders, and Comorbid Reading Disorder. We included measures of single word reading, nonword reading, spelling, phonological processing, vocabulary, receptive language, nonverbal intelligence, selective attention, and reading comprehension. We used ANOVA, correlations, and structural equation modeling (SEM) to examine the relationship between SVA and reading. We fit two possible models: SVA Indirect and SVA Direct. The difference between these models was the inclusion of a direct path from SVA to reading comprehension.Results: We examined an indirect model, where SVA predicted reading comprehension through word decoding and listening comprehension, and a direct model, which included a pathway from SVA to reading comprehension. Based on our ANOVA and correlation results, we collapsed the Dyslexic, Poor Comprehenders, and Comorbid Reading Disorder Groups for the SEM. We found evidence that for Typical Readers, an indirect model was the best fit, whereas the direct model was the best model for children with a reading disorder.Conclusions: Selective visual attention is related to reading comprehension. This relationship differs for children with and without a reading disorder.