Multisensory processes can compensate for attention deficits in schizophrenia

Studies on schizophrenia (SCZ) and aberrant multisensory integration (MSI) show conflicting results. These divergent results are potentially confounded by attention deficits in SCZ. To test this, we examined the interplay between MSI and intersensory attention (IA) in healthy controls (N=27) and in SCZ (N=27). Evoked brain potentials to unisensory-visual (V), unisensory-tactile (T) or bisensory VT stimuli were measured with high density electroencephalography, whilst participants attended block-wise to either visual or tactile inputs. Behaviourally, IA effects in SCZ are uncompromised for bisensory stimuli, but diminished for unisensory stimuli. At the neural level, we observed reduced IA effects for bisensory stimuli over mediofrontal scalp regions (230-320ms) in SCZ. The analysis of MSI revealed multiple phases of integration over occipital and frontal scalp regions (240-364ms), with comparable performance between HC and SCZ. The magnitudes of IA and MSI effects were both positively related to the behavioural performance in SCZ, indicating that IA and MSI mutually facilitate bisensory stimulus processing. Our study suggests that widely intact MSI, which facilitates stimulus processing, can compensate for top-down attention deficits in SCZ. Further, the interplay of IA and MSI implies that differences in attentional demands may account for previous conflicting findings on MSI in schizophrenia.

Auditory features modelling demonstrates sound envelope representation in striate cortex

SummaryPrimary visual cortex is no longer considered exclusively visual in its function. Proofs that its activity plays a role in multisensory processes have accrued. Here we provide evidence that, in absence of retinal input, V1 maps sound envelope information. We modeled amplitude changes occurring at typical speech envelope time-scales of four hierarchically-organized categories of natural (or synthetically derived) sounds. Using functional magnetic resonance, we assessed whether sound amplitude variations were represented in striate cortex and, as a control, in the temporal cortex. Sound amplitude mapping in V1 occurred regardless of the semantic content, was dissociated from the spectral properties of sounds and was not restricted to speech material. As in the temporal cortex, a spatially organized representation of amplitude modulation frequencies emerged in V1. Our results demonstrate that human striate cortex is a locus of representation of sound attributes.

Multisensory gains in simple detection predict global cognition in schoolchildren

The capacity to integrate information from different senses is central for coherent perception across the lifespan from infancy onwards. Later in life, multisensory processes are related to cognitive functions, such as speech or social communication. During learning, multisensory processes can in fact enhance subsequent recognition memory for unisensory objects. These benefits can even be predicted; adults’ recognition memory performance is shaped by earlier responses in the same task to multisensory – but not unisensory – information. Everyday environments where learning occurs, such as classrooms, are inherently multisensory in nature. Multisensory processes may therefore scaffold healthy cognitive development. Here, we provide the first evidence of a predictive relationship between multisensory benefits in simple detection and higher-level cognition that is present already in schoolchildren. Multiple regression analyses indicated that the extent to which a child (N=68; aged 4.5 –15years) exhibited multisensory benefits on a simple detection task not only predicted benefits on a continuous recognition task involving naturalistic objects (p=0.009), even when controlling for age. The same relative multisensory benefit also predicted working memory scores (p=0.023) and fluid intelligence scores (p=0.033) as measured using age-standardised test batteries. By contrast, gains in unisensory detection did not show significant prediction of any of the above global cognition measures. Our findings show that low-level multisensory processes predict higher-order memory and cognition already during childhood, even if still subject to ongoing maturation. These results call for revision of traditional models of cognitive development (and likely also education) to account for the role of multisensory processing, while also opening exciting opportunities to facilitate early learning through multisensory programs. More generally, these data suggest that a simple detection task could provide direct insights into the integrity of global cognition in schoolchildren and could be further developed as a readily-implemented and cost-effective screening tool for neurodevelopmental disorders, particularly in cases when standard neuropsychological tests are infeasible or unavailable.

Stability and flexibility in multisensory sampling: insights from perceptual illusions

Neural, oscillatory, and computational counterparts of multisensory processing remain a crucial challenge for neuroscientists. Converging evidence underlines a certain efficiency in balancing stability and flexibility of sensory sampling, supporting the general idea that multiple parallel and hierarchically organized processing stages in the brain contribute to our understanding of the (sensory/perceptual) world. Intriguingly, how temporal dynamics impact and modulate multisensory processes in our brain can be investigated benefiting from studies on perceptual illusions.