Enhanced temporal binding of audiovisual information in the bilingual brain

2018 ◽  
Vol 22 (04) ◽  
pp. 752-762 ◽  
Author(s):  
GAVIN M. BIDELMAN ◽  
SHELLEY T. HEATH
Keyword(s):  
Visual Cues ◽  
Multisensory Processing ◽  
Temporal Integration ◽  
Stimulus Onset ◽  
Audiovisual Integration ◽  
Auditory Modality ◽  
Temporal Binding ◽  
Temporal Binding Window ◽  
Illusory Perception ◽  
Double Flash

We asked whether bilinguals’ benefits reach beyond the auditory modality to benefit multisensory processing. We measured audiovisual integration of auditory and visual cues in monolinguals and bilinguals via the double-flash illusion where the presentation of multiple auditory stimuli concurrent with a single visual flash induces an illusory perception of multiple flashes. We varied stimulus onset asynchrony (SOA) between auditory and visual cues to measure the “temporal binding window” where listeners fuse a single percept. Bilinguals showed faster responses and were less susceptible to the double-flash illusion than monolinguals. Moreover, monolinguals showed poorer sensitivity in AV processing compared to bilinguals. The width of bilinguals’ AV temporal integration window was narrower than monolinguals’ for both leading and lagging SOAs (Biling.: -65–112 ms; Mono.: -193 – 112 ms). Our results suggest the plasticity afforded by speaking multiple languages enhances multisensory integration and audiovisual binding in the bilingual brain.

scholarly journals Autistic Communication and Imagination Sub-Traits Are Related to Audiovisual Temporal Integration in the Stream–Bounce Illusion

2020 ◽  
pp. 1-16
Author(s):  
Ayako Yaguchi ◽  
Souta Hidaka
Keyword(s):  
Social Communication ◽  
Multisensory Processing ◽  
Temporal Integration ◽  
Autism Spectrum ◽  
Repetitive Behaviors ◽  
Audiovisual Integration ◽  
Autism Spectrum Quotient ◽  
Sensory Reactivity ◽  
Experimental Trials ◽  
Double Flash

Abstract Autism spectrum disorder (ASD) is characterized by atypical social communication and restricted and repetitive behaviors; such traits are continuously distributed across nonclinical and clinical populations. Recently, relationships between ASD traits and low-level multisensory processing have been investigated, because atypical sensory reactivity has been regarded as a diagnostic criterion of ASD. Studies regarding an audiovisual illusion (the double-flash illusion) reported that social communication difficulties are related to temporal aspects of audiovisual integration. This study investigated whether similar relationships exist in another audiovisual illusion (the stream–bounce effect). In this illusion, two visual objects move toward each other, coincide, and pass each other, and the presentation of a transient sound at their coincidence induces a dominant perception that they bounce away from each other. Typically developing adults were recruited to perform experimental trials involving the stream–bounce effect. We measured their ASD traits using the Autism-Spectrum Quotient. The total quotient score was not related to any behavioral measurements of the effect. In contrast, for participants with higher difficulty in communication, the greatest magnitude of the stream–bounce effect occurred when the presentation timing of the sound tended to follow the visual coincidence. Participants with higher difficulty in imagination also showed the greatest magnitude of the effect when the presentation timing of the sound preceded that of the visual coincidence. Our findings regarding the stream–bounce effect, along with previous findings regarding the double-flash illusion, suggest that atypical temporal audiovisual integration is uniquely related to ASD sub-traits, especially in social communication.

Distinct Autistic Traits Are Differentially Associated With the Width of the Multisensory Temporal Binding Window

2018 ◽  
Vol 31 (6) ◽  
pp. 523-536 ◽  
Author(s):  
Ayako Yaguchi ◽  
Souta Hidaka
Keyword(s):  
Neurodevelopmental Disorder ◽  
Continuous Distribution ◽  
Autistic Traits ◽  
Autism Spectrum ◽  
Audiovisual Integration ◽  
Autism Spectrum Quotient ◽  
Temporal Binding ◽  
Restricted Interests ◽  
Temporal Binding Window ◽  
And Behavior

Autism spectrum disorder (ASD) is a neurodevelopmental disorder characterized by deficits in social communication and interaction, and restricted interests and behavior patterns. These characteristics are considered as a continuous distribution in the general population. People with ASD show atypical temporal processing in multisensory integration. Regarding the flash–beep illusion, which refers to how a single flash can be illusorily perceived as multiple flashes when multiple auditory beeps are concurrently presented, some studies reported that people with ASD have a wider temporal binding window and greater integration than typically developed people; others found the opposite or inconsistent tendencies. Here, we investigated the relationships between the manner of the flash–beep illusion and the various dimensions of ASD traits by estimating the degree of typically developed participants’ ASD traits including five subscales using the Autism-Spectrum Quotient. We found that stronger ASD traits of communication and social skill were associated with a wider and narrower temporal binding window respectively. These results suggest that specific ASD traits are differently involved in the particular temporal binding processes of audiovisual integration.

Reduced Temporal Sensitivity in Obesity: Evidence From a Simultaneity Judgement Task

2020 ◽  
Vol 33 (7) ◽  
pp. 777-791
Author(s):  
Sofia Tagini ◽  
Federica Scarpina ◽  
Massimo Scacchi ◽  
Alessandro Mauro ◽  
Massimiliano Zampini
Keyword(s):  
Multisensory Integration ◽  
Temporal Discrimination ◽  
Preliminary Evidence ◽  
Stimulus Onset ◽  
Judgment Task ◽  
Healthy Weight ◽  
Temporal Binding ◽  
Temporal Binding Window ◽  
Audiovisual Asynchrony

Abstract Preliminary evidence showed a reduced temporal sensitivity (i.e., larger temporal binding window) to audiovisual asynchrony in obesity. Our aim was to extend this investigation to visuotactile stimuli, comparing individuals of healthy weight and with obesity in a simultaneity judgment task. We verified that individuals with obesity had a larger temporal binding window than healthy-weight individuals, meaning that they tend to integrate visuotactile stimuli over an extended range of stimulus onset asynchronies. We point out that our finding gives evidence in support of a more pervasive impairment of the temporal discrimination of co-occurrent stimuli, which might affect multisensory integration in obesity. We discuss our results referring to the possible role of atypical oscillatory neural activity and structural anomalies in affecting the perception of simultaneity between multisensory stimuli in obesity. Finally, we highlight the urgency of a deeper understanding of multisensory integration in obesity at least for two reasons. First, multisensory bodily illusions might be used to manipulate body dissatisfaction in obesity. Second, multisensory integration anomalies in obesity might lead to a dissimilar perception of food, encouraging overeating behaviours.

scholarly journals The Magnitude of the Sound-Induced Flash Illusion does not Increase as a Function of Visual Stimulus Eccentricity in Peripheral Vision

2021 ◽  
Author(s):  
Niall Gavin ◽  
David McGovern ◽  
Rebecca Hirst
Keyword(s):  
Visual Stimulus ◽  
Peripheral Vision ◽  
Visual Stimuli ◽  
Stimulus Onset ◽  
Temporal Binding ◽  
Temporal Binding Window ◽  
Audiovisual Stimuli ◽  
Illusory Percept ◽  
Onset Asynchrony ◽  
The Impact

The sound-induced flash illusion occurs when a rapidly presented visual stimulus is accompanied by two auditory stimuli, creating the illusory percept of two visual stimuli. While much research has focused on how the temporal proximity of the audiovisual stimuli impacts susceptibility to the illusion, comparatively less research has been dedicated to investigating the impact of spatial manipulations. Here, we aimed to assess whether manipulating the eccentricity of visual flash stimuli altered the properties of the temporal binding window associated with the SIFI. Twenty participants were required to report whether they perceived one or two flashes that were concurrently presented with one or two beeps. Visual stimuli were presented at one of four different retinal eccentricities (2.5, 5, 7.5 or 10 degrees below fixation) and audiovisual stimuli were separated by one of eight stimulus-onset asynchronies. In keeping with previous findings, increasing stimulus-onset asynchrony between the auditory and visual stimuli led to a marked decrease in susceptibility to the illusion allowing us to estimate the width and amplitude of the temporal binding window. However, varying the eccentricity of the visual stimulus had no effect on either the width or the peak amplitude of the temporal binding window, with a similar pattern of results observed for both the “fission” and “fusion” variants of the illusion. Thus, spatial manipulations of the audiovisual stimuli used to elicit the SIFI appear to have a weaker effect on the integration of sensory signals than temporal manipulations, a finding which has implications for neuroanatomical models of multisensory integration.

The Bodily Self in Schizophrenia

2018 ◽  
pp. 1108-1124
Author(s):  
Francesca Ferri ◽  
Vittorio Gallese
Keyword(s):  
Empirical Evidence ◽  
Multisensory Processing ◽  
Brain Activity ◽  
Sense Of Agency ◽  
Body Ownership ◽  
Temporal Binding ◽  
Spontaneous Brain Activity ◽  
Temporal Binding Window ◽  
Body Experiences

This chapter illustrates the most recent empirical evidence of anomalies of body experiences in schizophrenia and schizotypy, with a specific focus on body ownership, sense of agency, and self-other boundary. The authors link these anomalies of body experiences to a reduced temporal sensitivity of multisensory processing, as indexed by an abnormally wide temporal binding window, which has been reported in both schizophrenia and schizotypy. Then, the authors propose specific neurobiological markers possibly associated with temporal anomalies of multisensory processing and, consequently, body experiences in schizophrenia and schizotypy. They refer specifically to the role of disorganized patterns of spontaneous brain activity, and the underlying excitation/inhibition imbalance, as a possible key to understanding anomalies of bodily-self experiences in self-disorders.

Migraine, motion sensitivity, and temporal binding

2012 ◽  
Vol 25 (0) ◽  
pp. 209
Author(s):  
Timothy E. Hullar ◽  
Alexander K. Malone ◽  
Spencer B. Smith ◽  
Nai-Yuan N. Chang
Keyword(s):  
Temporal Integration ◽  
Normal Subjects ◽  
Vestibular Disorder ◽  
Temporal Binding ◽  
Motion Sensitivity ◽  
Sensory Inputs ◽  
Migraine Headaches ◽  
Temporal Binding Window ◽  
History Of ◽  
Peripheral Vestibular Disorder

Little is known about vestibular-related timing processes in patients with disequilibrium. Patients with a history of migraine headaches often complain of significant motion sensitivity and long-term vague imbalance inconsistent with a peripheral vestibular disorder. Some of these people have episodic spells of severe vertigo termed ‘vestibular migraines’. Other patients have no history of migraine but do report significant motion sensitivity. Motion sensitivity has typically been explained as a mismatch between the amplitude of vestibular and other (typically visual) sensory inputs. Another possibility is that motion sensitive patients may suffer from a mismatch in the temporal integration of vestibular and other sensory inputs. Here, we compared the temporal binding window (TBW) of vestibular + auditory stimuli in normal subjects, subjects with motion sensitivity, and those with both migraine and motion sensitivity. We asked subjects undergoing earth-vertical sinusoidal rotations at 0.5 Hz, 128°/s to identify whether a metronome-like series of tone bursts was synchronous with their cyclic motion. We calculated the TBW as the range in time encompassing the middle 68% of the area under the psychometric curve. The TBW in normal subjects was 312 ± 135 ms (mean ± SD), in subjects with motion sensitivity was 454 ± 103 ms, and in subjects with migraine and motion sensitivity was 451 ± 124 ms. The TBW of normal subjects was significantly shorter than the other groups. Temporal errors in perception, as manifested by a prolongation of the TBW, are a plausible mechanism for imbalance in patients with migraine and motion sensitivity.

scholarly journals Atypical Multisensory Integration and the Temporal Binding Window in Autism Spectrum Disorder

2020 ◽  
Vol 50 (11) ◽  
pp. 3944-3956 ◽  
Author(s):  
Sayaka Kawakami ◽  
Shota Uono ◽  
Sadao Otsuka ◽  
Sayaka Yoshimura ◽  
Shuo Zhao ◽  
...  
Keyword(s):  
Autism Spectrum Disorder ◽  
Multisensory Integration ◽  
Temporal Order Judgment ◽  
Multisensory Processing ◽  
Autism Spectrum ◽  
Judgment Task ◽  
Spectrum Disorder ◽  
Temporal Binding ◽  
Adults With Autism ◽  
Temporal Binding Window

Abstract The present study examined the relationship between multisensory integration and the temporal binding window (TBW) for multisensory processing in adults with Autism spectrum disorder (ASD). The ASD group was less likely than the typically developing group to perceive an illusory flash induced by multisensory integration during a sound-induced flash illusion (SIFI) task. Although both groups showed comparable TBWs during the multisensory temporal order judgment task, correlation analyses and Bayes factors provided moderate evidence that the reduced SIFI susceptibility was associated with the narrow TBW in the ASD group. These results suggest that the individuals with ASD exhibited atypical multisensory integration and that individual differences in the efficacy of this process might be affected by the temporal processing of multisensory information.

Audiovisual Integration of Time-to-Contact Information for Approaching Objects

2016 ◽  
Vol 29 (4-5) ◽  
pp. 365-395 ◽  
Author(s):  
Patricia R. DeLucia ◽  
Doug Preddy ◽  
Daniel Oberfeld
Keyword(s):  
Visual Information ◽  
Visual Cues ◽  
Relative Rate ◽  
Rate Of Change ◽  
Audiovisual Integration ◽  
Reliable Information ◽  
Auditory Modality ◽  
Visual Condition ◽  
Time To Collision ◽  
Expansion Pattern

Previous studies of time-to-collision (TTC) judgments of approaching objects focused on effectiveness of visual TTC information in the optical expansion pattern (e.g., visual tau, disparity). Fewer studies examined effectiveness of auditory TTC information in the pattern of increasing intensity (auditory tau), or measured integration of auditory and visual TTC information. Here, participants judged TTC of an approaching object presented in the visual or auditory modality, or both concurrently. TTC information provided by the modalities was jittered slightly against each other, so that auditory and visual TTC were not perfectly correlated. A psychophysical reverse correlation approach was used to estimate the influence of auditory and visual cues on TTC estimates. TTC estimates were shorter in the auditory than the visual condition. On average, TTC judgments in the audiovisual condition were not significantly different from judgments in the visual condition. However, multiple regression analyses showed that TTC estimates were based on both auditory and visual information. Although heuristic cues (final sound pressure level, final optical size) and more reliable information (relative rate of change in acoustic intensity, optical expansion) contributed to auditory and visual judgments, the effect of heuristics was greater in the auditory condition. Although auditory and visual information influenced judgments, concurrent presentation of both did not result in lower response variability compared to presentation of either one alone; there was no multimodal advantage. The relative weightings of heuristics and more reliable information differed between auditory and visual TTC judgments, and when both were available, visual information was weighted more heavily.

Audiovisual Simultaneity Judgements in Synaesthesia

2021 ◽  
pp. 1-12
Author(s):  
Anna Borgolte ◽  
Ahmad Bransi ◽  
Johanna Seifert ◽  
Sermin Toto ◽  
Gregor R. Szycik ◽  
...  
Keyword(s):  
Visual Stimulus ◽  
Temporal Order ◽  
Multisensory Processing ◽  
Sensory Modality ◽  
Stimulus Onset ◽  
Control Subjects ◽  
Visual Events

Abstract Synaesthesia is a multimodal phenomenon in which the activation of one sensory modality leads to an involuntary additional experience in another sensory modality. To date, normal multisensory processing has hardly been investigated in synaesthetes. In the present study we examine processes of audiovisual separation in synaesthesia by using a simultaneity judgement task. Subjects were asked to indicate whether an acoustic and a visual stimulus occurred simultaneously or not. Stimulus onset asynchronies (SOA) as well as the temporal order of the stimuli were systematically varied. Our results demonstrate that synaesthetes are better in separating auditory and visual events than control subjects, but only when vision leads.

Sign in / Sign up

Export Citation Format

Share Document