Adaptation to audiovisual asynchrony occurs rapidly

2013 ◽  
Vol 26 (1-2) ◽  
pp. 46 ◽  
Author(s):  
Erik van der Burg ◽  
John Cass ◽  
David Alais
Keyword(s):  
Audiovisual Asynchrony

Short-term experience increases infants’ sensitivity to audiovisual asynchrony

2012 ◽  
Vol 35 (4) ◽  
pp. 815-818 ◽  
Author(s):  
Ferran Pons ◽  
Maria Teixidó ◽  
Joel Garcia-Morera ◽  
Jordi Navarra
Keyword(s):  
Short Term ◽  
Audiovisual Asynchrony

scholarly journals Surmising synchrony of sound and sight: Factors explaining variance of audiovisual integration in hurdling, tap dancing and drumming

PLoS ONE ◽  
2021 ◽  
Vol 16 (7) ◽  
pp. e0253130
Author(s):  
Nina Heins ◽  
Jennifer Pomp ◽  
Daniel S. Kluger ◽  
Stefan Vinbrüx ◽  
Ima Trempler ◽  
...  
Keyword(s):  
Sound Production ◽  
Audiovisual Integration ◽  
Visual Signals ◽  
Whole Body ◽  
Auditory Signal ◽  
Natural Action ◽  
Simultaneity Judgment ◽  
Audiovisual Stimuli ◽  
High Event ◽  
Audiovisual Asynchrony

Auditory and visual percepts are integrated even when they are not perfectly temporally aligned with each other, especially when the visual signal precedes the auditory signal. This window of temporal integration for asynchronous audiovisual stimuli is relatively well examined in the case of speech, while other natural action-induced sounds have been widely neglected. Here, we studied the detection of audiovisual asynchrony in three different whole-body actions with natural action-induced sounds–hurdling, tap dancing and drumming. In Study 1, we examined whether audiovisual asynchrony detection, assessed by a simultaneity judgment task, differs as a function of sound production intentionality. Based on previous findings, we expected that auditory and visual signals should be integrated over a wider temporal window for actions creating sounds intentionally (tap dancing), compared to actions creating sounds incidentally (hurdling). While percentages of perceived synchrony differed in the expected way, we identified two further factors, namely high event density and low rhythmicity, to induce higher synchrony ratings as well. Therefore, we systematically varied event density and rhythmicity in Study 2, this time using drumming stimuli to exert full control over these variables, and the same simultaneity judgment tasks. Results suggest that high event density leads to a bias to integrate rather than segregate auditory and visual signals, even at relatively large asynchronies. Rhythmicity had a similar, albeit weaker effect, when event density was low. Our findings demonstrate that shorter asynchronies and visual-first asynchronies lead to higher synchrony ratings of whole-body action, pointing to clear parallels with audiovisual integration in speech perception. Overconfidence in the naturally expected, that is, synchrony of sound and sight, was stronger for intentional (vs. incidental) sound production and for movements with high (vs. low) rhythmicity, presumably because both encourage predictive processes. In contrast, high event density appears to increase synchronicity judgments simply because it makes the detection of audiovisual asynchrony more difficult. More studies using real-life audiovisual stimuli with varying event densities and rhythmicities are needed to fully uncover the general mechanisms of audiovisual integration.

scholarly journals Adaptation to audiovisual asynchrony modulates the speeded detection of sound

2009 ◽  
Vol 106 (23) ◽  
pp. 9169-9173 ◽  
Author(s):  
J. Navarra ◽  
J. Hartcher-O'Brien ◽  
E. Piazza ◽  
C. Spence
Keyword(s):  
Audiovisual Asynchrony

scholarly journals Perception of audio-visual speech synchrony in Spanish-speaking children with and without specific language impairment

2012 ◽  
Vol 40 (3) ◽  
pp. 687-700 ◽  
Author(s):  
FERRAN PONS ◽  
LLORENÇ ANDREU ◽  
MONICA SANZ-TORRENT ◽  
LUCÍA BUIL-LEGAZ ◽  
DAVID J. LEWKOWICZ
Keyword(s):  
Speech Perception ◽  
Speech Processing ◽  
Language Impairment ◽  
Specific Language Impairment ◽  
Visual Speech ◽  
Specific Language ◽  
Visual Component ◽  
Spanish Speaking ◽  
Auditory Component ◽  
Audiovisual Asynchrony

ABSTRACTSpeech perception involves the integration of auditory and visual articulatory information, and thus requires the perception of temporal synchrony between this information. There is evidence that children with specific language impairment (SLI) have difficulty with auditory speech perception but it is not known if this is also true for the integration of auditory and visual speech. Twenty Spanish-speaking children with SLI, twenty typically developing age-matched Spanish-speaking children, and twenty Spanish-speaking children matched for MLU-w participated in an eye-tracking study to investigate the perception of audiovisual speech synchrony. Results revealed that children with typical language development perceived an audiovisual asynchrony of 666 ms regardless of whether the auditory or visual speech attribute led the other one. Children with SLI only detected the 666 ms asynchrony when the auditory component followed the visual component. None of the groups perceived an audiovisual asynchrony of 366 ms. These results suggest that the difficulty of speech processing by children with SLI would also involve difficulties in integrating auditory and visual aspects of speech perception.

scholarly journals Rapid Recalibration to Audiovisual Asynchrony

2013 ◽  
Vol 33 (37) ◽  
pp. 14633-14637 ◽  
Author(s):  
E. Van der Burg ◽  
D. Alais ◽  
J. Cass
Keyword(s):  
Audiovisual Asynchrony

The role of audiovisual asynchrony in person recognition

2010 ◽  
Vol 63 (1) ◽  
pp. 23-30 ◽  
Author(s):  
David M. C. Robertson ◽  
Stefan R. Schweinberger
Keyword(s):  
Person Recognition ◽  
Audiovisual Asynchrony
Sign in / Sign up

Export Citation Format

Share Document