scholarly journals Beat gestures modulate auditory integration in speech perception

2012 ◽  
Vol 25 (0) ◽  
pp. 86
Author(s):  
Emmanuel Biau ◽  
Salvador Soto-Faraco

In everyday life, people interact with each others through verbal communication but also by spontaneous beat gestures which are a very important part of the paralinguistic context during face-to-face conversations. Nonetheless, their role and neural correlates have been seldom addressed. Here we investigate the time course of beat-speech integration in natural speech perception conditions. We measured event-related potentials to words pronounced with or without an accompanying beat gesture while participants attended to a political speech. When the speaker was on sight, words pronounced with a beat gesture elicited appositive shift in ERPs at early sensory (before 100 ms) and at a later time window coinciding with the auditory component P2. This result remained partially true even when the auditory signal was removed from audiovisual signal. Interestingly, there was no difference with words pronounced without gesture when participants listened to the same speech passage without viewing of the speaker. We conclude that in a naturalistic speech context, beat gestures are integrated with speech early on in time and modulate the sensory/phonological levels of processing. We propose that these results suggest a possible role of beats as a highlighter, helping direct the focus of attention of the listener on important information, rather than adding information per se. Beat gestures would modulate how verbal information is treated.

2010 ◽  
Vol 10 ◽  
pp. 329-339 ◽  
Author(s):  
Torsten Rahne ◽  
Michael Ziese ◽  
Dorothea Rostalski ◽  
Roland Mühler

This paper describes a logatome discrimination test for the assessment of speech perception in cochlear implant users (CI users), based on a multilingual speech database, the Oldenburg Logatome Corpus, which was originally recorded for the comparison of human and automated speech recognition. The logatome discrimination task is based on the presentation of 100 logatome pairs (i.e., nonsense syllables) with balanced representations of alternating “vowel-replacement” and “consonant-replacement” paradigms in order to assess phoneme confusions. Thirteen adult normal hearing listeners and eight adult CI users, including both good and poor performers, were included in the study and completed the test after their speech intelligibility abilities were evaluated with an established sentence test in noise. Furthermore, the discrimination abilities were measured electrophysiologically by recording the mismatch negativity (MMN) as a component of auditory event-related potentials. The results show a clear MMN response only for normal hearing listeners and CI users with good performance, correlating with their logatome discrimination abilities. Higher discrimination scores for vowel-replacement paradigms than for the consonant-replacement paradigms were found. We conclude that the logatome discrimination test is well suited to monitor the speech perception skills of CI users. Due to the large number of available spoken logatome items, the Oldenburg Logatome Corpus appears to provide a useful and powerful basis for further development of speech perception tests for CI users.


2018 ◽  
Vol 30 (05) ◽  
pp. 1850034
Author(s):  
Yeganeh Shahsavar ◽  
Majid Ghoshuni

The main goal of this event-related potentials (ERPs) study was to assess the effects of stimulations in Stroop task in brain activities of patients with different degrees of depression. Eighteen patients (10 males, with the mean age [Formula: see text]) were asked to fill out Beck’s depression questionnaire. Electroencephalographic (EEG) signals of subjects were recorded in three channels (Pz, Cz, and Fz) during Stroop test. This test entailed 360 stimulations, which included 120 congruent, 120 incongruent, and 120 neutral stimulations. To analyze the data, 18 time features in each type of stimulus were extracted from the ERP components and the optimal features were selected. The correlation between the subjects’ scores in Beck’s depression questionnaires and the extracted time features in each recording channel was calculated in order to select the best features. Total area, and peak-to-peak time window in the Cz channel in both the congruent and incongruent stimulus showed significant correlation with Beck scores, with [Formula: see text], [Formula: see text] and [Formula: see text], [Formula: see text], respectively. Consequently, given the correlation between time features and the subjects’ Beck scores with different degrees of depression, it can be interpreted that in case of growth in degrees of depression, stimulations involving congruent images would produce more challenging interferences for the patients compared to incongruent stimulations which can be more effective in diagnosing the level of disorder.


2007 ◽  
Vol 19 (10) ◽  
pp. 1595-1608 ◽  
Author(s):  
Leanne M. Williams ◽  
Andrew H. Kemp ◽  
Kim Felmingham ◽  
Belinda J. Liddell ◽  
Donna M. Palmer ◽  
...  

Although biases toward signals of fear may be an evolutionary adaptation necessary for survival, heightened biases may be maladaptive and associated with anxiety or depression. In this study, event-related potentials (ERPs) were used to examine the time course of neural responses to facial fear stimuli (versus neutral) presented overtly (for 500 msec with conscious attention) and covertly (for 10 msec with immediate masking to preclude conscious awareness) in 257 nonclinical subjects. We also examined the impact of trait anxiety and depression, assessed using psychometric ratings, on the time course of ERPs. In the total subject group, controlled biases to overtly processed fear were reflected in an enhancement of ERPs associated with structural encoding (120–220 msec) and sustained evaluation persisting from 250 msec and beyond, following a temporo-occipital to frontal topography. By contrast, covert fear processing elicited automatic biases, reflected in an enhancement of ERPs prior to structural encoding (80–180 msec) and again in the period associated with automatic orienting and emotion encoding (230–330 msec), which followed the reverse frontal to temporo-occipital topography. Higher levels of trait anxiety (in the clinical range) were distinguished by a heightened bias to covert fear (speeding of early ERPs), compared to higher depression which was associated with an opposing bias to overt fear (slowing of later ERPs). Anxiety also heightened early responses to covert fear, and depression to overt fear, with subsequent deficits in emotion encoding in each case. These findings are consistent with neural biases to signals of fear which operate automatically and during controlled processing, feasibly supported by parallel networks. Heightened automatic biases in anxiety may contribute to a cycle of hypervigilance and anxious thoughts, whereas depression may represent a “burnt out” emotional state in which evaluation of fear stimuli is prolonged only when conscious attention is allocated.


2015 ◽  
Vol 27 (2) ◽  
pp. 459-476 ◽  
Author(s):  
Sergey A. Kornilov ◽  
James S. Magnuson ◽  
Natalia Rakhlin ◽  
Nicole Landi ◽  
Elena L. Grigorenko

AbstractLexical processing deficits in children with developmental language disorder (DLD) have been postulated to arise as sequelae of their grammatical deficits (either directly or via compensatory mechanisms) and vice versa. We examined event-related potential indices of lexical processing in children with DLD (n= 23) and their typically developing peers (n= 16) using a picture–word matching paradigm. We found that children with DLD showed markedly reduced N400 amplitudes in response both to auditorily presented words that had initial phonological overlap with the name of the pictured object and to words that were not semantically or phonologically related to the pictured object. Moreover, this reduction was related to behavioral indices of phonological and lexical but not grammatical development. We also found that children with DLD showed a depressed phonological mapping negativity component in the early time window, suggesting deficits in phonological processing or early lexical access. The results are partially consistent with the overactivation account of lexical processing deficits in DLD and point to the relative functional independence of lexical/phonological and grammatical deficits in DLD, supporting a multidimensional view of the disorder. The results also, although indirectly, support the neuroplasticity account of DLD, according to which language impairment affects brain development and shapes the specific patterns of brain responses to language stimuli.


2016 ◽  
Vol 23 (1) ◽  
pp. 78-89 ◽  
Author(s):  
Anthony J. Angwin ◽  
Nadeeka N.W. Dissanayaka ◽  
Alison Moorcroft ◽  
Katie L. McMahon ◽  
Peter A. Silburn ◽  
...  

AbstractObjectives: Cognitive-linguistic impairments in Parkinson’s disease (PD) have been well documented; however, few studies have explored the neurophysiological underpinnings of semantic deficits in PD. This study investigated semantic function in PD using event-related potentials. Methods: Eighteen people with PD and 18 healthy controls performed a semantic judgement task on written word pairs that were either congruent or incongruent. Results: The mean amplitude of the N400 for new incongruent word pairs was similar for both groups, however the onset latency was delayed in the PD group. Further analysis of the data revealed that both groups demonstrated attenuation of the N400 for repeated incongruent trials, as well as attenuation of the P600 component for repeated congruent trials. Conclusions: The presence of N400 congruity and N400 repetition effects in the PD group suggests that semantic processing is generally intact, but with a slower time course as evidenced by the delayed N400. Additional research will be required to determine whether N400 and P600 repetition effects are sensitive to further cognitive decline in PD. (JINS, 2017, 23, 78–89)


2017 ◽  
Vol 42 (3) ◽  
pp. 357-372 ◽  
Author(s):  
Jarmo Hämäläinen ◽  
Nicole Landi ◽  
Otto Loberg ◽  
Kaisa Lohvansuu ◽  
Kenneth Pugh ◽  
...  

Development of reading skills has been shown to be tightly linked to phonological processing skills and to some extent to speech perception abilities. Although speech perception is also known to play a role in reading development, it is not clear which processes underlie this connection. Using event-related potentials (ERPs) we investigated the speech processing mechanisms for common and uncommon sound contrasts (/ba/-/da/-/ga/ and /ata/-/at: a/) with respect to the native language of school-age children in Finland and the US. In addition, a comprehensive behavioral test battery of reading and phonological processing was administered. ERPs revealed that the children could discriminate between the speech sound contrasts (place of articulation and phoneme length) regardless of their native language. No differences emerged between the Finnish and US children in their change detection responses. The brain responses to the phoneme length contrast, however, correlated robustly with reading scores in the US children, with larger responses being linked to poorer reading skills. Finnish children also showed correlations between the reading and phonological measures and ERP responses, but the pattern of results was not as clear as for the US children. The results indicate that speech perception is linked to reading skills and this link is more robust for uncommon speech sound contrasts.


2011 ◽  
Vol 86 (3) ◽  
pp. 210-218 ◽  
Author(s):  
Clara D. Martin ◽  
Francisco Barcelo ◽  
Mireia Hernandez ◽  
Albert Costa

2014 ◽  
Vol 316 ◽  
pp. 110-121 ◽  
Author(s):  
Takahiro Soshi ◽  
Satoko Hisanaga ◽  
Narihiro Kodama ◽  
Yori Kanekama ◽  
Yasuhiro Samejima ◽  
...  

2004 ◽  
Vol 16 (8) ◽  
pp. 1363-1374 ◽  
Author(s):  
Teresa V. Mitchell ◽  
Helen J. Neville

Recent reports have documented greater plasticity in the dorsal visual stream as compared with the ventral visual stream. This study sought to test the hypothesis that this greater plasticity may be related to a more protracted period of development in the dorsal as compared with the ventral stream. Age-related effects on event-related potentials (ERPs) elicited by motion and color stimuli, designed to activate the two visual streams, were assessed in healthy individuals aged 6 years through adulthood. Although significant developmental effects were observed in amplitudes of ERPs to both color and motion stimuli, marked latency effects were observed only in response to motion. These results provide support for the hypothesis that the dorsal stream displays a longer developmental time course across the early school years than the ventral stream. Implications for neural and behavioral plasticity are discussed.


Sign in / Sign up

Export Citation Format

Share Document