scholarly journals Happy you, happy me: expressive changes on a stranger’s voice recruit faster implicit processes than self-produced expressions

2019 ◽  
Author(s):  
Laura Rachman ◽  
Stéphanie Dubal ◽  
Jean-Julien Aucouturier

AbstractIn social interactions, people have to pay attention both to the what and who. In particular, expressive changes heard on speech signals have to be integrated with speaker identity, differentiating e.g. self- and other-produced signals. While previous research has shown that self-related visual information processing is facilitated compared to non-self stimuli, evidence in the auditory modality remains mixed. Here, we compared electroencephalography (EEG) responses to expressive changes in sequence of self- or other-produced speech sounds, using a mismatch negativity (MMN) passive oddball paradigm. Critically, to control for speaker differences, we used programmable acoustic transformations to create voice deviants which differed from standards in exactly the same manner, making EEG responses to such deviations comparable between sequences. Our results indicate that expressive changes on a stranger’s voice are highly prioritized in auditory processing compared to identical changes on the self-voice. Other-voice deviants generate earlier MMN onset responses and involve stronger cortical activations in a left motor and somatosensory network suggestive of an increased recruitment of resources for less internally predictable, and therefore perhaps more socially relevant, signals.

2014 ◽  
Vol 26 (12) ◽  
pp. 2827-2839 ◽  
Author(s):  
Maria J. S. Guerreiro ◽  
Joaquin A. Anguera ◽  
Jyoti Mishra ◽  
Pascal W. M. Van Gerven ◽  
Adam Gazzaley

Selective attention involves top–down modulation of sensory cortical areas, such that responses to relevant information are enhanced whereas responses to irrelevant information are suppressed. Suppression of irrelevant information, unlike enhancement of relevant information, has been shown to be deficient in aging. Although these attentional mechanisms have been well characterized within the visual modality, little is known about these mechanisms when attention is selectively allocated across sensory modalities. The present EEG study addressed this issue by testing younger and older participants in three different tasks: Participants attended to the visual modality and ignored the auditory modality, attended to the auditory modality and ignored the visual modality, or passively perceived information presented through either modality. We found overall modulation of visual and auditory processing during cross-modal selective attention in both age groups. Top–down modulation of visual processing was observed as a trend toward enhancement of visual information in the setting of auditory distraction, but no significant suppression of visual distraction when auditory information was relevant. Top–down modulation of auditory processing, on the other hand, was observed as suppression of auditory distraction when visual stimuli were relevant, but no significant enhancement of auditory information in the setting of visual distraction. In addition, greater visual enhancement was associated with better recognition of relevant visual information, and greater auditory distractor suppression was associated with a better ability to ignore auditory distraction. There were no age differences in these effects, suggesting that when relevant and irrelevant information are presented through different sensory modalities, selective attention remains intact in older age.


Perception ◽  
1997 ◽  
Vol 26 (1_suppl) ◽  
pp. 219-219
Author(s):  
T Kujala ◽  
K Alho

We investigated the functional role of human visual brain areas deprived of visual information. To this end, we recorded brain activity elicited by auditory and somatosensory stimuli in blind human subjects. Activity was recorded in the ‘Attend’ condition, in which subjects detected occasional deviant stimuli presented among repetitive standard stimuli and in the ‘Ignore’ condition, in which subjects did not attend to the stimuli. The results indicate that in the early-blinded subjects, event-related potential (ERP) topography elicited by deviant auditory and somatosensory target stimuli is posterior to that in the sighted (Kujala et al, 1995 Experimental Brain Research104 519 – 526). This suggests involvement of posterior brain areas in auditory and somatosensory processing in the blind humans. For the auditory modality, activated areas were located with magnetoencephalography (MEG), which indicates involvement of extrastriate occipital areas in detection of auditory targets (Kujala et al, 1995 Experimental Brain Research103 143 – 146). Visual-cortex plasticity was further studied in subjects who had lost their vision after childhood in order to clarify whether these cross-modal changes are specific to visual deprivation of early onset. In that study, auditory ERP topographies of late-blinded, early-blinded, and sighted subjects were compared. Comparison of posterior topography of ERPs elicited by deviant target stimuli in both early-blinded and late-blinded subjects with that in the sighted subjects suggests visual-cortex involvement in auditory processing even in late-onset blindness (Kujala et al, 1977 Psychophysiology34 213 – 216). Preliminary MEG recordings in one late-blinded subject provided further support for posterior generators (parietal-occipital) in auditory processing.


2019 ◽  
Author(s):  
Cecilie Møller ◽  
Andreas Højlund ◽  
Klaus B. Bærentsen ◽  
Niels Chr. Hansen ◽  
Joshua C. Skewes ◽  
...  

AbstractMultisensory processing facilitates perception of our everyday environment and becomes particularly important when sensory information is degraded or close to the discrimination threshold. Here, we used magnetoencephalography and an audiovisual oddball paradigm to assess the complementary role of visual information in subtle pitch discrimination at the neural level of participants with varying levels of pitch discrimination abilities, i.e., musicians and nonmusicians. The amplitude of the auditory mismatch negativity (MMNm) served as an index of sensitivity. The gain in amplitude resulting from compatible audiovisual information was larger in participants whose MMNm amplitude was smaller in the condition deviating only in the auditory dimension, in accordance with the multisensory principle of inverse effectiveness. These findings show that discrimination of even a sensory-specific feature as pitch is facilitated by multisensory information at a pre-attentive level, and they highlight the importance of considering inter-individual differences in uni-sensory abilities when assessing multisensory processing.


2014 ◽  
Vol 37 (2) ◽  
pp. 197-198
Author(s):  
Stephan de la Rosa ◽  
Heinrich H. Bülthoff

AbstractCook et al. suggest that motor-visual neurons originate from associative learning. This suggestion has interesting implications for the processing of socially relevant visual information in social interactions. Here, we discuss two aspects of the associative learning account that seem to have particular relevance for visual recognition of social information in social interactions – namely, context-specific and contingency based learning.


Languages ◽  
2020 ◽  
Vol 6 (1) ◽  
pp. 8
Author(s):  
Daniel Vergara ◽  
Gilda Socarrás

Processing research on Spanish gender agreement has focused on L2 learners’ and—to a lesser extent—heritage speakers’ sensitivity to gender agreement violations. This research has been mostly carried out in the written modality, which places heritage speakers at a disadvantage as they are more frequently exposed to Spanish auditorily. This study contributes to the understanding of the differences between heritage and L2 grammars by examining the processing of gender agreement in the auditory modality and its impact on comprehension. Twenty Spanish heritage speakers and 20 intermediate L2 learners listened to stimuli containing two nouns with gender mismatches in the main clause, and an adjective in the relative clause that only agreed in gender with one of the nouns. We measured noun-adjective agreement accuracy through participants’ responses to an auditory task. Our results show that heritage speakers are more accurate than L2 learners in the auditory processing of gender agreement information for comprehension. Additionally, heritage speakers’ accuracy is modulated by their Spanish language proficiency and age of onset. Participants also exhibit higher accuracies in cases in which the adjective agrees with the first noun. We argue that this is an ambiguity resolution strategy influenced by the experimental task.


2004 ◽  
Vol 25 (3) ◽  
pp. 284-301 ◽  
Author(s):  
Catharine M. Pettigrew ◽  
Bruce E. Murdoch ◽  
Curtis W. Ponton ◽  
Simon Finnigan ◽  
Paavo Alku ◽  
...  

2003 ◽  
Vol 15 (5) ◽  
pp. 747-758 ◽  
Author(s):  
Christophe Micheyl ◽  
Robert P. Carlyon ◽  
Yury Shtyrov ◽  
Olaf Hauk ◽  
Tara Dodson ◽  
...  

A sound turned off for a short moment can be perceived as continuous if the silent gap is filled with noise. The neural mechanisms underlying this “continuity illusion” were investigated using the mismatch negativity (MMN), an eventrelated potential reflecting the perception of a sudden change in an otherwise regular stimulus sequence. The MMN was recorded in four conditions using an oddball paradigm. The standards consisted of 500-Hz, 120-msec tone pips that were either physically continuous (Condition 1) or were interrupted by a 40-msec silent gap (Condition 2). The deviants consisted of the interrupted tone, but with the silent gap filled by a burst of bandpass-filtered noise. The noise either occupied the same frequency region as the tone and elicited the continuity illusion (Conditions 1a and 2a), or occupied a remote frequency region and did not elicit the illusion (Conditions 1b and 2b). We predicted that, if the continuity illusion is determined before MMN generation, then, other things being equal, the MMN should be larger in conditions where the deviants are perceived as continuous and the standards as interrupted or vice versa, than when both were perceived as continuous or both interrupted. Consistent with this prediction, we observed an interaction between standard type and noise frequency region, with the MMN being larger in Condition 1a than in Condition 1b, but smaller in Condition 2a than in Condition 2b. Because the subjects were instructed to ignore the tones and watch a silent movie during the recordings, the results indicate that the continuity illusion can occur outside the focus of attention. Furthermore, the latency of the MMN (less than approximately 200 msec postdeviance onset) places an upper limit on the stage of neural processing responsible for the illusion.


2018 ◽  
Vol 52 (03) ◽  
pp. 126-133 ◽  
Author(s):  
Patrik Roser ◽  
Eva-Maria Pichler ◽  
Benedikt Habermeyer ◽  
Wolfram Kawohl ◽  
Georg Juckel

Abstract Introduction Cannabis use disorders (CUD) are highly prevalent among patients with schizophrenia (SCZ). Deficient mismatch negativity (MMN) generation is a characteristic finding in SCZ patients and cannabis users. This study therefore examined the effects of CUD on MMN generation in SCZ patients. Methods Twenty SCZ − CUD patients, 21 SCZ+CUD patients, and 20 healthy controls (HC) were included in this study. MMN to frequency and duration deviants was elicited within an auditory oddball paradigm and recorded by 32 channel EEG. Results As expected, SCZ − CUD patients showed reduced frontocentral MMN amplitudes to duration deviants compared to HC. Interestingly, SCZ+CUD patients demonstrated greater MMN amplitudes to duration deviants compared to SCZ − CUD patients at central electrodes with no differences compared to HC. Discussion These results demonstrate that comorbid cannabis use in SCZ patients might be associated with superior cognitive functioning. It can be assumed that the association between cannabis use and better cognitive performance may be due to a subgroup of cognitively less impaired SCZ patients characterized by lower genetic vulnerability for psychosis.


2017 ◽  
Author(s):  
Nicolas Burra ◽  
Dirk Kerzel ◽  
David Munoz ◽  
Didier Grandjean ◽  
Leonardo Ceravolo

Salient vocalizations, especially aggressive voices, are believed to attract attention due to an automatic threat detection system. However, studies assessing the temporal dynamics of auditory spatial attention to aggressive voices are missing. Using event-related potential markers of auditory spatial attention (N2ac and LPCpc), we show that attentional processing of threatening vocal signals is enhanced at two different stages of auditory processing. As early as 200 ms post stimulus onset, attentional orienting/engagement is enhanced for threatening as compared to happy vocal signals. Subsequently, as early as 400 ms post stimulus onset, the reorienting of auditory attention to the center of the screen (or disengagement from the target) is enhanced. This latter effect is consistent with the need to optimize perception by balancing the intake of stimulation from left and right auditory space. Our results extend the scope of theories from the visual to the auditory modality by showing that threatening stimuli also bias early spatial attention in the auditory modality. Although not the focus of the present work, we observed that the attentional enhancement was more pronounced in female than male participants.


2018 ◽  
Vol 61 (5) ◽  
pp. 1322-1333
Author(s):  
Varghese Peter ◽  
Marina Kalashnikova ◽  
Denis Burnham

Purpose An important skill in the development of speech perception is to apply optimal weights to acoustic cues so that phonemic information is recovered from speech with minimum effort. Here, we investigated the development of acoustic cue weighting of amplitude rise time (ART) and formant rise time (FRT) cues in children as measured by mismatch negativity (MMN). Method Twelve adults and 36 children aged 6–12 years listened to a /ba/–/wa/ contrast in an oddball paradigm in which the standard stimulus had the ART and FRT cues of /ba/. In different blocks, the deviant stimulus had either the ART or FRT cues of /wa/. Results The results revealed that children younger than 10 years were sensitive to both ART and FRT cues whereas 10- to 12-year-old children and adults were sensitive only to FRT cues. Moreover, children younger than 10 years generated a positive mismatch response, whereas older children and adults generated MMN. Conclusion These results suggest that preattentive adultlike weighting of ART and FRT cues is attained only by 10 years of age and accompanies the change from mismatch response to the more mature MMN response. Supplemental Material https://doi.org/10.23641/asha.6207608


Sign in / Sign up

Export Citation Format

Share Document