Multisensory integration of musical emotion perception in singing

We investigated how visual and auditory information contributes to emotion communication during singing. Classically trained singers applied two different facial expressions (expressive/suppressed) to pieces from their song and opera repertoire. Recordings of the singers were evaluated by laypersons or experts, presented to them in three different modes: auditory, visual, and audio–visual. A manipulation check confirmed that the singers succeeded in manipulating the face while keeping the sound highly expressive. Analyses focused on whether the visual difference or the auditory concordance between the two versions determined perception of the audio–visual stimuli. When evaluating expressive intensity or emotional content a clear effect of visual dominance showed. Experts made more use of the visual cues than laypersons. Consistency measures between uni-modal and multimodal presentations did not explain the visual dominance. The evaluation of seriousness was applied as a control. The uni-modal stimuli were rated as expected, but multisensory evaluations converged without visual dominance. Our study demonstrates that long-term knowledge and task context affect multisensory integration. Even though singers’ orofacial movements are dominated by sound production, their facial expressions can communicate emotions composed into the music, and observes do not rely on audio information instead. Studies such as ours are important to understand multisensory integration in applied settings.

Effects of Teaching Presentation Methods and Visual and Auditory Working Memory Capacity on Young Children’s Learning Effectiveness

Objectives: This study investigates the effects of teaching material presentation methods and young children's visual and auditory working memory capacity on their learning effectiveness. It also suggests effective instructional design and teaching-learning methods suitable for children’s information processing characteristics.Methods: Participants included 86 five-year-old children enrolled in kindergartens in Seoul, Gyeonggi, Incheon, and Daejeon. Three categories of teaching materials with different presentation methods were created. Participants were randomly assigned to one of the category groups, and participated in learning activities. After the activities, learning effectiveness, working memory, and attention were measured. Data were analyzed using SPSS 20.0.Results: Results indicated that children’s learning effectiveness differed according to the teaching material presentation method. Higher learning effectiveness was observed when auditory and visual information was presented concurrently rather than sequentially, but learning was not affected by the sequential order. The groups with larger auditory working memory capacity and larger visual working memory capacity achieved higher learning effectiveness than did their respective counterparts. Additionally, learning effectiveness was greater for children with larger auditory working memory capacity when presented with auditory information before visual, and for those with larger visual working memory capacity when presented with visual information before auditory.Conclusion: The study results enhance foundational knowledge related to individual differences in young children's visual and auditory information processing abilities. Moreover, this study has practical implications for developing instructional materials and proposals suitable for young children’s individual information processing characteristics.

Vztah mezi presbyakuzí a poruchou kognitivních funkcí ve stáří PDF uzamčeno English info

Age-related hearing loss, presbycusis, is one of the most frequent sensory impairments in the ageing population. It is associated with pathologies of both inner ear and the central parts of the auditory system. Intact cognitive functions are necessary for the proper processing of complex auditory information. Since the beginning of the 80s, there is an increasing amount of evidence linking presbycusis to cognitive impairment and increased risk of dementia. The exact cause, which connects these two pathologies, is still unknown, although there are several hypotheses with various levels of evidence available. This review aims to describe the role of cognitive functions in the auditory processing, to summarize published evidence for a relationship between the hearing loss and cognitive impairment with a possible mechanism, which would explain this link. In addition, we discuss specific features of cognitive assessment in a person with hearing loss and describe the effect of hearing loss treatment, e. g. with hearing aids, cochlear implant and cognitive-hearing training on cognitive functions. Keywords: dementia – hearing loss – presbycusis – cognitive decline

Tracing Links Between Early Auditory Information Processing and Negative Symptoms in Schizophrenia: An ERP Study

Background: Negative symptoms represent a heterogeneous dimension with a strong impact on functioning of subjects with schizophrenia (SCZ). Five constructs are included in this dimension: anhedonia, asociality, avolition, blunted affect, and alogia. Factor analyses revealed that these symptoms cluster in two domains: experiential domain (avolition, asociality, and anhedonia) and the expressive deficit (alogia and blunted affect), that might be linked to different neurobiological alterations. Few studies investigated associations between N100, an electrophysiological index of early sensory processing, and negative symptoms, reporting controversial results. However, none of these studies investigated electrophysiological correlates of the two negative symptom domains.Objectives: The aim of our study was to evaluate, within the multicenter study of the Italian Network for Research on Psychoses, the relationships between N100 and negative symptom domains in SCZ.Methods: Auditory N100 was analyzed in 114 chronic stabilized SCZ and 63 healthy controls (HCs). Negative symptoms were assessed with the Brief Negative Symptom Scale (BNSS). Repeated measures ANOVA and correlation analyses were performed to evaluate differences between SCZ and HCs and association of N100 features with negative symptoms.Results: Our findings demonstrated a significant N100 amplitude reduction in SCZ compared with HCs. In SCZ, N100 amplitude for standard stimuli was associated with negative symptoms, in particular with the expressive deficit domain. Within the expressive deficit, blunted affect and alogia had the same pattern of correlation with N100.Conclusion: Our findings revealed an association between expressive deficit and N100, suggesting that these negative symptoms might be related to deficits in early auditory processing in SCZ.

Shared mechanisms of auditory and non-auditory vocal learning in the songbird brain

Songbirds and humans share the ability to adaptively modify their vocalizations based on sensory feedback. Prior studies have focused primarily on the role that auditory feedback plays in shaping vocal output throughout life. In contrast, it is unclear whether and how non-auditory information drives vocal plasticity. Here, we first used a reinforcement learning paradigm to establish that non-auditory feedback can drive vocal learning in adult songbirds. We then assessed the role of a songbird basal ganglia-thalamocortical pathway critical to auditory vocal learning in this novel form of vocal plasticity. We found that both this circuit and its dopaminergic inputs are necessary for non-auditory vocal learning, demonstrating that this pathway is not specialized exclusively for auditory-driven vocal learning. The ability of this circuit to use both auditory and non-auditory information to guide vocal learning may reflect a general principle for the neural systems that support vocal plasticity across species.

Traditional martial arts and shooting training have different effects on auditory fine structure processing ability---Evidence from behavioral tests and fMRI

Explore the influence of traditional martial arts and shooting training on the ability of auditory temporal fine structure (TFS) processing. Twenty-five college students participated in the experiment, including 8 traditional martial arts practitioners, 8 high-level shooting athletes, and 9 control groups without any regular exercise habits. The BIC (break in interaural correlation) delay threshold and TFS1 test were used to evaluate the temporary storage capacity and sensitivity of TFS, respectively, and a fMRI test was performed after the test. The results found that the traditional martial arts group had stronger TFS sensitivity, while the shooting group had stronger TFS retention ability, and the performance of the behavioral test of the shooting group is related to the fALFF value of the brain area of interest. Traditional martial arts and shooting training have improved the ability of auditory information processing from different angles, diversified exercise habits will lead to the development of diversity in brain structure and function.

Anti-inflammatory compounds improve spiral ganglion neuron survival after aminoglycoside-induced hair cell loss in rats

Spiral ganglion neurons (SGNs) relay auditory information from cochlear hair cells to the central nervous system. After hair cells are destroyed by aminoglycoside antibiotics, SGNs gradually die. However, the reasons for this cochlear neurodegeneration are unclear. We used microarray gene expression profiling to assess transcriptomic changes in the spiral ganglia of kanamycin-deafened and age-matched control rats and found that many of the genes upregulated after deafening are associated with immune/inflammatory responses. In support of this, we observed increased numbers of macrophages in the spiral ganglion of deafened rats. We also found, via CD68 immunoreactivity, an increase in activated macrophages after deafening. An increase in CD68-associated nuclei was observed by postnatal day 23, a time before significant SGN degeneration is observed. Finally, we show that the immunosuppressive drugs dexamethasone and ibuprofen, as well as the NAD salvage pathway activator P7C3, provide at least some neuroprotection post-deafening. Ibuprofen and dexamethasone also decreased the degree of macrophage activation. These results suggest that activated macrophages specifically, and perhaps a more general neuroinflammatory response, are actively contributing to SGN degeneration after hair cell loss.

The impact of audio on the reading of intralingual versus interlingual subtitles: Evidence from eye movements

This study investigated how semantically relevant auditory information might affect the reading of subtitles, and if such effects might be modulated by the concurrent video content. Thirty-four native Chinese speakers with English as their second language watched video with English subtitles in six conditions defined by manipulating the nature of the audio (Chinese/L1 audio vs. English/L2 audio vs. no audio) and the presence versus absence of video content. Global eye-movement analyses showed that participants tended to rely less on subtitles with Chinese or English audio than without audio, and the effects of audio were more pronounced in the presence of video presentation. Lexical processing of subtitles was not modulated by the audio. However, Chinese audio, which presumably obviated the need to read the subtitles, resulted in more superficial post-lexical processing of the subtitles relative to either the English or no audio. On the contrary, English audio accentuated post-lexical processing of the subtitles compared with Chinese audio or no audio, indicating that participants might use English audio to support subtitle reading (or vice versa) and thus engaged in deeper processing of the subtitles. These findings suggest that, in multimodal reading situations, eye movements are not only controlled by processing difficulties associated with properties of words (e.g., their frequency and length) but also guided by metacognitive strategies involved in monitoring comprehension and its online modulation by different information sources.