Categorical Perception of Mandarin Pitch Directions by Cantonese-Speaking Musicians and Non-musicians

Purpose: This study is to investigate whether Cantonese-speaking musicians may show stronger CP than Cantonese-speaking non-musicians in perceiving pitch directions generated based on Mandarin tones. It also aims to examine whether musicians may be more effective in processing stimuli and more sensitive to subtle differences caused by vowel quality.Methods: Cantonese-speaking musicians and non-musicians performed a categorical identification and a discrimination task on rising and falling continua of fundamental frequency generated based on Mandarin level, rising and falling tones on two vowels with nine duration values.Results: Cantonese-speaking musicians exhibited a stronger categorical perception (CP) of pitch contours than non-musicians based on the identification and discrimination tasks. Compared to non-musicians, musicians were also more sensitive to the change of stimulus duration and to the intrinsic F0 in pitch perception in pitch processing.Conclusion: The CP was strengthened due to musical experience and musicians benefited more from increased stimulus duration and were more efficient in pitch processing. Musicians might be able to better use the extra time to form an auditory representation with more acoustic details. Even with more efficiency in pitch processing, musicians' ability to detect subtle pitch changes caused by intrinsic F0 was not undermined, which is likely due to their superior ability to process temporal information. These results thus suggest musicians may have a great advantage in learning tones of a second language.

Perception and Production of Statement-Question Intonation in Autism Spectrum Disorder: A Developmental Investigation

Prosody or “melody in speech” in autism spectrum disorder (ASD) is often perceived as atypical. This study examined perception and production of statements and questions in 84 children, adolescents and adults with and without ASD, as well as participants’ pitch direction discrimination thresholds. The results suggested that the abilities to discriminate (in both speech and music conditions), identify, and imitate statement-question intonation were intact in individuals with ASD across age cohorts. Sensitivity to pitch direction predicted performance on intonation processing in both groups, who also exhibited similar developmental changes. These findings provide evidence for shared mechanisms in pitch processing between speech and music, as well as associations between low- and high-level pitch processing and between perception and production of pitch.

Prominence and Expectation in Speech and Music Through the Lens of Pitch Processing

Speech and music reflect extraordinary aspects of human cognitive abilities. Pitch, as an important parameter in the auditory domain, has been the focus of previous research on the relations between speech and music. The present study continues this line of research by focusing on two aspects of pitch processing: pitch prominence and melodic expectation. Specifically, we examined the perceived boundary of prominence for focus/accent in speech and music, plus the comparison between the pitch expectation patterns of music and speech. Speech (Mandarin Chinese) and music stimuli were created with different interval steps that increased from 1 semitone to 12 semitones from the third to the fourth word/note of a sentence/melody. The results showed that ratings of both accent/focus and expectation/surprise increased with increasing semitone distance from the baseline (though this pattern was mixed with tonal stability profiles for the melodies). Nevertheless, the perceived boundary of prominence was different for music and speech, with the boundary for detecting prominence in speech higher than that in music. Expectation also showed different patterns for speech and music. The results thus favor the suggestion that speech prosody and music melody tend to require specialized pitch patterns unique to their own respective communication purposes.

Influence of Background Musical Emotions on Attention in Congenital Amusia

Congenital amusia in its most common form is a disorder characterized by a musical pitch processing deficit. Although pitch is involved in conveying emotion in music, the implications for pitch deficits on musical emotion judgements is still under debate. Relatedly, both limited and spared musical emotion recognition was reported in amusia in conditions where emotion cues were not determined by musical mode or dissonance. Additionally, assumed links between musical abilities and visuo-spatial attention processes need further investigation in congenital amusics. Hence, we here test to what extent musical emotions can influence attentional performance. Fifteen congenital amusic adults and fifteen healthy controls matched for age and education were assessed in three attentional conditions: executive control (distractor inhibition), alerting, and orienting (spatial shift) while music expressing either joy, tenderness, sadness, or tension was presented. Visual target detection was in the normal range for both accuracy and response times in the amusic relative to the control participants. Moreover, in both groups, music exposure produced facilitating effects on selective attention that appeared to be driven by the arousal dimension of musical emotional content, with faster correct target detection during joyful compared to sad music. These findings corroborate the idea that pitch processing deficits related to congenital amusia do not impede other cognitive domains, particularly visual attention. Furthermore, our study uncovers an intact influence of music and its emotional content on the attentional abilities of amusic individuals. The results highlight the domain-selectivity of the pitch disorder in congenital amusia, which largely spares the development of visual attention and affective systems.

Adopting StudyIntonation CAPT Tools to Tonal Languages Through the Example of Vietnamese

In tonal languages, tones are associated with both and phonological and lexical domains. Accurate tone articulation is required in order to convey the correct meaning. Learning tones at both word and phrase levels is often challenging for L2 learners with non-tonal language background, because of possible subtle difference between the close tones. In this paper, we discuss an adoption of StudyIntonation CAPT tools to the case of Vietnamese language being a good example of register tonal language with a complex system of tones comprising such features as tone pitch, its length, contour melody, intensity and phonation. The particular focus of this contribution is to assess the adoption of StudyIntonation course toolkit and its pitch processing and visualization algorithms in order to evaluate how the combined use of audio and visual perception mechanisms supported by StudyIntonation may help learners to improve the accuracy of their pronunciation and intonation with respect to tonal languages.

Cortical and Subcortical Processing of Linguistic Pitch Patterns

Pitch is one of the major prosodic cues in speech. A central research question is the way the brain derives the percept of pitch from incoming acoustic information. After introducing the functional architecture of the human auditory system, this chapter reviews lesion and neuroimaging studies and human electrophysiological studies of the processing of linguistically relevant pitch patterns at the cortical and subcortical levels, respectively. Recent evidence demonstrates the malleability of pitch processing in response to long-term and short-term auditory experiences as well as to the immediate history of the sensory inputs. In addition, the role of pitch in syntax-level processing will be evaluated. The chapter concludes with a discussion of how these findings, along with recent technical advances, will allow future studies to explore the neurocognitive bases of phonological theories of pitch representation and, conversely, of how prosodic theories may inform the intricate nature of neural pitch processing.

Pathological Prosody

Prosody in speech arises from fundamental frequency (f0), temporal measures, amplitude, and voice quality. These parameters in various combinations signal linguistic, emotional-attitudinal, and personal identity information. Prosodic processing engages cortical, subcortical, cerebellar, and brainstem systems, and damage to any of these can result in dysprosody. Despite the crucial role played by prosody in communication, little attention has been paid to clinical evaluation and even less to treatment. Numerous research studies of deficient emotional prosodic production and recognition reveal temporal deficits in association with left hemisphere damage and pitch processing failure in right hemisphere damage. Limited attempts at linguistic-prosodic testing suggest that damage to either cerebral hemisphere or to subcortical systems can affect production as well as comprehension. Treatment of linguistic dysprosody has revealed challenges in protocol design and performance evaluation. Prosodic insufficiency, present in cortical, subcortical, and cerebellar disease, has substantial implications for communicative function and deserves to be a strong focus of future research.

Left hemispheric deficit in the sustained neuromagnetic response to periodic click trains in children with ASD.

Background: Deficits in perception and production of vocal pitch are often observed in people with autism spectrum disorder (ASD), but the neural basis of these abnormalities is unknown. In magnetoencephalogram (MEG), spectrally complex periodic sounds trigger two continuous neural responses – the auditory steady state response (ASSR) and the sustained field (SF). It has been shown that the SF in neurotypical individuals is associated with low-level analysis of pitch in the ‘pitch processing center’ of the Heschl’s gyrus. Therefore, this auditory response may reflect vocal pitch processing abnormalities in ASD. The SF, however, has never been studied in people with this disorder. Methods: We used MEG and individual brain models to investigate the ASSR and SF evoked by monaural 40 Hz click trains in boys with ASD (N=35) and neurotypical (NT) boys (N=35) aged 7-12-years.Results: In agreement with the previous research in adults, the cortical sources of the SF in children were located in the left and right Heschl’s gyri, anterolateral to those of the ASSR. In both groups, the SF and ASSR dominated in the right hemisphere and were higher in the hemisphere contralateral to the stimulated ear. The ASSR increased with age in both NT and ASD children and did not differ between the groups. The SF amplitude did not significantly change between the ages of 7 and 12 years. It was moderately attenuated in both hemispheres and was markedly delayed and displaced in the left hemisphere in boys with ASD. The SF delay in participants with ASD was present irrespective of their intelligence level and severity of autism symptoms.Limitations: We did not test the language abilities of our participants. Therefore, the link between SF and processing of vocal pitch in children with ASD remains speculative.Conclusion: Children with ASD demonstrate selective left-hemispheric abnormalities at the level of the core auditory cortex when processing spectrally complex periodic sound. The observed neural deficit may contribute to speech perception difficulties experienced by children with ASD, including their poor perception and production of linguistic prosody.

Cross-domain effect of pitch processing in lexical and melodic contexts reflected by non-musicians: An MEG study

The pitch processing of language and music is generally considered engaging overlapped neural correlates. Previous studies on musicians showed that the ability of pitch processing in music could be transferred to language. It is known that music training can facilitate neural processing of speech, however, the underlying neural mechanisms of pitch processing of language and music are not fully understood, especially in non-musicians. Using magnetoencephalography, we presented a pitch anomaly paradigm which consists of language/music phrases ending in either congruous or incongruous tones/pitches to non-musicians. We found the distinctive brain activity patterns in two groups with high and low musical pitch perceptual abilities. The brain-behavior results showed a positive correlation between the performance of musical pitch tasks and the activation of the left frontotemporal cortical regions elicited by lexical tones. Our results suggested that the cross-domain effect of language and music could be generalized to people without formal music training.

Left hemispheric deficit in the sustained neuromagnetic response to periodic click trains in children with ASD.

Background: Deficits in perception and production of vocal pitch are often observed in people with autism spectrum disorder (ASD), but the neural basis of these abnormalities is unknown. In magnetoencephalogram (MEG), spectrally complex periodic sounds trigger two continuous neural responses – the auditory steady state response (ASSR) and the sustained field (SF). It has been shown that the SF in neurotypical individuals is associated with low-level analysis of pitch in the ‘pitch processing center’ of the Heschl’s gyrus. Therefore, this auditory response may reflect vocal pitch processing abnormalities in ASD. The SF, however, has never been studied in people with this disorder. Methods: We used MEG and individual brain models to investigate the ASSR and SF evoked by monaural 40 Hz click trains in boys with ASD (N=35) and neurotypical (NT) boys (N=35) aged 7-12-years.Results: In agreement with the previous research in adults, the cortical sources of the SF in children were located in the left and right Heschl’s gyri, anterolateral to those of the ASSR. In both groups, the SF and ASSR dominated in the right hemisphere and were higher in the hemisphere contralateral to the stimulated ear. The ASSR increased with age in both NT and ASD children and did not differ between the groups. The SF amplitude did not significantly change between the ages of 7 and 12 years. It was moderately attenuated in both hemispheres and was markedly delayed and displaced in the left hemisphere in boys with ASD. The SF delay in participants with ASD was present irrespective of their intelligence level and severity of autism symptoms.Limitations: We did not test the language abilities of our participants. Therefore, the link between SF and processing of vocal pitch in children with ASD remains speculative.Conclusion: Children with ASD demonstrate selective left-hemispheric abnormalities at the level of the core auditory cortex when processing spectrally complex periodic sound. The observed neural deficit may contribute to speech perception difficulties experienced by children with ASD, including their poor perception and production of linguistic prosody.