A Review of Speech Perception of Mandarin-Speaking Children With Cochlear Implantation

Objective: This paper reviewed the literature on the development of and factors affecting speech perception of Mandarin-speaking children with cochlear implantation (CI). We also summarized speech outcome measures in standard Mandarin for evaluating auditory and speech perception of children with CI.Method: A comprehensive search of Google Scholar and PubMed was conducted from March to June 2021. Search terms used were speech perception/lexical tone recognition/auditory perception AND cochlear implant AND Mandarin/Chinese.Conclusion: Unilateral CI recipients demonstrated continuous improvements in auditory and speech perception for several years post-activation. Younger age at implantation and longer duration of CI use contribute to better speech perception. Having undergone a hearing aid trial before implantation and having caregivers whose educational level is higher may lead to better performance. While the findings that support the use of CI to improve speech perception continue to grow, much research is needed to validate the use of unilateral and bilateral implantation. Evidence to date, however, revealed bimodal benefits over CI-only conditions in lexical tone recognition and sentence perception in noise. Due to scarcity of research, conclusions on the benefits of bilateral CIs compared to unilateral CI or bimodal CI use cannot be drawn. Therefore, future research on bimodal and bilateral CIs is needed to guide evidence-based clinical practice.

Relative Weights of Temporal Envelope Cues in Different Frequency Regions for Mandarin Vowel, Consonant, and Lexical Tone Recognition

Objectives: Mandarin-speaking users of cochlear implants (CI) perform poorer than their English counterpart. This may be because present CI speech coding schemes are largely based on English. This study aims to evaluate the relative contributions of temporal envelope (E) cues to Mandarin phoneme (including vowel, and consonant) and lexical tone recognition to provide information for speech coding schemes specific to Mandarin.Design: Eleven normal hearing subjects were studied using acoustic temporal E cues that were extracted from 30 continuous frequency bands between 80 and 7,562 Hz using the Hilbert transform and divided into five frequency regions. Percent-correct recognition scores were obtained with acoustic E cues presented in three, four, and five frequency regions and their relative weights calculated using the least-square approach.Results: For stimuli with three, four, and five frequency regions, percent-correct scores for vowel recognition using E cues were 50.43–84.82%, 76.27–95.24%, and 96.58%, respectively; for consonant recognition 35.49–63.77%, 67.75–78.87%, and 87.87%; for lexical tone recognition 60.80–97.15%, 73.16–96.87%, and 96.73%. For frequency region 1 to frequency region 5, the mean weights in vowel recognition were 0.17, 0.31, 0.22, 0.18, and 0.12, respectively; in consonant recognition 0.10, 0.16, 0.18, 0.23, and 0.33; in lexical tone recognition 0.38, 0.18, 0.14, 0.16, and 0.14.Conclusion: Regions that contributed most for vowel recognition was Region 2 (502–1,022 Hz) that contains first formant (F1) information; Region 5 (3,856–7,562 Hz) contributed most to consonant recognition; Region 1 (80–502 Hz) that contains fundamental frequency (F0) information contributed most to lexical tone recognition.

DCT based feature extraction and support vector machine classification for musical instruments tone recognition

The conducted research proposes a feature extraction and classification combination method that is used in a tone recognition system for musical instruments. It is expected that by implementing this combination, the tone recognition system will require fewer feature extraction coefficients than those previously investigated. The proposed combination comprises of feature extraction using discrete cosine transform (DCT) and classification using support vector machine (SVM). Bellyra, clarinet, and pianica tones were used in the experiment, with each indicating a tone with one, several, or many major local peaks in the transform domain. Based on the results of the tests, the proposed combination is efficient enough to be used in a tone recognition system for musical instruments. This is indicated in recognizing a tone, it only needs at least eight feature extraction coefficients.

Dialect Effects on Mandarin Tone Perception Development

This study aimed to characterize factors that influence early dialect development in a language environment with multiple dialects. Children were evaluated for these dialect effects compared with normal hearing referenced measures of speech and language development that are commonly implemented in hearing-impaired children. Dialect exposure and use were assessed longitudinally in Chinese children (2–6 years old) that were raised in a community where Putonghua (PTH) and Sichuanhua (SCH) Mandarin dialects were used. Lexical tones in these dialects are different. A total of 20 boys and 20 girls (2 years old at the beginning of the study) that attended the same nursery school were included in this study. SCH was used by the majority of subjects <4 years old. The majority of subjects >4 years old used either dialect, with a few users of both dialects at this age. PTH tone perception did not differ significantly as a function of dialect use. Tone recognition and discrimination were >90% accurate by 6 years old, in contrast to previous results for children with minimal exposure and use of PTH. Children with approximately ⩾50% PTH exposure might be accurately assessed with norm-referenced speech materials spoken in PTH, regardless of their preferred dialect. However, the current norm-referenced assessments of children with minimal PTH exposure and nonusers of the dialect might be inaccurate.

Aging Effect on Mandarin Chinese Vowel and Tone Identification in Six-Talker Babble

Purpose The purpose of this study was to measure Mandarin Chinese vowel-plus-tone identification in quiet and noise for younger and older listeners. Method Two types of noise served as the masker, namely, six-talker babble and babble-modulated noise, at two signal-to-noise ratios (SNRs) of −4 and −8 dB. Fourteen listeners from both age groups were recruited, and three sets of data analyses were conducted: the identification of vowel plus tone, the identification of vowel, and the identification of tone. Results Younger listeners outperformed older listeners in all listening conditions, whereas the younger–older listener difference became greater in noise than in quiet, indicating a more detrimental effect of noise for older listeners than for younger listeners. In addition, vowel identification showed slightly better scores than tone identification in noise, suggesting that noise appeared to affect tone perception more negatively than vowel perception in Mandarin Chinese. At −4 dB SNR, there was a significantly greater amount of informational masking (IM) and a greater amount of energetic masking (EM) for older listeners than for younger listeners. At −8 dB SNR, there was a greater amount of EM for older listeners than for younger listeners but with no group difference in the amount of IM. Conclusion These results suggest that older listeners received a more negative impact of noise for Mandarin Chinese phonemic and tone recognition and had a larger amount of IM or EM from competing speech noise than younger listeners, depending on the SNR.

Aging Effects on Categorical Perception of Mandarin Lexical Tones in Noise

Purpose The purpose of this study was to examine the aging effects on the categorical perception (CP) of Mandarin lexical Tones 1–4 and Tones 1–2 in noise. It also investigated whether listeners' categorical tone perception in noise correlated with their general tone identification of 20 natural vowel-plus-tone signals in noise. Method Twelve younger and 12 older listeners with normal hearing were recruited in both tone identification and discrimination tasks in a CP paradigm where fundamental frequency contours of target stimuli varied systematically from the flat tone (Tone 1) to the rising/falling tones (Tones 2/4). Both tasks were conducted in quiet and noise with signal-to-noise ratios set at −5 and −10 dB, respectively, and general tone identification of natural speech signals was also tested in noise conditions. Results Compared with younger listeners, older listeners had shallower identification slopes and smaller discrimination peakedness in Tones 1–2/4 perception in all listening conditions, except for Tones 1–4 perception in quiet where no group differences were found. Meanwhile, noise affected Tones 1–2/4 perception: The signal-to-noise ratio condition at −10 dB brought shallower slope in Tones 1–2/4 identification and less peakedness in Tones 1–4 discrimination for both listener groups. Older listeners' CP in noise, the identification slopes in particular, positively correlated with their general tone identification in noise, but such correlations were partially missing for younger listeners. Conclusions Both aging and the presence of speech-shaped noise significantly reduced the CP of Mandarin Tones 1–2/4. Listeners' Mandarin tone recognition may be related to their CP of Mandarin tones.