Binaural Speech Intelligibility Prediction in the Presence of Multiple Babble Interferers Based on Mutual Information

AbstractAging is associated with an exaggerated representation of the speech envelope in auditory cortex. The relationship between this age-related exaggerated response and a listener’s ability to understand speech in noise remains an open question. Here, information-theory-based analysis methods are applied to magnetoencephalography (MEG) recordings of human listeners, investigating their cortical responses to continuous speech, using the novel non-linear measure of phase-locked mutual information between the speech stimuli and cortical responses. The cortex of older listeners shows an exaggerated level of mutual information, compared to younger listeners, for both attended and unattended speakers. The mutual information peaks for several distinct latencies: early (∼50 ms), middle (∼100 ms) and late (∼200 ms). For the late component, the neural enhancement of attended over unattended speech is affected by stimulus SNR, but the direction of this dependency is reversed by aging. Critically, in older listeners and for the same late component, greater cortical exaggeration is correlated with decreased behavioral inhibitory control. This negative correlation also carries over to speech intelligibility in noise, where greater cortical exaggeration in older listeners is correlated with worse speech intelligibility scores. Finally, an age-related lateralization difference is also seen for the ∼100 ms latency peaks, where older listeners show a bilateral response compared to younger listeners’ right-lateralization. Thus, this information-theory-based analysis provides new, and less coarse-grained, results regarding age-related change in auditory cortical speech processing, and its correlation with cognitive measures, compared to related linear measures.New & NoteworthyCortical representations of natural speech are investigated using a novel non-linear approach based on mutual information. Cortical responses, phase-locked to the speech envelope, show an exaggerated level of mutual information associated with aging, appearing at several distinct latencies (∼50, ∼100 and ∼200 ms). Critically, for older listeners only, the ∼200 ms latency response components are correlated with specific behavioral measures, including behavioral inhibition and speech comprehension.

Download Full-text

Speech Intelligibility Prediction Based on Mutual Information

IEEE/ACM Transactions on Audio Speech and Language Processing ◽

10.1109/taslp.2013.2295914 ◽

2014 ◽

Vol 22 (2) ◽

pp. 430-440 ◽

Cited By ~ 23

Author(s):

Jesper Jensen ◽

Cees H. Taal

Keyword(s):

Mutual Information ◽

Speech Intelligibility

Download Full-text

Jointly optimal near-end and far-end multi-microphone speech intelligibility enhancement based on mutual information

2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) ◽

10.1109/icassp.2016.7471756 ◽

2016 ◽

Cited By ~ 4

Author(s):

Seyran Khademi ◽

Richard C. Hendriks ◽

W. Bastiaan Kleijn

Keyword(s):

Mutual Information ◽

Speech Intelligibility

Download Full-text

A Family With Autosomal-Dominant Progressive Sensorineural Hearing Loss

American Journal of Audiology ◽

10.1044/1059-0889.0501.23 ◽

1996 ◽

Vol 5 (1) ◽

pp. 23-32 ◽

Cited By ~ 3

Author(s):

Chris Halpin ◽

Barbara Herrmann ◽

Margaret Whearty

Keyword(s):

Speech Production ◽

Hearing Aids ◽

Role Models ◽

Speech Intelligibility ◽

Large Scale ◽

Speech Language Pathology ◽

The Family ◽

Patient Will ◽

Language Pathology

The family described in this article provides an unusual opportunity to relate findings from genetic, histological, electrophysiological, psychophysical, and rehabilitative investigation. Although the total number evaluated is large (49), the known, living affected population is smaller (14), and these are spread from age 20 to age 59. As a result, the findings described above are those of a large-scale case study. Clearly, more data will be available through longitudinal study of the individuals documented in the course of this investigation but, given the slow nature of the progression in this disease, such studies will be undertaken after an interval of several years. The general picture presented to the audiologist who must rehabilitate these cases is that of a progressive cochlear degeneration that affects only thresholds at first, and then rapidly diminishes speech intelligibility. The expected result is that, after normal language development, the patient may accept hearing aids well, encouraged by the support of the family. Performance and satisfaction with the hearing aids is good, until the onset of the speech intelligibility loss, at which time the patient will encounter serious difficulties and may reject hearing aids as unhelpful. As the histological and electrophysiological results indicate, however, the eighth nerve remains viable, especially in the younger affected members, and success with cochlear implantation may be expected. Audiologic counseling efforts are aided by the presence of role models and support from the other affected members of the family. Speech-language pathology services were not considered important by the members of this family since their speech production developed normally and has remained very good. Self-correction of speech was supported by hearing aids and cochlear implants (Case 5’s speech production was documented in Perkell, Lane, Svirsky, & Webster, 1992). These patients received genetic counseling and, due to the high penetrance of the disease, exhibited serious concerns regarding future generations and the hope of a cure.

Download Full-text

Comparison of In-the-Ear and Over-the-Ear Hearing Aid Fittings

Journal of Speech and Hearing Disorders ◽

10.1044/jshd.5104.362 ◽

1986 ◽

Vol 51 (4) ◽

pp. 362-369 ◽

Cited By ~ 4

Author(s):

Donna M. Risberg ◽

Robyn M. Cox

Keyword(s):

Hearing Aids ◽

High Frequency ◽

Comparative Evaluation ◽

Speech Intelligibility ◽

Hearing Aid ◽

Hearing Aid Fitting ◽

The Difference ◽

Functional Gain ◽

The Relationship

A custom in-the-ear (ITE) hearing aid fitting was compared to two over-the-ear (OTE) hearing aid fittings for each of 9 subjects with mild to moderately severe hearing losses. Speech intelligibility via the three instruments was compared using the Speech Intelligibility Rating (SIR) test. The relationship between functional gain and coupler gain was compared for the ITE and the higher rated OTE instruments. The difference in input received at the microphone locations of the two types of hearing aids was measured for 10 different subjects and compared to the functional gain data. It was concluded that (a) for persons with mild to moderately severe hearing losses, appropriately adjusted custom ITE fittings typically yield speech intelligibility that is equal to the better OTE fitting identified in a comparative evaluation; and (b) gain prescriptions for ITE hearing aids should be adjusted to account for the high-frequency emphasis associated with in-the-concha microphone placement.

Download Full-text

Dysarthric Sentence Intelligibility

Journal of Speech Language and Hearing Research ◽

10.1044/jslhr.4106.1282 ◽

1998 ◽

Vol 41 (6) ◽

pp. 1282-1293 ◽

Cited By ~ 32

Author(s):

Jane Mertz Garcia ◽

Paul A. Dagenais

Keyword(s):

Speech Intelligibility ◽

Presentation Mode ◽

Contextual Influences ◽

Motor Functioning ◽

Video Presentation ◽

Independent Information ◽

Communicative Process ◽

Presentation Formats ◽

Sentence Intelligibility ◽

Audio Video

This study examined changes in the sentence intelligibility scores of speakers with dysarthria in association with different signal-independent factors (contextual influences). This investigation focused on the presence or absence of iconic gestures while speaking sentences with low or high semantic predictiveness. The speakers were 4 individuals with dysarthria, who varied from one another in terms of their level of speech intelligibility impairment, gestural abilities, and overall level of motor functioning. Ninety-six inexperienced listeners (24 assigned to each speaker) orthographically transcribed 16 test sentences presented in an audio + video or audio-only format. The sentences had either low or high semantic predictiveness and were spoken by each speaker with and without the corresponding gestures. The effects of signal-independent factors (presence or absence of iconic gestures, low or high semantic predictiveness, and audio + video or audio-only presentation formats) were analyzed for individual speakers. Not all signal-independent information benefited speakers similarly. Results indicated that use of gestures and high semantic predictiveness improved sentence intelligibility for 2 speakers. The other 2 speakers benefited from high predictive messages. The audio + video presentation mode enhanced listener understanding for all speakers, although there were interactions related to specific speaking situations. Overall, the contributions of relevant signal-independent information were greater for the speakers with more severely impaired intelligibility. The results are discussed in terms of understanding the contribution of signal-independent factors to the communicative process.

Download Full-text

Translating Principles of Speech Science to Clinical Practice: Current and Future Trends in Craniofacial Disorders

Perspectives on Speech Science and Orofacial Disorders ◽

10.1044/ssod18.1.31 ◽

2008 ◽

Vol 18 (1) ◽

pp. 31-40 ◽

Cited By ~ 2

Author(s):

David J. Zajac

Keyword(s):

Clinical Practice ◽

Speech Intelligibility ◽

Current Practice ◽

Computer Assisted ◽

Behavioral Management ◽

Single Word ◽

Future Directions ◽

Speech Science ◽

The Impact ◽

Opinion Article

Abstract The purpose of this opinion article is to review the impact of the principles and technology of speech science on clinical practice in the area of craniofacial disorders. Current practice relative to (a) speech aerodynamic assessment, (b) computer-assisted single-word speech intelligibility testing, and (c) behavioral management of hypernasal resonance are reviewed. Future directions and/or refinement of each area are also identified. It is suggested that both challenging and rewarding times are in store for clinical researchers in craniofacial disorders.

Download Full-text