scholarly journals The Effect of Stimulus Choice on an EEG-Based Objective Measure of Speech Intelligibility

Ear & Hearing ◽  
2020 ◽  
Vol 41 (6) ◽  
pp. 1586-1597 ◽  
Author(s):  
Eline Verschueren ◽  
Jonas Vanthornhout ◽  
Tom Francart
Keyword(s):  
Speech Intelligibility ◽  
Objective Measure ◽  
Stimulus Choice

scholarly journals The effect of stimulus choice on an EEG-based objective measure of speech intelligibility

2018 ◽  
Author(s):  
Eline Verschueren ◽  
Jonas Vanthornhout ◽  
Tom Francart
Keyword(s):  
Speech Processing ◽  
Speech Intelligibility ◽  
Objective Measure ◽  
Natural Speech ◽  
Temporal Characteristics ◽  
Brain Responses ◽  
Stimulus Choice ◽  
The Matrix ◽  
Speech Envelope ◽  
The Brain

ABSTRACTObjectivesRecently an objective measure of speech intelligibility, based on brain responses derived from the electroencephalogram (EEG), has been developed using isolated Matrix sentences as a stimulus. We investigated whether this objective measure of speech intelligibility can also be used with natural speech as a stimulus, as this would be beneficial for clinical applications.DesignWe recorded the EEG in 19 normal-hearing participants while they listened to two types of stimuli: Matrix sentences and a natural story. Each stimulus was presented at different levels of speech intelligibility by adding speech weighted noise. Speech intelligibility was assessed in two ways for both stimuli: (1) behaviorally and (2) objectively by reconstructing the speech envelope from the EEG using a linear decoder and correlating it with the acoustic envelope. We also calculated temporal response functions (TRFs) to investigate the temporal characteristics of the brain responses in the EEG channels covering different brain areas.ResultsFor both stimulus types the correlation between the speech envelope and the reconstructed envelope increased with increasing speech intelligibility. In addition, correlations were higher for the natural story than for the Matrix sentences. Similar to the linear decoder analysis, TRF amplitudes increased with increasing speech intelligibility for both stimuli. Remarkable is that although speech intelligibility remained unchanged in the no noise and +2.5 dB SNR condition, neural speech processing was affected by the addition of this small amount of noise: TRF amplitudes across the entire scalp decreased between 0 to 150 ms, while amplitudes between 150 to 200 ms increased in the presence of noise. TRF latency changes in function of speech intelligibility appeared to be stimulus specific: The latency of the prominent negative peak in the early responses (50-300 ms) increased with increasing speech intelligibility for the Matrix sentences, but remained unchanged for the natural story.ConclusionsThese results show (1) the feasibility of natural speech as a stimulus for the objective measure of speech intelligibility, (2) that neural tracking of speech is enhanced using a natural story compared to Matrix sentences and (3) that noise and the stimulus type can change the temporal characteristics of the brain responses. These results might reflect the integration of incoming acoustic features and top-down information, suggesting that the choice of the stimulus has to be considered based on the intended purpose of the measurement.

scholarly journals Predicting individual speech intelligibility from the cortical tracking of acoustic- and phonetic-level speech representations

2018 ◽  
Author(s):  
D Lesenfants ◽  
J Vanthornhout ◽  
E Verschueren ◽  
L Decruy ◽  
T Francart
Keyword(s):  
Auditory Processing ◽  
Speech Intelligibility ◽  
Objective Measure ◽  
List Type ◽  
Search Terms ◽  
Speech Reception ◽  
Cortical Responses ◽  
Potential Applications ◽  
Speech Features ◽  
Phonetic Features

ABSTRACTObjectiveTo objectively measure speech intelligibility of individual subjects from the EEG, based on cortical tracking of different representations of speech: low-level acoustical, higher-level discrete, or a combination. To compare each model’s prediction of the speech reception threshold (SRT) for each individual with the behaviorally measured SRT.MethodsNineteen participants listened to Flemish Matrix sentences presented at different signal-to-noise ratios (SNRs), corresponding to different levels of speech understanding. For different EEG frequency bands (delta, theta, alpha, beta or low-gamma), a model was built to predict the EEG signal from various speech representations: envelope, spectrogram, phonemes, phonetic features or a combination of phonetic Features and Spectrogram (FS). The same model was used for all subjects. The model predictions were then compared to the actual EEG of each subject for the different SNRs, and the prediction accuracy in function of SNR was used to predict the SRT.ResultsThe model based on the FS speech representation and the theta EEG band yielded the best SRT predictions, with a difference between the behavioral and objective SRT below 1 decibel for 53% and below 2 decibels for 89% of the subjects.ConclusionA model including low- and higher-level speech features allows to predict the speech reception threshold from the EEG of people listening to natural speech. It has potential applications in diagnostics of the auditory system.Search Termscortical speech tracking, objective measure, speech intelligibility, auditory processing, speech representations.HighlightsObjective EEG-based measure of speech intelligibilityImproved prediction of speech intelligibility by combining speech representationsCortical tracking of speech in the delta EEG band monotonically increased with SNRsCortical responses in the theta EEG band best predicted the speech reception thresholdDisclosureThe authors report no disclosures relevant to the manuscript.

scholarly journals Neural tracking as an objective measure of auditory perception and speech intelligibility

2021 ◽  
Author(s):  
Jana Van Canneyt ◽  
Marlies Gillis ◽  
Jonas Vanthornhout ◽  
Tom Francart
Keyword(s):  
Speech Perception ◽  
Auditory Cortex ◽  
Speech Intelligibility ◽  
Objective Assessment ◽  
Objective Measure ◽  
Primary Auditory Cortex ◽  
Auditory Pathway ◽  
Natural Speech ◽  
Linguistic Features ◽  
The Brain

The neural tracking framework enables the analysis of neural responses (EEG) to continuous natural speech, e.g., a story or a podcast. This allows for objective investigation of a range of auditory and linguistic processes in the brain during natural speech perception. This approach is more ecologically valid than traditional auditory evoked responses and has great potential for both research and clinical applications. In this article, we review the neural tracking framework and highlight three prominent examples of neural tracking analyses. This includes the neural tracking of the fundamental frequency of the voice (f0), the speech envelope and linguistic features. Each of these analyses provides a unique point of view into the hierarchical stages of speech processing in the human brain. f0-tracking assesses the encoding of fine temporal information in the early stages of the auditory pathway, i.e. from the auditory periphery up to early processing in the primary auditory cortex. This fundamental processing in (mostly) subcortical stages forms the foundation of speech perception in the cortex. Envelope tracking reflects bottom-up and top-down speech-related processes in the auditory cortex, and is likely necessary but not sufficient for speech intelligibility. To study neural processes more directly related to speech intelligibility, neural tracking of linguistic features can be used. This analysis focuses on the encoding of linguistic features (e.g. word or phoneme surprisal) in the brain. Together these analyses form a multi-faceted and time-effective objective assessment of the auditory and linguistic processing of an individual.

scholarly journals Assessment of speech intelligibility in university lecture rooms of different sizes using objective and subjective methods

2021 ◽  
Vol 3 (5 (111)) ◽  
pp. 47-56
Author(s):  
Arkadiy Prodeus ◽  
Maryna Didkovska
Keyword(s):  
Speech Intelligibility ◽  
Subjective Evaluation ◽  
Objective Measure ◽  
Impulse Responses ◽  
Professional Quality ◽  
Lecture Room ◽  
Transmission Index ◽  
Speech Transmission ◽  
Quantitative Characteristics ◽  
Side Walls

The scores of speech intelligibility, obtained using objective and subjective methods for three university lecture rooms of the small, medium, and large sizes with different degrees of filling, were presented. The problem of achieving high speech intelligibility is relevant for both students and university administration, and for architects designing or reconstructing lecture rooms. Speech intelligibility was assessed using binaural room impulse responses which applied an artificial head and non-professional quality audio equipment for measuring. The Speech Transmission Index was an objective measure of speech intelligibility, while the subjective evaluation of speech intelligibility was carried out using the articulation method. Comparative analysis of the effectiveness of parameters of impulse response as a measure of speech intelligibility showed that Early Decay Time exceeded the score of the T30 reverberation time but was ineffective in a small lecture room. The C50 clarity index for all the considered lecture rooms was the most informative. Several patterns determined by the influence of early sound reflections on speech intelligibility were detected. Specifically, it was shown that an increase in the ratio of the energy of early reflections to the energy of direct sound leads to a decrease in speech intelligibility. The exceptions are small, up to 30‒40 cm, distances from the back wall of the room, where speech intelligibility is usually slightly higher than in the middle of the room. At a distance of 0.7–1.7 m from the side walls of the room, speech intelligibility is usually worse for the ear, which is closer to the wall. The usefulness of the obtained results lies in refining the quantitative characteristics of the influence of early reflections of sound on speech intelligibility at different points of lecture rooms.

Automating an objective measure of pediatric speech intelligibility

2014 ◽  
Author(s):  
Jason Lilley ◽  
Susan Nittrouer ◽  
H. Timothy Bunnell
Keyword(s):  
Speech Intelligibility ◽  
Objective Measure

A Family With Autosomal-Dominant Progressive Sensorineural Hearing Loss

1996 ◽  
Vol 5 (1) ◽  
pp. 23-32 ◽  
Author(s):  
Chris Halpin ◽  
Barbara Herrmann ◽  
Margaret Whearty
Keyword(s):  
Speech Production ◽  
Hearing Aids ◽  
Role Models ◽  
Speech Intelligibility ◽  
Large Scale ◽  
Speech Language Pathology ◽  
The Family ◽  
Patient Will ◽  
Language Pathology

The family described in this article provides an unusual opportunity to relate findings from genetic, histological, electrophysiological, psychophysical, and rehabilitative investigation. Although the total number evaluated is large (49), the known, living affected population is smaller (14), and these are spread from age 20 to age 59. As a result, the findings described above are those of a large-scale case study. Clearly, more data will be available through longitudinal study of the individuals documented in the course of this investigation but, given the slow nature of the progression in this disease, such studies will be undertaken after an interval of several years. The general picture presented to the audiologist who must rehabilitate these cases is that of a progressive cochlear degeneration that affects only thresholds at first, and then rapidly diminishes speech intelligibility. The expected result is that, after normal language development, the patient may accept hearing aids well, encouraged by the support of the family. Performance and satisfaction with the hearing aids is good, until the onset of the speech intelligibility loss, at which time the patient will encounter serious difficulties and may reject hearing aids as unhelpful. As the histological and electrophysiological results indicate, however, the eighth nerve remains viable, especially in the younger affected members, and success with cochlear implantation may be expected. Audiologic counseling efforts are aided by the presence of role models and support from the other affected members of the family. Speech-language pathology services were not considered important by the members of this family since their speech production developed normally and has remained very good. Self-correction of speech was supported by hearing aids and cochlear implants (Case 5’s speech production was documented in Perkell, Lane, Svirsky, & Webster, 1992). These patients received genetic counseling and, due to the high penetrance of the disease, exhibited serious concerns regarding future generations and the hope of a cure.

Comparison of In-the-Ear and Over-the-Ear Hearing Aid Fittings

1986 ◽  
Vol 51 (4) ◽  
pp. 362-369 ◽  
Author(s):  
Donna M. Risberg ◽  
Robyn M. Cox
Keyword(s):  
Hearing Aids ◽  
High Frequency ◽  
Comparative Evaluation ◽  
Speech Intelligibility ◽  
Hearing Aid ◽  
Hearing Aid Fitting ◽  
The Difference ◽  
Functional Gain ◽  
The Relationship

A custom in-the-ear (ITE) hearing aid fitting was compared to two over-the-ear (OTE) hearing aid fittings for each of 9 subjects with mild to moderately severe hearing losses. Speech intelligibility via the three instruments was compared using the Speech Intelligibility Rating (SIR) test. The relationship between functional gain and coupler gain was compared for the ITE and the higher rated OTE instruments. The difference in input received at the microphone locations of the two types of hearing aids was measured for 10 different subjects and compared to the functional gain data. It was concluded that (a) for persons with mild to moderately severe hearing losses, appropriately adjusted custom ITE fittings typically yield speech intelligibility that is equal to the better OTE fitting identified in a comparative evaluation; and (b) gain prescriptions for ITE hearing aids should be adjusted to account for the high-frequency emphasis associated with in-the-concha microphone placement.

Dysarthric Sentence Intelligibility

1998 ◽  
Vol 41 (6) ◽  
pp. 1282-1293 ◽  
Author(s):  
Jane Mertz Garcia ◽  
Paul A. Dagenais
Keyword(s):  
Speech Intelligibility ◽  
Presentation Mode ◽  
Contextual Influences ◽  
Motor Functioning ◽  
Video Presentation ◽  
Independent Information ◽  
Communicative Process ◽  
Presentation Formats ◽  
Sentence Intelligibility ◽  
Audio Video

This study examined changes in the sentence intelligibility scores of speakers with dysarthria in association with different signal-independent factors (contextual influences). This investigation focused on the presence or absence of iconic gestures while speaking sentences with low or high semantic predictiveness. The speakers were 4 individuals with dysarthria, who varied from one another in terms of their level of speech intelligibility impairment, gestural abilities, and overall level of motor functioning. Ninety-six inexperienced listeners (24 assigned to each speaker) orthographically transcribed 16 test sentences presented in an audio + video or audio-only format. The sentences had either low or high semantic predictiveness and were spoken by each speaker with and without the corresponding gestures. The effects of signal-independent factors (presence or absence of iconic gestures, low or high semantic predictiveness, and audio + video or audio-only presentation formats) were analyzed for individual speakers. Not all signal-independent information benefited speakers similarly. Results indicated that use of gestures and high semantic predictiveness improved sentence intelligibility for 2 speakers. The other 2 speakers benefited from high predictive messages. The audio + video presentation mode enhanced listener understanding for all speakers, although there were interactions related to specific speaking situations. Overall, the contributions of relevant signal-independent information were greater for the speakers with more severely impaired intelligibility. The results are discussed in terms of understanding the contribution of signal-independent factors to the communicative process.

Translating Principles of Speech Science to Clinical Practice: Current and Future Trends in Craniofacial Disorders

2008 ◽  
Vol 18 (1) ◽  
pp. 31-40 ◽  
Author(s):  
David J. Zajac
Keyword(s):  
Clinical Practice ◽  
Speech Intelligibility ◽  
Current Practice ◽  
Computer Assisted ◽  
Behavioral Management ◽  
Single Word ◽  
Future Directions ◽  
Speech Science ◽  
The Impact ◽  
Opinion Article

Abstract The purpose of this opinion article is to review the impact of the principles and technology of speech science on clinical practice in the area of craniofacial disorders. Current practice relative to (a) speech aerodynamic assessment, (b) computer-assisted single-word speech intelligibility testing, and (c) behavioral management of hypernasal resonance are reviewed. Future directions and/or refinement of each area are also identified. It is suggested that both challenging and rewarding times are in store for clinical researchers in craniofacial disorders.

Sign in / Sign up

Export Citation Format

Share Document