Speechreading supplemented with frequency‐selective sound‐pressure information and formant‐frequency information

AbstractSensory information is represented and elaborated in hierarchical cortical systems that are thought to be dedicated to individual sensory modalities. This traditional view of sensory cortex organization has been challenged by recent evidence of multimodal responses in primary and association sensory areas. Although it is indisputable that sensory areas respond to multiple modalities, it remains unclear whether these multimodal responses reflect selective information processing for particular stimulus features. Here, we used fMRI adaptation to identify brain regions that are sensitive to the temporal frequency information contained in auditory, tactile, and audiotactile stimulus sequences. A number of brain regions distributed over the parietal and temporal lobes exhibited frequency-selective temporal response modulation for both auditory and tactile stimulus events, as indexed by repetition suppression effects. A smaller set of regions responded to crossmodal adaptation sequences in a frequency-dependent manner. Despite an extensive overlap of multimodal frequency-selective responses across the parietal and temporal lobes, representational similarity analysis revealed a cortical “regional landscape” that clearly reflected distinct somatosensory and auditory processing systems that converged on modality-invariant areas. These structured relationships between brain regions were also evident in spontaneous signal fluctuation patterns measured at rest. Our results reveal that multimodal processing in human cortex can be feature-specific and that multimodal frequency representations are embedded in the intrinsically hierarchical organization of cortical sensory systems.Significance StatementA hallmark of traditional brain organization models is the segregation of signals from the different senses in modality-dedicated brain regions. Recent evidence showing multimodal activity in brain regions thought to be dedicated to a single modality have challenged the traditional sensory cortex model. Notably, few studies have explored the feature-specificity of multimodal responses found in sensory cortex. Here, we used fMRI adaptation to identify parietal and temporal cortex regions which exhibited sensitivity to both tactile and auditory frequency information. These univariate results demonstrate that multimodal processing in sensory cortex can be feature-specific. Using the same data, though, we found clear evidence of modality-based cortical organization estimated from multivariate response patterns and spontaneous BOLD signal fluctuations. Thus, our results reveal an embedding of feature-specific multimodal processing in traditionally-defined cortical systems.

Download Full-text

Real Ear Sound Pressure Levels Developed by Three Portable Stereo System Earphones

American Journal of Audiology ◽

10.1044/1059-0889.0104.52 ◽

1992 ◽

Vol 1 (4) ◽

pp. 52-55 ◽

Cited By ~ 4

Author(s):

Gail L. MacLean ◽

Andrew Stuart ◽

Robert Stenstrom

Keyword(s):

High Frequency ◽

Sound Pressure ◽

Low Frequency ◽

Test System ◽

Output Frequency ◽

Frequency Effects ◽

Adult Men ◽

Frequency Responses ◽

Significant Difference ◽

Sound Pressure Levels

Differences in real ear sound pressure levels (SPLs) with three portable stereo system (PSS) earphones (supraaural [Sony Model MDR-44], semiaural [Sony Model MDR-A15L], and insert [Sony Model MDR-E225]) were investigated. Twelve adult men served as subjects. Frequency response, high frequency average (HFA) output, peak output, peak output frequency, and overall RMS output for each PSS earphone were obtained with a probe tube microphone system (Fonix 6500 Hearing Aid Test System). Results indicated a significant difference in mean RMS outputs with nonsignificant differences in mean HFA outputs, peak outputs, and peak output frequencies among PSS earphones. Differences in mean overall RMS outputs were attributed to differences in low-frequency effects that were observed among the frequency responses of the three PSS earphones. It is suggested that one cannot assume equivalent real ear SPLs, with equivalent inputs, among different styles of PSS earphones.

Download Full-text

Contributions of Voice and Nonverbal Communication to Perceived Masculinity–Femininity for Cisgender and Transgender Communicators

Journal of Speech Language and Hearing Research ◽

10.1044/2019_jslhr-19-00387 ◽

2020 ◽

Vol 63 (4) ◽

pp. 931-947

Author(s):

Teresa L. D. Hardy ◽

Carol A. Boliek ◽

Daniel Aalto ◽

Justin Lewicke ◽

Kristopher Wells ◽

...

Keyword(s):

Fundamental Frequency ◽

Sound Pressure Level ◽

Sound Pressure ◽

Vocal Tract ◽

Presentation Mode ◽

Pressure Level ◽

Presentation Modes ◽

Audiovisual Stimuli ◽

Vocal Tract Resonance ◽

Point Light

Purpose The purpose of this study was twofold: (a) to identify a set of communication-based predictors (including both acoustic and gestural variables) of masculinity–femininity ratings and (b) to explore differences in ratings between audio and audiovisual presentation modes for transgender and cisgender communicators. Method The voices and gestures of a group of cisgender men and women ( n = 10 of each) and transgender women ( n = 20) communicators were recorded while they recounted the story of a cartoon using acoustic and motion capture recording systems. A total of 17 acoustic and gestural variables were measured from these recordings. A group of observers ( n = 20) rated each communicator's masculinity–femininity based on 30- to 45-s samples of the cartoon description presented in three modes: audio, visual, and audio visual. Visual and audiovisual stimuli contained point light displays standardized for size. Ratings were made using a direct magnitude estimation scale without modulus. Communication-based predictors of masculinity–femininity ratings were identified using multiple regression, and analysis of variance was used to determine the effect of presentation mode on perceptual ratings. Results Fundamental frequency, average vowel formant, and sound pressure level were identified as significant predictors of masculinity–femininity ratings for these communicators. Communicators were rated significantly more feminine in the audio than the audiovisual mode and unreliably in the visual-only mode. Conclusions Both study purposes were met. Results support continued emphasis on fundamental frequency and vocal tract resonance in voice and communication modification training with transgender individuals and provide evidence for the potential benefit of modifying sound pressure level, especially when a masculine presentation is desired.

Download Full-text

Personal Audio System: Hearing Symptoms, Habits, and Sound Pressure Levels Measured in Real Ear and a Manikin

Journal of Speech Language and Hearing Research ◽

10.1044/2020_jslhr-19-00053 ◽

2020 ◽

Vol 63 (6) ◽

pp. 2016-2026

Author(s):

Tamara R. Almeida ◽

Clayton H. Rocha ◽

Camila M. Rabelo ◽

Raquel F. Gomes ◽

Ivone F. Neves-Lobo ◽

...

Keyword(s):

Sound Pressure ◽

Daily Basis ◽

Cross Sectional Study ◽

Normal Hearing ◽

Chi Square ◽

Cross Sectional ◽

The Real ◽

Significant Difference ◽

Sound Pressure Levels ◽

Audio System

Purpose The aims of this study were to characterize hearing symptoms, habits, and sound pressure levels (SPLs) of personal audio system (PAS) used by young adults; estimate the risk of developing hearing loss and assess whether instructions given to users led to behavioral changes; and propose recommendations for PAS users. Method A cross-sectional study was performed in 50 subjects with normal hearing. Procedures included questionnaire and measurement of PAS SPLs (real ear and manikin) through the users' own headphones and devices while they listened to four songs. After 1 year, 30 subjects answered questions about their usage habits. For the statistical analysis, one-way analysis of variance, Tukey's post hoc test, Lin and Spearman coefficients, the chi-square test, and logistic regression were used. Results Most subjects listened to music every day, usually in noisy environments. Sixty percent of the subjects reported hearing symptoms after using a PAS. Substantial variability in the equivalent music listening level (Leq) was noted ( M = 84.7 dBA; min = 65.1 dBA, max = 97.5 dBA). A significant difference was found only in the 4-kHz band when comparing the real-ear and manikin techniques. Based on the Leq, 38% of the individuals exceeded the maximum daily time allowance. Comparison of the subjects according to the maximum allowed daily exposure time revealed a higher number of hearing complaints from people with greater exposure. After 1 year, 43% of the subjects reduced their usage time, and 70% reduced the volume. A volume not exceeding 80% was recommended, and at this volume, the maximum usage time should be 160 min. Conclusions The habit of listening to music at high intensities on a daily basis seems to cause hearing symptoms, even in individuals with normal hearing. The real-ear and manikin techniques produced similar results. Providing instructions on this topic combined with measuring PAS SPLs may be an appropriate strategy for raising the awareness of people who are at risk. Supplemental Material https://doi.org/10.23641/asha.12431435

Download Full-text

Effects of Aging on the Subcortical Encoding of Stop Consonants

American Journal of Audiology ◽

10.1044/2020_aja-19-00044 ◽

2020 ◽

Vol 29 (3) ◽

pp. 391-403

Author(s):

Dania Rishiq ◽

Ashley Harkrider ◽

Cary Springer ◽

Mark Hedrick

Keyword(s):

Older Adults ◽

Repeated Measures ◽

Mixed Model ◽

Auditory Brainstem ◽

Auditory Brainstem Responses ◽

Aging Effects ◽

Formant Frequency ◽

Place Of Articulation ◽

Second Formant ◽

Effects Of Aging

Purpose The main purpose of this study was to evaluate aging effects on the predominantly subcortical (brainstem) encoding of the second-formant frequency transition, an essential acoustic cue for perceiving place of articulation. Method Synthetic consonant–vowel syllables varying in second-formant onset frequency (i.e., /ba/, /da/, and /ga/ stimuli) were used to elicit speech-evoked auditory brainstem responses (speech-ABRs) in 16 young adults ( M age = 21 years) and 11 older adults ( M age = 59 years). Repeated-measures mixed-model analyses of variance were performed on the latencies and amplitudes of the speech-ABR peaks. Fixed factors were phoneme (repeated measures on three levels: /b/ vs. /d/ vs. /g/) and age (two levels: young vs. older). Results Speech-ABR differences were observed between the two groups (young vs. older adults). Specifically, older listeners showed generalized amplitude reductions for onset and major peaks. Significant Phoneme × Group interactions were not observed. Conclusions Results showed aging effects in speech-ABR amplitudes that may reflect diminished subcortical encoding of consonants in older listeners. These aging effects were not phoneme dependent as observed using the statistical methods of this study.

Download Full-text

Hearing in Mice via GSR Audiometry

Journal of Speech and Hearing Research ◽

10.1044/jshr.0604.359 ◽

1963 ◽

Vol 6 (4) ◽

pp. 359-368 ◽

Cited By ~ 34

Author(s):

Charles I. Berlin

Keyword(s):

Inverse Relationship ◽

Sound Pressure ◽

Single Units ◽

Sensitivity Curve ◽

Basic Tool ◽

Eighth Nerve ◽

Pure Tones ◽

Conditioned Responses ◽

Frequency Intensity ◽

Near Threshold

Hearing in mice has been difficult to measure behaviorally. With GSR as the basic tool, the sensitivity curve to pure tones in mice has been successfully outlined. The most sensitive frequency-intensity combination was 15 000 cps at 0-5 dB re: 0.0002 dyne/cm 2 , with responses noted from 1 000 to beyond 70 000 cps. Some problems of reliability of conditioning were encountered, as well as findings concerning the inverse relationship between the size of GSR to unattenuated tones and the sound pressure necessary to elicit conditioned responses at or near threshold. These data agree well with the sensitivity of single units of the eighth nerve of the mouse.

Download Full-text

Stimulus Ratio Effects on Speech Discrimination by Children and Adults

Journal of Speech Language and Hearing Research ◽

10.1044/jshr.3403.671 ◽

1991 ◽

Vol 34 (3) ◽

pp. 671-678 ◽

Cited By ~ 9

Author(s):

Joan E. Sussman

Keyword(s):

Discrimination Task ◽

Response Pattern ◽

Response Patterns ◽

Speech Discrimination ◽

Adult Group ◽

Discrimination Accuracy ◽

Formant Frequency ◽

Response Strategies ◽

Place Of Articulation ◽

Adults And Children

This investigation examined the response strategies and discrimination accuracy of adults and children aged 5–10 as the ratio of same to different trials was varied across three conditions of a “change/no-change” discrimination task. The conditions varied as follows: (a) a ratio of one-third same to two-thirds different trials (33% same), (b) an equal ratio of same to different trials (50% same), and (c) a ratio of two-thirds same to one-third different trials (67% same). Stimuli were synthetic consonant-vowel syllables that changed along a place of articulation dimension by formant frequency transition. Results showed that all subjects changed their response strategies depending on the ratio of same-to-different trials. The most lax response pattern was observed for the 50% same condition, and the most conservative pattern was observed for the 67% same condition. Adult response patterns were most conservative across condition. Differences in discrimination accuracy as measured by P(C) were found, with the largest difference in the 5- to 6-year-old group and the smallest change in the adult group. These findings suggest that children’s response strategies, like those of adults, can be manipulated by changing the ratio of same-to-different trials. Furthermore, interpretation of sensitivity measures must be referenced to task variables such as the ratio of same-to-different trials.

Download Full-text