Investigating the Role of Familiar Face and Voice Cues in Speech Processing in Noise

Author(s):  
Jeesun Kim ◽  
Sonya Karisma ◽  
Vincent Aubanel ◽  
Chris Davis
Perception ◽  
2021 ◽  
Vol 50 (2) ◽  
pp. 174-177
Author(s):  
Sarah Laurence ◽  
Jordyn Eyre ◽  
Ailsa Strathie

Expertise in familiar face recognition has been well-documented in several studies. Here, we examined the role of context using a surprise lecturer recognition test. Across two experiments, we found few students recognised their lecturer when they were unexpected, but accuracy was higher when the lecturer was preceded by a prompt. Our findings suggest that familiar face recognition can be poor in unexpected contexts.


2017 ◽  
Vol 61 (1) ◽  
pp. 84-96 ◽  
Author(s):  
David M. Gómez ◽  
Peggy Mok ◽  
Mikhail Ordin ◽  
Jacques Mehler ◽  
Marina Nespor

Research has demonstrated distinct roles for consonants and vowels in speech processing. For example, consonants have been shown to support lexical processes, such as the segmentation of speech based on transitional probabilities (TPs), more effectively than vowels. Theory and data so far, however, have considered only non-tone languages, that is to say, languages that lack contrastive lexical tones. In the present work, we provide a first investigation of the role of consonants and vowels in statistical speech segmentation by native speakers of Cantonese, as well as assessing how tones modulate the processing of vowels. Results show that Cantonese speakers are unable to use statistical cues carried by consonants for segmentation, but they can use cues carried by vowels. This difference becomes more evident when considering tone-bearing vowels. Additional data from speakers of Russian and Mandarin suggest that the ability of Cantonese speakers to segment streams with statistical cues carried by tone-bearing vowels extends to other tone languages, but is much reduced in speakers of non-tone languages.


Author(s):  
Anton Batliner ◽  
Bernd Möbius

Automatic speech processing (ASP) is understood as covering word recognition, the processing of higher linguistic components (syntax, semantics, and pragmatics), and the processing of computational paralinguistics (CP), which deals with speaker states and traits. This chapter attempts to track the role of prosody in ASP from the word level up to CP. A short history of the field from 1980 to 2020 distinguishes the early years (until 2000)—when the prosodic contribution to the modelling of linguistic phenomena, such as accents, boundaries, syntax, semantics, and dialogue acts, was the focus—from the later years, when the focus shifted to paralinguistics; prosody ceased to be visible. Different types of predictor variables are addressed, among them high-performance power features as well as leverage features, which can also be employed in teaching and therapy.


2019 ◽  
Vol 31 (8) ◽  
pp. 1205-1215 ◽  
Author(s):  
Victor J. Boucher ◽  
Annie C. Gilbert ◽  
Boutheina Jemel

Studies that use measures of cerebro-acoustic coherence have shown that theta oscillations (3–10 Hz) entrain to syllable-size modulations in the energy envelope of speech. This entrainment creates sensory windows in processing acoustic cues. Recent reports submit that delta oscillations (<3 Hz) can be entrained by nonsensory content units like phrases and serve to process meaning—though such views face fundamental problems. Other studies suggest that delta underlies a sensory chunking linked to the processing of sequential attributes of speech sounds. This chunking associated with the “focus of attention” is commonly manifested by the temporal grouping of items in sequence recall. Similar grouping in speech may entrain delta. We investigate this view by examining how low-frequency oscillations entrain to three types of stimuli (tones, nonsense syllables, and utterances) having similar timing, pitch, and energy contours. Entrainment was indexed by “intertrial phase coherence” in the EEGs of 18 listeners. The results show that theta oscillations at central sites entrain to syllable-size elements in speech and tones. However, delta oscillations at frontotemporal sites specifically entrain to temporal groups in both meaningful utterances and meaningless syllables, which indicates that delta may support but does not directly bear on a processing of content. The findings overall suggest that, although theta entrainment relates to a processing of acoustic attributes, delta entrainment links to a sensory chunking that relates to a processing of properties of articulated sounds. The results also show that measures of intertrial phase coherence can be better suited than cerebro-acoustic coherence in revealing delta entrainment.


2020 ◽  
Vol 32 (2) ◽  
pp. 226-240 ◽  
Author(s):  
Benedikt Zoefel ◽  
Isobella Allard ◽  
Megha Anil ◽  
Matthew H. Davis

Several recent studies have used transcranial alternating current stimulation (tACS) to demonstrate a causal role of neural oscillatory activity in speech processing. In particular, it has been shown that the ability to understand speech in a multi-speaker scenario or background noise depends on the timing of speech presentation relative to simultaneously applied tACS. However, it is possible that tACS did not change actual speech perception but rather auditory stream segregation. In this study, we tested whether the phase relation between tACS and the rhythm of degraded words, presented in silence, modulates word report accuracy. We found strong evidence for a tACS-induced modulation of speech perception, but only if the stimulation was applied bilaterally using ring electrodes (not for unilateral left hemisphere stimulation with square electrodes). These results were only obtained when data were analyzed using a statistical approach that was identified as optimal in a previous simulation study. The effect was driven by a phasic disruption of word report scores. Our results suggest a causal role of neural entrainment for speech perception and emphasize the importance of optimizing stimulation protocols and statistical approaches for brain stimulation research.


Infancy ◽  
2004 ◽  
Vol 5 (3) ◽  
pp. 341-353 ◽  
Author(s):  
Barbara Höhle ◽  
Jürgen Weissenborn ◽  
Dorothea Kiefer ◽  
Antje Schulz ◽  
Michaela Schmitz

2007 ◽  
Vol 18 (07) ◽  
pp. 539-547 ◽  
Author(s):  
Fergus I.M. Craik

The article presents a commentary on the accompanying six papers from the perspective of a cognitive psychologist. Treisman's (1964, 1969) levels of analysis model of selective attention is suggested as a framework within which the interactions between 'bottom-up' auditory factors and 'top-down' cognitive factors may be understood. The complementary roles of auditory and cognitive aspects of hearing are explored, and their mutually compensatory properties discussed. The findings and ideas reported in the six accompanying papers fit well into such a 'levels of processing' framework, which may therefore be proposed as a model for understanding the effects of aging on speech processing and comprehension. El artículo presenta un comentario sobre los seis trabajos acompañantes desde la perspectiva de un psicólogo de la cognición. Se sugiere el modelo de Treisman (1964, 1969) de niveles de análisis de la atención selectiva como el marco dentro del cuál las interacciones entre los factores de atención "de abajo hacia arriba" y los factores cognitivos de "de arriba hacia abajo" pueden ser comprendidos. Se exploran los papeles complementarios de los aspectos auditivos y cognitivos de la audición y se discuten sus mutuas propiedades compensatorias. Los hallazgos e ideas reportados en los seis trabajos acompañantes calzan bien en dicho marco de "niveles de procesamiento", los que puede, por tanto, ser propuestos como un modelo para comprender el efecto del envejecimiento para el procesamiento y la comprensión del lenguaje.


2021 ◽  
Vol 11 ◽  
Author(s):  
Melis Çetinçelik ◽  
Caroline F. Rowland ◽  
Tineke M. Snijders

Eye gaze is a ubiquitous cue in child–caregiver interactions, and infants are highly attentive to eye gaze from very early on. However, the question of why infants show gaze-sensitive behavior, and what role this sensitivity to gaze plays in their language development, is not yet well-understood. To gain a better understanding of the role of eye gaze in infants' language learning, we conducted a broad systematic review of the developmental literature for all studies that investigate the role of eye gaze in infants' language development. Across 77 peer-reviewed articles containing data from typically developing human infants (0–24 months) in the domain of language development, we identified two broad themes. The first tracked the effect of eye gaze on four developmental domains: (1) vocabulary development, (2) word–object mapping, (3) object processing, and (4) speech processing. Overall, there is considerable evidence that infants learn more about objects and are more likely to form word–object mappings in the presence of eye gaze cues, both of which are necessary for learning words. In addition, there is good evidence for longitudinal relationships between infants' gaze following abilities and later receptive and expressive vocabulary. However, many domains (e.g., speech processing) are understudied; further work is needed to decide whether gaze effects are specific to tasks, such as word–object mapping or whether they reflect a general learning enhancement mechanism. The second theme explored the reasons why eye gaze might be facilitative for learning, addressing the question of whether eye gaze is treated by infants as a specialized socio-cognitive cue. We concluded that the balance of evidence supports the idea that eye gaze facilitates infants' learning by enhancing their arousal, memory, and attentional capacities to a greater extent than other low-level attentional cues. However, as yet, there are too few studies that directly compare the effect of eye gaze cues and non-social, attentional cues for strong conclusions to be drawn. We also suggest that there might be a developmental effect, with eye gaze, over the course of the first 2 years of life, developing into a truly ostensive cue that enhances language learning across the board.


2020 ◽  
Vol 4 (4) ◽  
pp. p1
Author(s):  
Théophile Munyangeyo

This reflection aims to depict the prospective position and role of translation and interpreting in the globalised world. Demographic factors point to a long-lasting multilingualism, which reflects the co-existence of linguistic identities within a variety of settings. From schools, to workplaces and communities, different languages are and will continue to be in use. In many countries, there is an increasing wave of using vernacular and migrant languages in education. However, the current global academic discourse on language situations does not sufficiently reflect this new looming reality. The focus of translation and interpreting studies has traditionally been placed on those languages that were perceived as internationally important. One would assume that economic and diplomatic interests have influenced that approach and attitude. With changes affecting the globalised world in relation to the rise of some emerging economies and new resources, it is clear that the interlingual communication will be one of the greatest challenges of the coming age. In this regard, a new paradigm in overall language promotion and education must be formulated within which human translation and interpretation continue be seen as important skills to be generally acquired.


Sign in / Sign up

Export Citation Format

Share Document