scholarly journals How much do visual cues help listeners in perceiving accented speech?

2018 ◽  
Vol 40 (1) ◽  
pp. 93-109
Author(s):  
YI ZHENG ◽  
ARTHUR G. SAMUEL

AbstractIt has been documented that lipreading facilitates the understanding of difficult speech, such as noisy speech and time-compressed speech. However, relatively little work has addressed the role of visual information in perceiving accented speech, another type of difficult speech. In this study, we specifically focus on accented word recognition. One hundred forty-two native English speakers made lexical decision judgments on English words or nonwords produced by speakers with Mandarin Chinese accents. The stimuli were presented as either as videos that were of a relatively far speaker or as videos in which we zoomed in on the speaker’s head. Consistent with studies of degraded speech, listeners were more accurate at recognizing accented words when they saw lip movements from the closer apparent distance. The effect of apparent distance tended to be larger under nonoptimal conditions: when stimuli were nonwords than words, and when stimuli were produced by a speaker who had a relatively strong accent. However, we did not find any influence of listeners’ prior experience with Chinese accented speech, suggesting that cross-talker generalization is limited. The current study provides practical suggestions for effective communication between native and nonnative speakers: visual information is useful, and it is more useful in some circumstances than others.

Phonetica ◽  
2020 ◽  
Vol 77 (6) ◽  
pp. 441-479
Author(s):  
Rebecca Laturnus

<b><i>Background/Aims:</i></b> Previous research has shown that exposure to multiple foreign accents facilitates adaptation to an untrained novel accent. One explanation is that L2 speech varies systematically such that there are commonalities in the productions of nonnative speakers, regardless of their language background. <b><i>Methods:</i></b> A systematic acoustic comparison was conducted between 3 native English speakers and 6 nonnative accents. Voice onset time, unstressed vowel duration, and formant values of stressed and unstressed vowels were analyzed, comparing each nonnative accent to the native English talkers. A subsequent perception experiment tests what effect training on regionally accented voices has on the participant’s comprehension of nonnative accented speech to investigate the importance of within-speaker variation on attunement and generalization. <b><i>Results:</i></b> Data for each measure show substantial variability across speakers, reflecting phonetic transfer from individual L1s, as well as substantial inconsistency and variability in pronunciation, rather than commonalities in their productions. Training on native English varieties did not improve participants’ accuracy in understanding nonnative speech. <b><i>Conclusion:</i></b> These findings are more consistent with a hypothesis of accent attune­ment wherein listeners track general patterns of nonnative speech rather than relying on overlapping acoustic signals between speakers.


Perception ◽  
10.1068/p7153 ◽  
2012 ◽  
Vol 41 (2) ◽  
pp. 175-192 ◽  
Author(s):  
Esteban R Calcagno ◽  
Ezequiel L Abregú ◽  
Manuel C Eguía ◽  
Ramiro Vergara

In humans, multisensory interaction is an important strategy for improving the detection of stimuli of different nature and reducing the variability of response. It is known that the presence of visual information affects the auditory perception in the horizontal plane (azimuth), but there are few researches that study the influence of vision in the auditory distance perception. In general, the data obtained from these studies are contradictory and do not completely define the way in which visual cues affect the apparent distance of a sound source. Here psychophysical experiments on auditory distance perception in humans are performed, including and excluding visual cues. The results show that the apparent distance from the source is affected by the presence of visual information and that subjects can store in their memory a representation of the environment that later improves the perception of distance.


Author(s):  
Mien-Jen Wu ◽  
Tania Ionin

This paper examines the effect of intonation contour on two types of scopally ambiguous constructions in English: configurations with a universal quantifier in subject position and sentential negation (e.g., Every horse didn’t jump) and configurations with quantifiers in both subject and object positions (e.g., A girl saw every boy). There is much prior literature on the relationship between the fall-rise intonation and availability of inverse scope with quantifier-negation configurations. The present study has two objectives: (1) to examine whether the role of intonation in facilitating inverse scope is restricted to this configuration, or whether it extends to double-quantifier configurations as well; and (2) to examine whether fall-rise intonation fully disambiguates the sentence, or only facilitates inverse scope. These questions were investigated experimentally, via an auditory acceptability judgment task, in which native English speakers rated the acceptability of auditorily presented sentences in contexts matching surface-scope vs. inverse-scope readings. The results provide evidence that fall-rise intonation facilitates the inverse-scope readings of English quantifier-negation configurations (supporting findings from prior literature), but not those of double-quantifier configurations.


Neurology ◽  
2018 ◽  
Vol 90 (11) ◽  
pp. e977-e984 ◽  
Author(s):  
Motoyasu Honma ◽  
Yuri Masaoka ◽  
Takeshi Kuroda ◽  
Akinori Futamura ◽  
Azusa Shiromaru ◽  
...  

ObjectiveTo determine whether Parkinson disease (PD) affects cross-modal function of vision and olfaction because it is known that PD impairs various cognitive functions, including olfaction.MethodsWe conducted behavioral experiments to identify the influence of PD on cross-modal function by contrasting patient performance with age-matched normal controls (NCs). We showed visual effects on the strength and preference of odor by manipulating semantic connections between picture/odorant pairs. In addition, we used brain imaging to identify the role of striatal presynaptic dopamine transporter (DaT) deficits.ResultsWe found that odor evaluation in participants with PD was unaffected by visual information, while NCs overestimated smell when sniffing odorless liquid while viewing pleasant/unpleasant visual cues. Furthermore, DaT deficit in striatum, for the posterior putamen in particular, correlated to few visual effects in participants with PD.ConclusionsThese findings suggest that PD impairs cross-modal function of vision/olfaction as a result of posterior putamen deficit. This cross-modal dysfunction may serve as the basis of a novel precursor assessment of PD.


Author(s):  
Aslı Altan ◽  
Erika Hoff

Children in bilingual communities are frequently exposed to speech from nonnative speakers, but little research has described how that input might differ from the input of native speakers. There is evidence that input from nonnative speakers might be less useful to language learning children, but little research has asked why. This chapter analyzes the frequency of complex structures in the child-directed speech of 30 native English speakers and 36 nonnative speakers who were late learners of English, all speaking English to their two-and-a-half-year-old children. All instances of nine categories of complex structures were coded in transcripts of mother-child interaction. The frequency of all but one category was greater in the speech of native speakers. These findings suggest that input provided by native speakers provides more frequent models of complex structures than nonnative input.


2018 ◽  
Vol 10 (6) ◽  
pp. 193
Author(s):  
Yaseen A. Azi

Based on the literature review, the three patterns (fillers, repairs and repetitions) in the conversations of the native English speakers are generally regarded as results of the normal speaking between people. On the other hand, the same patterns in the conversations of the L2 speakers are always seen as a marker of disfluency and linguistic disabilities of the nonnative speakers. Therefore, this study simply focuses on finding how the three disfluency patterns are used by the Saudi English speakers from different levels of fluency. The sampling of the study includes two groups of participants from different fluency levels. Through the transcriptions and the discourse analysis of one hour recoding of the two groups, the results showed that the three patterns (fillers, repairs and repetitions) should not be generally associated with disfluency. Instead, repetitions and self-repairs have been equally used by the two groups and such patterns can be used as a conversational device. However, the filler “uh” with longer pausing can clearly predict disfluency among the Saudi English speakers. 


2015 ◽  
Vol 37 (2) ◽  
pp. 303-322 ◽  
Author(s):  
JOAN SERENO ◽  
LYNNE LAMMERS ◽  
ALLARD JONGMAN

ABSTRACTThe present study examines the relative impact of segments and intonation on accentedness, comprehensibility, and intelligibility, specifically investigating the separate contribution of segmental and intonational information to perceived foreign accent in Korean-accented English. Two English speakers and two Korean speakers recorded 40 English sentences. The sentences were manipulated by combining segments from one speaker with intonation (fundamental frequency contour and duration) from another speaker. Four versions of each sentence were created: one English control (English segments and English intonation), one Korean control (Korean segments and Korean intonation), and two Korean–English combinations (one with English segments and Korean intonation; the other with Korean segments and English intonation). Forty native English speakers transcribed the sentences for intelligibility and rated their comprehensibility and accentedness. The data show that segments had a significant effect on accentedness, comprehensibility, and intelligibility, but intonation only had an effect on intelligibility. Contrary to previous studies, the present study, separating segments from intonation, suggests that segmental information contributes substantially more to the perception of foreign accentedness than intonation. Native speakers seem to rely mainly on segments when determining foreign accentedness.


2015 ◽  
Vol 36 (1) ◽  
pp. 23-42 ◽  
Author(s):  
CATHERINE E. SHOWALTER ◽  
RACHEL HAYES-HARB

ABSTRACTRecent research has indicated that learners exposed to second language words’ orthographic forms of words can often use this information to make inferences about the words’ phonological forms. Here we asked, do learners benefit even when the orthography is unfamiliar? We taught native English speakers minimal nonword pairs differentiated by the Arabic velar–uvular contrast (e.g., [kubu], [qubu]) and manipulated the quality of orthographic input. We found that participants were consistently unable to associate the novel phonemes with novel words. Results are discussed in terms of (a) the role of orthographic input in second language word form learning, (b) the influence of orthographic familiarity in moderating the role of orthographic input, and (c) the issue of talker variability in word learning.


2017 ◽  
Vol 30 (7-8) ◽  
pp. 653-679 ◽  
Author(s):  
Nida Latif ◽  
Agnès Alsius ◽  
K. G. Munhall

During conversations, we engage in turn-taking behaviour that proceeds back and forth effortlessly as we communicate. In any given day, we participate in numerous face-to-face interactions that contain social cues from our partner and we interpret these cues to rapidly identify whether it is appropriate to speak. Although the benefit provided by visual cues has been well established in several areas of communication, the use of visual information to make turn-taking decisions during conversation is unclear. Here we conducted two experiments to investigate the role of visual information in identifying conversational turn exchanges. We presented clips containing single utterances spoken by single individuals engaged in a natural conversation with another. These utterances were from either right before a turn exchange (i.e., when the current talker would finish and the other would begin) or were utterances where the same talker would continue speaking. In Experiment 1, participants were presented audiovisual, auditory-only and visual-only versions of our stimuli and identified whether a turn exchange would occur or not. We demonstrated that although participants could identify turn exchanges with unimodal information alone, they performed best in the audiovisual modality. In Experiment 2, we presented participants audiovisual turn exchanges where the talker, the listener or both were visible. We showed that participants suffered a cost at identifying turns exchanges when visual cues from the listener were not available. Overall, we demonstrate that although auditory information is sufficient for successful conversation, visual information plays an important role in the overall efficiency of communication.


Author(s):  
Mahjoobeh Abarghooeinezhad ◽  
Shahla Simin

This paper seeks to analyze the research article abstracts among native English speakers and non-native (Iranian) speakers in the field of Electronic engineering. The analysis mainly focuses on the rhetorical structure, i.e. the constituent Moves/Sub-Moves. In addition, Verb choices and the voice and tense of the verbs in Move 2 and Move 4 respectively were examined. To this end, 25 published abstracts from each field (a total of 50 abstracts), all appearing in established, ISI journals, were selected. The model proposed by Santos (1996), composed of 5 moves along AntMover software was employed as a general guideline in order to identify Moves/SubMoves. The results compared and contrasted the dominant move patterns of each field, their unique Move/SubMoves, and the typical voice and tense of verbs employed in Move 4. It was also found that there were some variations between the abstracts written by native English speakers and nonnative speakers of English. It is hoped that with detailed analyses of abstracts, the results of this study may serve as a complement to the guidelines for novice writers to construct a proper research article abstract in electronic engineering.


Sign in / Sign up

Export Citation Format

Share Document