Temporal Eye-Voice Span as a Dynamic Indicator for Cognitive Effort During Speech Processing: A Comparative Study of Reading Aloud and Sight Translation

2021 ◽  
pp. 161-179
Author(s):  
Hao Zhou ◽  
Yu Weng ◽  
Binghan Zheng
2019 ◽  
Vol 63 (3) ◽  
pp. 695-716
Author(s):  
Camille Collard ◽  
Heike Przybyl ◽  
Bart Defrancq

In Dutch and German subordinate clauses, the verb is generally placed after the clausal constituents (Subject-Object-Verb structure) thereby creating a middle field (or verbal brace). This makes interpreting from SOV into SVO languages particularly challenging as it requires further processing and feats of memory. It often requires interpreters to use specific strategies (for example, anticipation) (Lederer 1981; Liontou 2011). However, few studies have tackled this issue from the point of view of interpreting into SOV languages. Producing SOV structures requires some specific cognitive effort as, for instance, subject properties need to be kept in mind in order to ensure the correct subject-verb agreement across a span of 10 or 20 words. Speakers therefore often opt for a strategy called extraposition, placing specific elements after the verb in order to shorten the brace (Hawkins 1994; Bevilacqua 2009). Dutch speakers use this strategy more often than German speakers (Haeseryn 1990). Given the additional cognitive load generated by the interpreting process (Gile 1999), it may be assumed that interpreters will shorten the verbal brace to a larger extent than native speakers. The present study is based on a corpus of interpreted and non-mediated speeches at the European Parliament and compares middle field lengths as well as extraposition in Dutch and German subordinate clauses. Results from 3460 subordinate clauses confirm that interpreters of both languages shorten the middle field more than native speakers. The study also shows that German interpreters use extraposition more often than native speakers, but this is not the case for Dutch interpreters. Dutch and German interpreters appear to use extraposition partly because they imitate the clause word order of the source speech, showing that, in this case, extraposition can be considered an effort-saving tool.


2021 ◽  
Vol 16 ◽  
pp. 146-154
Author(s):  
Khamlich Salah Eddine ◽  
Khamlich Fathallah ◽  
Issam Atouf ◽  
Benrabh Mohamed

Speech processing in real time requires the use of fast, reconfigurable electronic circuits capable of handling large amounts of information generated by the audio source. This article presents hardware implementations of a multilayer perceptron (MLP) and the MFCC algorithm for speech recognition. These algorithms have been implemented in hardware and tested in an on-board electronic card based on a reconfigurable circuit (FPGA). We also present a comparative study between several architectures of MLP and with the literature on the level of costs with regard to the surface of silicon, the speed and the computing resources required. Following the FPGA circuit modification, we created NIOSII processors to physically implement the architecture of ANN-type MLPs and MFCC speech recognition algorithms and perform real-time speech recognition functions.


2020 ◽  
Author(s):  
Bruno Oliveira Ferreira de Souza ◽  
Éve‐Marie Frigon ◽  
Robert Tremblay‐Laliberté ◽  
Christian Casanova ◽  
Denis Boire

Author(s):  
Jennifer M. Roche ◽  
Arkady Zgonnikov ◽  
Laura M. Morett

Purpose The purpose of the current study was to evaluate the social and cognitive underpinnings of miscommunication during an interactive listening task. Method An eye and computer mouse–tracking visual-world paradigm was used to investigate how a listener's cognitive effort (local and global) and decision-making processes were affected by a speaker's use of ambiguity that led to a miscommunication. Results Experiments 1 and 2 found that an environmental cue that made a miscommunication more or less salient impacted listener language processing effort (eye-tracking). Experiment 2 also indicated that listeners may develop different processing heuristics dependent upon the speaker's use of ambiguity that led to a miscommunication, exerting a significant impact on cognition and decision making. We also found that perspective-taking effort and decision-making complexity metrics (computer mouse tracking) predict language processing effort, indicating that instances of miscommunication produced cognitive consequences of indecision, thinking, and cognitive pull. Conclusion Together, these results indicate that listeners behave both reciprocally and adaptively when miscommunications occur, but the way they respond is largely dependent upon the type of ambiguity and how often it is produced by the speaker.


2015 ◽  
Vol 20 (2) ◽  
pp. 49-57 ◽  
Author(s):  
Yvonne Rogalski ◽  
Amy Rominger

For this exploratory cross-disciplinary study, a speech-language pathologist and an audiologist collaborated to investigate the effects of objective and subjective hearing loss on cognition and memory in 11 older adults without hearing loss (OAs), 6 older adults with unaided hearing loss (HLOAs), and 16 young adults (YAs). All participants received cognitive testing and a complete audiologic evaluation including a subjective questionnaire about perceived hearing difficulty. Memory testing involved listening to or reading aloud a text passage then verbally recalling the information. Key findings revealed that objective hearing loss and subjective hearing loss were correlated and both were associated with a cognitive screening test. Potential clinical implications are discussed and include a need for more cross-professional collaboration in assessing older adults with hearing loss.


2001 ◽  
Vol 268 (6) ◽  
pp. 1739-1748
Author(s):  
Aitor Hierro ◽  
Jesus M. Arizmendi ◽  
Javier De Las Rivas ◽  
M. Angeles Urbaneja ◽  
Adelina Prado ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document