Using Eye-Tracking to Analyze Collaboration in a Virtual Role Play Environment

An Eye-Tracking Study on Audiovisual Speech Perception Strategies Adopted by Normal-Hearing and Deaf Adults Under Different Language Familiarities

Journal of Speech Language and Hearing Research ◽

10.1044/2020_jslhr-19-00223 ◽

2020 ◽

Vol 63 (7) ◽

pp. 2245-2254 ◽

Cited By ~ 1

Author(s):

Jianrong Wang ◽

Yumeng Zhu ◽

Yu Chen ◽

Abdilbar Mamat ◽

Mei Yu ◽

...

Keyword(s):

Speech Perception ◽

Eye Tracking ◽

Normal Hearing ◽

Audiovisual Speech ◽

Audiovisual Speech Perception ◽

Allocation Pattern ◽

Deaf Adults ◽

Bilingual Speaker ◽

Primary Hypothesis ◽

Standard Chinese

Purpose The primary purpose of this study was to explore the audiovisual speech perception strategies.80.23.47 adopted by normal-hearing and deaf people in processing familiar and unfamiliar languages. Our primary hypothesis was that they would adopt different perception strategies due to different sensory experiences at an early age, limitations of the physical device, and the developmental gap of language, and others. Method Thirty normal-hearing adults and 33 prelingually deaf adults participated in the study. They were asked to perform judgment and listening tasks while watching videos of a Uygur–Mandarin bilingual speaker in a familiar language (Standard Chinese) or an unfamiliar language (Modern Uygur) while their eye movements were recorded by eye-tracking technology. Results Task had a slight influence on the distribution of selective attention, whereas subject and language had significant influences. To be specific, the normal-hearing and the d10eaf participants mainly gazed at the speaker's eyes and mouth, respectively, in the experiment; moreover, while the normal-hearing participants had to stare longer at the speaker's mouth when they confronted with the unfamiliar language Modern Uygur, the deaf participant did not change their attention allocation pattern when perceiving the two languages. Conclusions Normal-hearing and deaf adults adopt different audiovisual speech perception strategies: Normal-hearing adults mainly look at the eyes, and deaf adults mainly look at the mouth. Additionally, language and task can also modulate the speech perception strategy.

Download Full-text

Effects of Using Mixed Reality With Coaching on the Interprofessional Communication Skills of Speech-Language Pathology Graduate Students

Perspectives of the ASHA Special Interest Groups ◽

10.1044/2020_persp-20-00098 ◽

2021 ◽

pp. 1-21

Author(s):

Jacqueline A. Towson ◽

Matthew S. Taylor ◽

Diana L. Abarca ◽

Claire Donehower Paul ◽

Faith Ezekiel-Wilder

Keyword(s):

Graduate Students ◽

Self Efficacy ◽

Mixed Reality ◽

Role Play ◽

Speech Language Pathology ◽

Traditional Role ◽

Allied Health Professionals ◽

Interprofessional Communication ◽

Language Pathology ◽

The Individual

Purpose Communication between allied health professionals, teachers, and family members is a critical skill when addressing and providing for the individual needs of patients. Graduate students in speech-language pathology programs often have limited opportunities to practice these skills prior to or during externship placements. The purpose of this study was to research a mixed reality simulator as a viable option for speech-language pathology graduate students to practice interprofessional communication (IPC) skills delivering diagnostic information to different stakeholders compared to traditional role-play scenarios. Method Eighty graduate students ( N = 80) completing their third semester in one speech-language pathology program were randomly assigned to one of four conditions: mixed-reality simulation with and without coaching or role play with and without coaching. Data were collected on students' self-efficacy, IPC skills pre- and postintervention, and perceptions of the intervention. Results The students in the two coaching groups scored significantly higher than the students in the noncoaching groups on observed IPC skills. There were no significant differences in students' self-efficacy. Students' responses on social validity measures showed both interventions, including coaching, were acceptable and feasible. Conclusions Findings indicated that coaching paired with either mixed-reality simulation or role play are viable methods to target improvement of IPC skills for graduate students in speech-language pathology. These findings are particularly relevant given the recent approval for students to obtain clinical hours in simulated environments.

Download Full-text

Using the Theory of Planned Behavior to Predict Faking in Selection Exercises Varying in Fidelity

Journal of Personnel Psychology ◽

10.1027/1866-5888/a000211 ◽

2018 ◽

Vol 17 (3) ◽

pp. 155-160 ◽

Cited By ~ 3

Author(s):

Daniel Dürr ◽

Ute-Christine Klehe

Keyword(s):

Theory Of Planned Behavior ◽

Planned Behavior ◽

Predictive Validity ◽

Group Discussion ◽

Role Play ◽

Selection Procedure ◽

High Fidelity ◽

Selection Research ◽

Play Group

Abstract. Faking has been a concern in selection research for many years. Many studies have examined faking in questionnaires while far less is known about faking in selection exercises with higher fidelity. This study applies the theory of planned behavior (TPB; Ajzen, 1991 ) to low- (interviews) and high-fidelity (role play, group discussion) exercises, testing whether the TPB predicts reported faking behavior. Data from a mock selection procedure suggests that candidates do report to fake in low- and high-fidelity exercises. Additionally, the TPB showed good predictive validity for faking in a low-fidelity exercise, yet not for faking in high-fidelity exercises.

Download Full-text

Activation and Persistence of Implicit Causality Information in Spoken Language Comprehension

Experimental Psychology (formerly Zeitschrift für Experimentelle Psychologie) ◽

10.1027/1618-3169/a000002 ◽

2010 ◽

Vol 57 (1) ◽

pp. 5-16 ◽

Cited By ~ 46

Author(s):

Pirita Pyykkönen ◽

Juhani Järvikivi

Keyword(s):

Eye Tracking ◽

Language Comprehension ◽

Spoken Language ◽

Visual World ◽

Implicit Causality ◽

Causality Information ◽

Spoken Language Comprehension

A visual world eye-tracking study investigated the activation and persistence of implicit causality information in spoken language comprehension. We showed that people infer the implicit causality of verbs as soon as they encounter such verbs in discourse, as is predicted by proponents of the immediate focusing account ( Greene & McKoon, 1995 ; Koornneef & Van Berkum, 2006 ; Van Berkum, Koornneef, Otten, & Nieuwland, 2007 ). Interestingly, we observed activation of implicit causality information even before people encountered the causal conjunction. However, while implicit causality information was persistent as the discourse unfolded, it did not have a privileged role as a focusing cue immediately at the ambiguous pronoun when people were resolving its antecedent. Instead, our study indicated that implicit causality does not affect all referents to the same extent, rather it interacts with other cues in the discourse, especially when one of the referents is already prominently in focus.

Download Full-text