Towards End-to-End Video-Based Eye-Tracking

Auto-Stereoscopic 3D Video Conversation System Based on an Improved Eye Tracking Method

Applied Mechanics and Materials ◽

10.4028/www.scientific.net/amm.513-517.3907 ◽

2014 ◽

Vol 513-517 ◽

pp. 3907-3910

Author(s):

Chen Yu Jia ◽

Ze Hua Gao ◽

Xun Bo Yu ◽

Xin Zhu Sang ◽

Tian Qi Zhao

Keyword(s):

Eye Tracking ◽

Graphic Processing Unit ◽

3D Video ◽

Processing Unit ◽

Stereoscopic Video ◽

Stereoscopic 3D ◽

Tracking Method ◽

End To End ◽

Stereoscopic 3D Video ◽

Graphic Processing

An auto-stereoscopic 3D video conversation system is demonstrated with an improved eye-tracking method based on a lenticular sheet and two cameras. The two cameras are used to get stereoscopic picture pairs and addressed the viewers position by an Improved Eye Tracking Method. The computer combines the stereoscopic picture pairs with different masks graphic processing unit. Low crosstalk correct stereoscopic video pairs for the end-to-end commutation are achieved.

Download Full-text

PyTrack: An end-to-end analysis toolkit for eye tracking

Behavior Research Methods ◽

10.3758/s13428-020-01392-6 ◽

2020 ◽

Vol 52 (6) ◽

pp. 2588-2603

Author(s):

Upamanyu Ghose ◽

Arvind A. Srinivasan ◽

W. Paul Boyce ◽

Hong Xu ◽

Eng Siong Chng

Keyword(s):

Statistical Analysis ◽

Eye Movements ◽

Eye Tracking ◽

Automated Analysis ◽

Movement Behavior ◽

High Temporal Resolution ◽

Technological Advancement ◽

Tracking Data ◽

End To End ◽

Parameters Of Interest

AbstractEye tracking is a widely used tool for behavioral research in the field of psychology. With technological advancement, we now have specialized eye-tracking devices that offer high sampling rates, up to 2000 Hz, and allow for measuring eye movements with high accuracy. They also offer high spatial resolution, which enables the recording of very small movements, like drifts and microsaccades. Features and parameters of interest that characterize eye movements need to be algorithmically extracted from raw data as most eye trackers identify only basic parameters, such as blinks, fixations, and saccades. Eye-tracking experiments may investigate eye movement behavior in different groups of participants and in varying stimuli conditions. Hence, the analysis stage of such experiments typically involves two phases, (i) extraction of parameters of interest and (ii) statistical analysis between different participants or stimuli conditions using these parameters. Furthermore, the datasets collected in these experiments are usually very large in size, owing to the high temporal resolution of the eye trackers, and hence would benefit from an automated analysis toolkit. In this work, we present PyTrack, an end-to-end open-source solution for the analysis and visualization of eye-tracking data. It can be used to extract parameters of interest, generate and visualize a variety of gaze plots from raw eye-tracking data, and conduct statistical analysis between stimuli conditions and subject groups.

Download Full-text

An Eye-Tracking Study on Audiovisual Speech Perception Strategies Adopted by Normal-Hearing and Deaf Adults Under Different Language Familiarities

Journal of Speech Language and Hearing Research ◽

10.1044/2020_jslhr-19-00223 ◽

2020 ◽

Vol 63 (7) ◽

pp. 2245-2254 ◽

Cited By ~ 1

Author(s):

Jianrong Wang ◽

Yumeng Zhu ◽

Yu Chen ◽

Abdilbar Mamat ◽

Mei Yu ◽

...

Keyword(s):

Speech Perception ◽

Eye Tracking ◽

Normal Hearing ◽

Audiovisual Speech ◽

Audiovisual Speech Perception ◽

Allocation Pattern ◽

Deaf Adults ◽

Bilingual Speaker ◽

Primary Hypothesis ◽

Standard Chinese

Purpose The primary purpose of this study was to explore the audiovisual speech perception strategies.80.23.47 adopted by normal-hearing and deaf people in processing familiar and unfamiliar languages. Our primary hypothesis was that they would adopt different perception strategies due to different sensory experiences at an early age, limitations of the physical device, and the developmental gap of language, and others. Method Thirty normal-hearing adults and 33 prelingually deaf adults participated in the study. They were asked to perform judgment and listening tasks while watching videos of a Uygur–Mandarin bilingual speaker in a familiar language (Standard Chinese) or an unfamiliar language (Modern Uygur) while their eye movements were recorded by eye-tracking technology. Results Task had a slight influence on the distribution of selective attention, whereas subject and language had significant influences. To be specific, the normal-hearing and the d10eaf participants mainly gazed at the speaker's eyes and mouth, respectively, in the experiment; moreover, while the normal-hearing participants had to stare longer at the speaker's mouth when they confronted with the unfamiliar language Modern Uygur, the deaf participant did not change their attention allocation pattern when perceiving the two languages. Conclusions Normal-hearing and deaf adults adopt different audiovisual speech perception strategies: Normal-hearing adults mainly look at the eyes, and deaf adults mainly look at the mouth. Additionally, language and task can also modulate the speech perception strategy.

Download Full-text

Surgical management of extracranial carotid artery aneurysms

VASA ◽

10.1024/0301-1526/a000528 ◽

2016 ◽

Vol 45 (3) ◽

pp. 223-228 ◽

Cited By ~ 2

Author(s):

Jan Paweł Skóra ◽

Jacek Kurcz ◽

Krzysztof Korta ◽

Przemysław Szyber ◽

Tadeusz Andrzej Dorobisz ◽

...

Keyword(s):

Carotid Artery ◽

Surgical Management ◽

Minor Stroke ◽

Stroke Rate ◽

Extracranial Carotid Artery ◽

Long Term Follow Up ◽

End To End ◽

Dacron Patch ◽

Major Stroke

Abstract. Background: We present the methods and results of the surgical management of extracranial carotid artery aneurysms (ECCA). Postoperative complications including early and late neurological events were analysed. Correlation between reconstruction techniques and morphology of ECCA was assessed in this retrospective study. Patients and methods: In total, 32 reconstructions of ECCA were performed in 31 symptomatic patients with a mean age of 59.2 (range 33 - 84) years. The causes of ECCA were divided among atherosclerosis (n = 25; 78.1 %), previous carotid endarterectomy with Dacron patch (n = 4; 12.5 %), iatrogenic injury (n = 2; 6.3 %) and infection (n = 1; 3.1 %). In 23 cases, intervention consisted of carotid bypass. Aneurysmectomy with end-to-end suture was performed in 4 cases. Aneurysmal resection with patching was done in 2 cases and aneurysmorrhaphy without patching in another 2 cases. In 1 case, ligature of the internal carotid artery (ICA) was required. Results: Technical success defined as the preservation of ICA patency was achieved in 31 cases (96.9 %). There was one perioperative death due to major stroke (3.1 %). Two cases of minor stroke occurred in the 30-day observation period (6.3 %). Three patients had a transient hypoglossal nerve palsy that subsided spontaneously (9.4 %). At a mean long-term follow-up of 68 months, there were no major or minor ipsilateral strokes or surgery-related deaths reported. In all 30 surviving patients (96.9 %), long-term clinical outcomes were free from ipsilateral neurological symptoms. Conclusions: Open surgery is a relatively safe method in the therapy of ECCA. Surgical repair of ECCAs can be associated with an acceptable major stroke rate and moderate minor stroke rate. Complication-free long-term outcomes can be achieved in as many as 96.9 % of patients. Aneurysmectomy with end-to-end anastomosis or bypass surgery can be implemented during open repair of ECCA.

Download Full-text

Activation and Persistence of Implicit Causality Information in Spoken Language Comprehension

Experimental Psychology (formerly Zeitschrift für Experimentelle Psychologie) ◽

10.1027/1618-3169/a000002 ◽

2010 ◽

Vol 57 (1) ◽

pp. 5-16 ◽

Cited By ~ 46

Author(s):

Pirita Pyykkönen ◽

Juhani Järvikivi

Keyword(s):

Eye Tracking ◽

Language Comprehension ◽

Spoken Language ◽

Visual World ◽

Implicit Causality ◽

Causality Information ◽

Spoken Language Comprehension

A visual world eye-tracking study investigated the activation and persistence of implicit causality information in spoken language comprehension. We showed that people infer the implicit causality of verbs as soon as they encounter such verbs in discourse, as is predicted by proponents of the immediate focusing account ( Greene & McKoon, 1995 ; Koornneef & Van Berkum, 2006 ; Van Berkum, Koornneef, Otten, & Nieuwland, 2007 ). Interestingly, we observed activation of implicit causality information even before people encountered the causal conjunction. However, while implicit causality information was persistent as the discourse unfolded, it did not have a privileged role as a focusing cue immediately at the ambiguous pronoun when people were resolving its antecedent. Instead, our study indicated that implicit causality does not affect all referents to the same extent, rather it interacts with other cues in the discourse, especially when one of the referents is already prominently in focus.

Download Full-text