Face detection in complex visual displays: An eye-tracking study with 3- and 6-month-old infants and adults

When a driver doesn’t get proper rest, they fall asleep while driving and this leads to fatal accidents. This particular issue demands a solution in the form of a system that is capable of detecting drowsiness and to take necessary actions to avoid accidents.The detection is achieved with three main steps, it begins with face detection and facial feature detection using the famous Viola Jones algorithm followed by eye tracking. By the use of correlation coefficient template matching, the eyes are tracked. Whether the driver is awake or asleep is identified by matching the extracted eye image with the externally fed template (open eyes and closed eyes) based on eyes opening and eyes closing, blinking is recognized. If the driver falling asleep state remains above a specific time (the threshold time) the vehicles stops and an alarm is activated by the use of a specific microcontroller, in this prototype an Arduino is used.

Download Full-text

Class Insight: A Student Monitoring System with Real-time Updates using Face Detection and Eye Tracking

2021 IEEE World AI IoT Congress (AIIoT) ◽

10.1109/aiiot52608.2021.9454176 ◽

2021 ◽

Author(s):

HM Tamim ◽

Fahema Sultana ◽

Nazifa Tasneem ◽

Yakut Marzan ◽

Mohammad Monirujjaman Khan

Keyword(s):

Eye Tracking ◽

Real Time ◽

Monitoring System ◽

Face Detection

Download Full-text

An Eye-Tracking Study on Audiovisual Speech Perception Strategies Adopted by Normal-Hearing and Deaf Adults Under Different Language Familiarities

Journal of Speech Language and Hearing Research ◽

10.1044/2020_jslhr-19-00223 ◽

2020 ◽

Vol 63 (7) ◽

pp. 2245-2254 ◽

Cited By ~ 1

Author(s):

Jianrong Wang ◽

Yumeng Zhu ◽

Yu Chen ◽

Abdilbar Mamat ◽

Mei Yu ◽

...

Keyword(s):

Speech Perception ◽

Eye Tracking ◽

Normal Hearing ◽

Audiovisual Speech ◽

Audiovisual Speech Perception ◽

Allocation Pattern ◽

Deaf Adults ◽

Bilingual Speaker ◽

Primary Hypothesis ◽

Standard Chinese

Purpose The primary purpose of this study was to explore the audiovisual speech perception strategies.80.23.47 adopted by normal-hearing and deaf people in processing familiar and unfamiliar languages. Our primary hypothesis was that they would adopt different perception strategies due to different sensory experiences at an early age, limitations of the physical device, and the developmental gap of language, and others. Method Thirty normal-hearing adults and 33 prelingually deaf adults participated in the study. They were asked to perform judgment and listening tasks while watching videos of a Uygur–Mandarin bilingual speaker in a familiar language (Standard Chinese) or an unfamiliar language (Modern Uygur) while their eye movements were recorded by eye-tracking technology. Results Task had a slight influence on the distribution of selective attention, whereas subject and language had significant influences. To be specific, the normal-hearing and the d10eaf participants mainly gazed at the speaker's eyes and mouth, respectively, in the experiment; moreover, while the normal-hearing participants had to stare longer at the speaker's mouth when they confronted with the unfamiliar language Modern Uygur, the deaf participant did not change their attention allocation pattern when perceiving the two languages. Conclusions Normal-hearing and deaf adults adopt different audiovisual speech perception strategies: Normal-hearing adults mainly look at the eyes, and deaf adults mainly look at the mouth. Additionally, language and task can also modulate the speech perception strategy.

Download Full-text

The Use of Real-Time Visual Displays of Speech in the Training of a Profoundly Deaf, Nonspeaking Child: A Case Report

Journal of Speech and Hearing Disorders ◽

10.1044/jshd.3603.397 ◽

1971 ◽

Vol 36 (3) ◽

pp. 397-409 ◽

Cited By ~ 10

Author(s):

Rachel E. Stark

Keyword(s):

Case Report ◽

Real Time ◽

Speech Production ◽

Behavior Problem ◽

Deaf Children ◽

Developmental Sequence ◽

Visual Displays ◽

Individual Instruction ◽

Academic Record ◽

Extract Information

Real-time amplitude contour and spectral displays were used in teaching speech production skills to a profoundly deaf, nonspeaking boy. This child had a visual attention problem, a behavior problem, and a poor academic record. In individual instruction, he was first taught to produce features of speech, for example, friction, nasal, and stop, which are present in vocalizations of 6- to 9-month-old infants, and then to combine these features in syllables and words. He made progress in speech, although sign language and finger spelling were taught at the same time. Speech production skills were retained after instruction was terminated. The results suggest that deaf children are able to extract information about the features of speech from visual displays, and that a developmental sequence should be followed as far as possible in teaching speech production skills to them.

Download Full-text

Activation and Persistence of Implicit Causality Information in Spoken Language Comprehension

Experimental Psychology (formerly Zeitschrift für Experimentelle Psychologie) ◽

10.1027/1618-3169/a000002 ◽

2010 ◽

Vol 57 (1) ◽

pp. 5-16 ◽

Cited By ~ 46

Author(s):

Pirita Pyykkönen ◽

Juhani Järvikivi

Keyword(s):

Eye Tracking ◽

Language Comprehension ◽

Spoken Language ◽

Visual World ◽

Implicit Causality ◽

Causality Information ◽

Spoken Language Comprehension

A visual world eye-tracking study investigated the activation and persistence of implicit causality information in spoken language comprehension. We showed that people infer the implicit causality of verbs as soon as they encounter such verbs in discourse, as is predicted by proponents of the immediate focusing account ( Greene & McKoon, 1995 ; Koornneef & Van Berkum, 2006 ; Van Berkum, Koornneef, Otten, & Nieuwland, 2007 ). Interestingly, we observed activation of implicit causality information even before people encountered the causal conjunction. However, while implicit causality information was persistent as the discourse unfolded, it did not have a privileged role as a focusing cue immediately at the ambiguous pronoun when people were resolving its antecedent. Instead, our study indicated that implicit causality does not affect all referents to the same extent, rather it interacts with other cues in the discourse, especially when one of the referents is already prominently in focus.

Download Full-text