The application of image processing for Human-Computer Interface (HCI) using the Eye

Abstract The field of Human-Computer Interaction (HCI) has been developing tremendously since the past decade. The existence of smartphones or modern computers is already a norm in society these days which utilizes touch, voice and typing as a means for input. To further increase the variety of interaction, human eyes are set to be a good candidate for another form of HCI. The amount of information which the human eyes contain are extremely useful, hence, various methods and algorithm for eye gaze tracking are implemented in multiple sectors. However, some eye-tracking method requires infrared rays to be projected into the eye of the user which could potentially cause enzyme denaturation when the eye is subjected to those rays under extreme exposure. Therefore, to avoid potential harm from the eye-tracking method that utilizes infrared rays, this paper proposes an image-based eye tracking system using the Viola-Jones algorithm and Circular Hough Transform (CHT) algorithm. The proposed method uses visible light instead of infrared rays to control the mouse pointer using the eye gaze of the user. This research aims to implement the proposed algorithm for people with hand disability to interact with computers using their eye gaze.

Download Full-text

The stability of the MEMS 2D mirror's operating point in terms of eye tracking systems

Photonics Letters of Poland ◽

10.4302/plp.v12i2.1016 ◽

2020 ◽

Vol 12 (2) ◽

pp. 43

Author(s):

Mateusz Pomianek ◽

Marek Piszczek ◽

Marcin Maciejewski ◽

Piotr Krukowski

Keyword(s):

Eye Tracking ◽

Laser Scanning ◽

Tracking System ◽

Eye Gaze ◽

Main Element ◽

Head Tracking ◽

Tracking Systems ◽

Gaze Tracking ◽

Pupil Detection ◽

The Stability

This paper describes research on the stability of the MEMS mirror for use in eye tracking systems. MEMS mirrors are the main element in scanning methods (which is one of the methods of eye tracking). Due to changes in the mirror pitch, the system can scan the area of the eye with a laser and collect the signal reflected. However, this method works on the assumption that the inclinations are constant in each period. The instability of this causes errors. The aim of this work is to examine the error level caused by pitch instability at different points of work. Full Text: PDF ReferencesW. Fuhl, M. Tonsen, A. Bulling, and E. Kasneci, "Pupil detection for head-mounted eye tracking in the wild: an evaluation of the state of the art," Mach. Vis. Appl., vol. 27, no. 8, pp. 1275-1288, 2016, CrossRef X. Wang, S. Koch, K. Holmqvist, and M. Alexa, "Tracking the gaze on objects in 3D," ACM Trans. Graph., vol. 37, no. 6, pp. 1-18, Dec. 2018 CrossRef X. Xiong and H. Xie, "MEMS dual-mode electrostatically actuated micromirror," Proc. 2014 Zo. 1 Conf. Am. Soc. Eng. Educ. - "Engineering Educ. Ind. Involv. Interdiscip. Trends", ASEE Zo. 1 2014, no. Dmd, 2014 CrossRef E. Pengwang, K. Rabenorosoa, M. Rakotondrabe, and N. Andreff, "Scanning micromirror platform based on MEMS technology for medical application," Micromachines, vol. 7, no. 2, 2016 CrossRef J. P. Giannini, A. G. York, and H. Shroff, "Anticipating, measuring, and minimizing MEMS mirror scan error to improve laser scanning microscopy's speed and accuracy," PLoS One, vol. 12, no. 10, pp. 1-14, 2017 CrossRef C. Hennessey, B. Noureddin, and P. Lawrence, "A single camera eye-gaze tracking system with free head motion," Eye Track. Res. Appl. Symp., vol. 2005, no. March, pp. 87-94, 2005 CrossRef C. H. Morimoto and M. R. M. Mimica, "Eye gaze tracking techniques for interactive applications," Comput. Vis. Image Underst., vol. 98, no. 1, pp. 4-24, Apr. 2005 CrossRef S. T. S. Holmström, U. Baran, and H. Urey, "MEMS laser scanners: A review," J. Microelectromechanical Syst., vol. 23, no. 2, pp. 259-275, 2014 CrossRef C. W. Cho, "Gaze Detection by Wearable Eye-Tracking and NIR LED-Based Head-Tracking Device Based on SVR," ETRI J., vol. 34, no. 4, pp. 542-552, Aug. 2012 CrossRef T. Santini, W. Fuhl, and E. Kasneci, "PuRe: Robust pupil detection for real-time pervasive eye tracking," Comput. Vis. Image Underst., vol. 170, pp. 40-50, May 2018 CrossRef O. Solgaard, A. A. Godil, R. T. Howe, L. P. Lee, Y. A. Peter, and H. Zappe, "Optical MEMS: From micromirrors to complex systems," J. Microelectromechanical Syst., vol. 23, no. 3, pp. 517-538, 2014 CrossRef J. Wang, G. Zhang, and Z. You, "UKF-based MEMS micromirror angle estimation for LiDAR," J. Micromechanics Microengineering, vol. 29, no. 3, 201 CrossRef

Download Full-text

A Review on Eye Tracking Technology

Interdisciplinary Approaches to Altering Neurodevelopmental Disorders - Advances in Medical Diagnosis, Treatment, and Care ◽

10.4018/978-1-7998-3069-6.ch007 ◽

2020 ◽

pp. 107-130

Author(s):

Pavneet Bhatia ◽

Arun Khosla ◽

Gajendra Singh

Keyword(s):

Computer Vision ◽

Eye Tracking ◽

Assistive Technology ◽

Tracking System ◽

Eye Gaze ◽

Emerging Technology ◽

Gaze Tracking ◽

Safety Research ◽

Computer Vision Technology ◽

Tracking Technology

In past few decades, eye tracking has evolved as an emerging technology with wide areas of applications in gaming, human-computer interaction, business research, assistive technology, automatic safety research, and many more. Eye-gaze tracking is a provocative idea in computer-vision technology. This chapter includes the recent researches, expansion, and development in the technology, techniques, and its wide-ranging applications. It gives a detailed background of technology with all the efforts done in the direction to improve the tracking system.

Download Full-text

The Research on Eye Tracking for Gaze Tracking System

ACTA AUTOMATICA SINICA ◽

10.3724/sp.j.1004.2010.01051 ◽

2010 ◽

Vol 36 (8) ◽

pp. 1051-1061 ◽

Cited By ~ 6

Author(s):

Chuang ZHANG ◽

Jian-Nan CHI ◽

Zhao-Hui ZHANG ◽

Zhi-Liang WANG

Keyword(s):

Eye Tracking ◽

Tracking System ◽

Gaze Tracking

Download Full-text

Tracking eye-gaze in smart home systems (SHS): first insights from eye-tracking and self-report measures

Journal of Ambient Intelligence and Humanized Computing ◽

10.1007/s12652-021-03134-8 ◽

2021 ◽

Author(s):

Federico Cassioli ◽

Laura Angioletti ◽

Michela Balconi

Keyword(s):

Eye Tracking ◽

Personality Traits ◽

Smart Home ◽

Near Infrared ◽

Tracking System ◽

Eye Gaze ◽

Self Report ◽

Visual Exploration ◽

Living Room ◽

Psychological Traits

AbstractHuman–computer interaction (HCI) is particularly interesting because full-immersive technology may be approached differently by users, depending on the complexity of the interaction, users’ personality traits, and their motivational systems inclination. Therefore, this study investigated the relationship between psychological factors and attention towards specific tech-interactions in a smart home system (SHS). The relation between personal psychological traits and eye-tracking metrics is investigated through self-report measures [locus of control (LoC), user experience (UX), behavioral inhibition system (BIS) and behavioral activation system (BAS)] and a wearable and wireless near-infrared illumination based eye-tracking system applied to an Italian sample (n = 19). Participants were asked to activate and interact with five different tech-interaction areas with different levels of complexity (entrance, kitchen, living room, bathroom, and bedroom) in a smart home system (SHS), while their eye-gaze behavior was recorded. Data showed significant differences between a simpler interaction (entrance) and a more complex one (living room), in terms of number of fixation. Moreover, slower time to first fixation in a multifaceted interaction (bathroom), compared to simpler ones (kitchen and living room) was found. Additionally, in two interaction conditions (living room and bathroom), negative correlations were found between external LoC and fixation count, and between BAS reward responsiveness scores and fixation duration. Findings led to the identification of a two-way process, where both the complexity of the tech-interaction and subjects’ personality traits are important impacting factors on the user’s visual exploration behavior. This research contributes to understand the user responsiveness adding first insights that may help to create more human-centered technology.

Download Full-text