A fast and robust 3D head pose and gaze estimation system

2006 ◽  
Author(s):  
Koichi Kinoshita ◽  
Yong Ma ◽  
Shihong Lao ◽  
Masato Kawaade
Keyword(s):  
Gaze Estimation ◽  
Head Pose ◽  
Estimation System

scholarly journals Real-time gaze estimation via pupil center tracking

2018 ◽  
Vol 9 (1) ◽  
pp. 6-18 ◽  
Author(s):  
Dario Cazzato ◽  
Fabio Dominio ◽  
Roberto Manduchi ◽  
Silvia M. Castro
Keyword(s):  
Real Time ◽  
Learning Algorithm ◽  
Natural Environments ◽  
Gaze Estimation ◽  
Head Pose ◽  
Data Set ◽  
Gaze Tracking ◽  
Illumination Changes ◽  
Wide Range ◽  
Estimation System

Abstract Automatic gaze estimation not based on commercial and expensive eye tracking hardware solutions can enable several applications in the fields of human computer interaction (HCI) and human behavior analysis. It is therefore not surprising that several related techniques and methods have been investigated in recent years. However, very few camera-based systems proposed in the literature are both real-time and robust. In this work, we propose a real-time user-calibration-free gaze estimation system that does not need person-dependent calibration, can deal with illumination changes and head pose variations, and can work with a wide range of distances from the camera. Our solution is based on a 3-D appearance-based method that processes the images from a built-in laptop camera. Real-time performance is obtained by combining head pose information with geometrical eye features to train a machine learning algorithm. Our method has been validated on a data set of images of users in natural environments, and shows promising results. The possibility of a real-time implementation, combined with the good quality of gaze tracking, make this system suitable for various HCI applications.

scholarly journals Continuous Driver’s Gaze Zone Estimation Using RGB-D Camera

Sensors ◽  
2019 ◽  
Vol 19 (6) ◽  
pp. 1287 ◽  
Author(s):  
Yafei Wang ◽  
Guoliang Yuan ◽  
Zetian Mi ◽  
Jinjia Peng ◽  
Xueyan Ding ◽  
...  
Keyword(s):  
Real World ◽  
Estimation Method ◽  
Feature Space ◽  
Image Feature ◽  
Gaze Estimation ◽  
Head Pose ◽  
Pose Tracking ◽  
Angle Space ◽  
Long Time ◽  
Estimation System

The driver gaze zone is an indicator of a driver’s attention and plays an important role in the driver’s activity monitoring. Due to the bad initialization of point-cloud transformation, gaze zone systems using RGB-D cameras and ICP (Iterative Closet Points) algorithm do not work well under long-time head motion. In this work, a solution for a continuous driver gaze zone estimation system in real-world driving situations is proposed, combining multi-zone ICP-based head pose tracking and appearance-based gaze estimation. To initiate and update the coarse transformation of ICP, a particle filter with auxiliary sampling is employed for head state tracking, which accelerates the iterative convergence of ICP. Multiple templates for different gaze zone are applied to balance the templates revision of ICP under large head movement. For the RGB information, an appearance-based gaze estimation method with two-stage neighbor selection is utilized, which treats the gaze prediction as the combination of neighbor query (in head pose and eye image feature space) and linear regression (between eye image feature space and gaze angle space). The experimental results show that the proposed method outperforms the baseline methods on gaze estimation, and can provide a stable head pose tracking for driver behavior analysis in real-world driving scenarios.

scholarly journals Head pose‐free gaze estimation using domain adaptation

2021 ◽  
Author(s):  
Byungtae Ahn ◽  
Minseok Seo ◽  
Dong‐Geol Choi
Keyword(s):  
Domain Adaptation ◽  
Gaze Estimation ◽  
Head Pose

scholarly journals A New Gaze Estimation Method Based on Homography Transformation Derived from Geometric Relationship

2020 ◽  
Vol 10 (24) ◽  
pp. 9079
Author(s):  
Kaiqing Luo ◽  
Xuan Jia ◽  
Hua Xiao ◽  
Dongmei Liu ◽  
Li Peng ◽  
...  
Keyword(s):  
Estimation Method ◽  
Gaze Estimation ◽  
Estimation Model ◽  
Experimental Accuracy ◽  
Unknown Parameters ◽  
The Gaze ◽  
Marquardt Algorithm ◽  
Mapping Equation ◽  
Estimation System ◽  
Homography Transformation

In recent years, the gaze estimation system, as a new type of human-computer interaction technology, has received extensive attention. The gaze estimation model is one of the main research contents of the system. The quality of the model will directly affect the accuracy of the entire gaze estimation system. To achieve higher accuracy even with simple devices, this paper proposes an improved mapping equation model based on homography transformation. In the process of experiment, the model mainly uses the “Zhang Zhengyou calibration method” to obtain the internal and external parameters of the camera to correct the distortion of the camera, and uses the LM(Levenberg-Marquardt) algorithm to solve the unknown parameters contained in the mapping equation. After all the parameters of the equation are determined, the gaze point is calculated. Different comparative experiments are designed to verify the experimental accuracy and fitting effect of this mapping equation. The results show that the method can achieve high experimental accuracy, and the basic accuracy is kept within 0.6∘. The overall trend shows that the mapping method based on homography transformation has higher experimental accuracy, better fitting effect and stronger stability.

Sign in / Sign up

Export Citation Format

Share Document