scholarly journals Continuous Driver’s Gaze Zone Estimation Using RGB-D Camera

Sensors ◽  
2019 ◽  
Vol 19 (6) ◽  
pp. 1287 ◽  
Author(s):  
Yafei Wang ◽  
Guoliang Yuan ◽  
Zetian Mi ◽  
Jinjia Peng ◽  
Xueyan Ding ◽  
...  
Keyword(s):  
Real World ◽  
Estimation Method ◽  
Feature Space ◽  
Image Feature ◽  
Gaze Estimation ◽  
Head Pose ◽  
Pose Tracking ◽  
Angle Space ◽  
Long Time ◽  
Estimation System

The driver gaze zone is an indicator of a driver’s attention and plays an important role in the driver’s activity monitoring. Due to the bad initialization of point-cloud transformation, gaze zone systems using RGB-D cameras and ICP (Iterative Closet Points) algorithm do not work well under long-time head motion. In this work, a solution for a continuous driver gaze zone estimation system in real-world driving situations is proposed, combining multi-zone ICP-based head pose tracking and appearance-based gaze estimation. To initiate and update the coarse transformation of ICP, a particle filter with auxiliary sampling is employed for head state tracking, which accelerates the iterative convergence of ICP. Multiple templates for different gaze zone are applied to balance the templates revision of ICP under large head movement. For the RGB information, an appearance-based gaze estimation method with two-stage neighbor selection is utilized, which treats the gaze prediction as the combination of neighbor query (in head pose and eye image feature space) and linear regression (between eye image feature space and gaze angle space). The experimental results show that the proposed method outperforms the baseline methods on gaze estimation, and can provide a stable head pose tracking for driver behavior analysis in real-world driving scenarios.

scholarly journals Real-time gaze estimation via pupil center tracking

2018 ◽  
Vol 9 (1) ◽  
pp. 6-18 ◽  
Author(s):  
Dario Cazzato ◽  
Fabio Dominio ◽  
Roberto Manduchi ◽  
Silvia M. Castro
Keyword(s):  
Real Time ◽  
Learning Algorithm ◽  
Natural Environments ◽  
Gaze Estimation ◽  
Head Pose ◽  
Data Set ◽  
Gaze Tracking ◽  
Illumination Changes ◽  
Wide Range ◽  
Estimation System

Abstract Automatic gaze estimation not based on commercial and expensive eye tracking hardware solutions can enable several applications in the fields of human computer interaction (HCI) and human behavior analysis. It is therefore not surprising that several related techniques and methods have been investigated in recent years. However, very few camera-based systems proposed in the literature are both real-time and robust. In this work, we propose a real-time user-calibration-free gaze estimation system that does not need person-dependent calibration, can deal with illumination changes and head pose variations, and can work with a wide range of distances from the camera. Our solution is based on a 3-D appearance-based method that processes the images from a built-in laptop camera. Real-time performance is obtained by combining head pose information with geometrical eye features to train a machine learning algorithm. Our method has been validated on a data set of images of users in natural environments, and shows promising results. The possibility of a real-time implementation, combined with the good quality of gaze tracking, make this system suitable for various HCI applications.

scholarly journals A New Gaze Estimation Method Based on Homography Transformation Derived from Geometric Relationship

2020 ◽  
Vol 10 (24) ◽  
pp. 9079
Author(s):  
Kaiqing Luo ◽  
Xuan Jia ◽  
Hua Xiao ◽  
Dongmei Liu ◽  
Li Peng ◽  
...  
Keyword(s):  
Estimation Method ◽  
Gaze Estimation ◽  
Estimation Model ◽  
Experimental Accuracy ◽  
Unknown Parameters ◽  
The Gaze ◽  
Marquardt Algorithm ◽  
Mapping Equation ◽  
Estimation System ◽  
Homography Transformation

In recent years, the gaze estimation system, as a new type of human-computer interaction technology, has received extensive attention. The gaze estimation model is one of the main research contents of the system. The quality of the model will directly affect the accuracy of the entire gaze estimation system. To achieve higher accuracy even with simple devices, this paper proposes an improved mapping equation model based on homography transformation. In the process of experiment, the model mainly uses the “Zhang Zhengyou calibration method” to obtain the internal and external parameters of the camera to correct the distortion of the camera, and uses the LM(Levenberg-Marquardt) algorithm to solve the unknown parameters contained in the mapping equation. After all the parameters of the equation are determined, the gaze point is calculated. Different comparative experiments are designed to verify the experimental accuracy and fitting effect of this mapping equation. The results show that the method can achieve high experimental accuracy, and the basic accuracy is kept within 0.6∘. The overall trend shows that the mapping method based on homography transformation has higher experimental accuracy, better fitting effect and stronger stability.

scholarly journals Gaze Estimation Method Using Analysis of Electrooculogram Signals and Kinect Sensor

2017 ◽  
Vol 2017 ◽  
pp. 1-10 ◽  
Author(s):  
Keiko Sakurai ◽  
Mingmin Yan ◽  
Koichi Tanno ◽  
Hiroki Tamura
Keyword(s):  
Eye Movements ◽  
Eye Tracking ◽  
Estimation Method ◽  
Gaze Estimation ◽  
Strongly Correlated ◽  
Kinect Sensor ◽  
Tracking Method ◽  
Estimation System ◽  
Communication Methods ◽  
Very High

A gaze estimation system is one of the communication methods for severely disabled people who cannot perform gestures and speech. We previously developed an eye tracking method using a compact and light electrooculogram (EOG) signal, but its accuracy is not very high. In the present study, we conducted experiments to investigate the EOG component strongly correlated with the change of eye movements. The experiments in this study are of two types: experiments to see objects only by eye movements and experiments to see objects by face and eye movements. The experimental results show the possibility of an eye tracking method using EOG signals and a Kinect sensor.

scholarly journals Estimation Method for Roof‐damaged Buildings from Aero-Photo Images During Earthquakes Using Deep Learning

2021 ◽  
Author(s):  
Shono Fujita ◽  
Michinori Hatayama
Keyword(s):  
Information System ◽  
Deep Learning ◽  
Geographic Information System ◽  
Estimation Method ◽  
Image Data ◽  
Location Information ◽  
Long Time ◽  
Estimation System ◽  
The Government ◽  
Real Earthquake

AbstractIssuing a disaster certificate, which is used to decide the contents of a victim’s support, requires accuracy and rapidity. However, in Japan at large, issuing of damage certificates has taken a long time in past earthquake disasters. Hence, the government needs a more efficient mechanism for issuing damage certificates. This study developed an estimation system of roof-damaged buildings to obtain an overview of earthquake damage based on aero-photo images using deep learning. To provide speedy estimation, this system utilized the trimming algorithm, which automatically generates roof image data using the location information of building polygons on GIS (Geographic Information System). Consequently, the proposed system can estimate, if a house is covered with a blue sheet with 97.57 % accuracy and also detect whether a house is damaged, with 93.51 % accuracy. It would therefore be worth considering the development of an image recognition model and a method of collecting aero-photo data to operate this system during a real earthquake.

scholarly journals Comparative Analysis of Kinect-Based and Oculus-Based Gaze Region Estimation Methods in a Driving Simulator

Sensors ◽  
2020 ◽  
Vol 21 (1) ◽  
pp. 26
Author(s):  
David González-Ortega ◽  
Francisco Javier Díaz-Pernas ◽  
Mario Martínez-Zarzuela ◽  
Míriam Antón-Rodríguez
Keyword(s):  
Virtual Reality ◽  
Comparative Analysis ◽  
Driving Simulator ◽  
Estimation Method ◽  
Estimation Methods ◽  
Gaze Estimation ◽  
Driving Simulators ◽  
Oculus Rift ◽  
Gaze Patterns ◽  
And Performance

Driver’s gaze information can be crucial in driving research because of its relation to driver attention. Particularly, the inclusion of gaze data in driving simulators broadens the scope of research studies as they can relate drivers’ gaze patterns to their features and performance. In this paper, we present two gaze region estimation modules integrated in a driving simulator. One uses the 3D Kinect device and another uses the virtual reality Oculus Rift device. The modules are able to detect the region, out of seven in which the driving scene was divided, where a driver is gazing at in every route processed frame. Four methods were implemented and compared for gaze estimation, which learn the relation between gaze displacement and head movement. Two are simpler and based on points that try to capture this relation and two are based on classifiers such as MLP and SVM. Experiments were carried out with 12 users that drove on the same scenario twice, each one with a different visualization display, first with a big screen and later with Oculus Rift. On the whole, Oculus Rift outperformed Kinect as the best hardware for gaze estimation. The Oculus-based gaze region estimation method with the highest performance achieved an accuracy of 97.94%. The information provided by the Oculus Rift module enriches the driving simulator data and makes it possible a multimodal driving performance analysis apart from the immersion and realism obtained with the virtual reality experience provided by Oculus.

Gaze estimation method based on an aspherical model of the cornea

2010 ◽  
Author(s):  
Takashi Nagamatsu ◽  
Yukina Iwamoto ◽  
Junzo Kamahara ◽  
Naoki Tanaka ◽  
Michiya Yamamoto
Keyword(s):  
Estimation Method ◽  
Gaze Estimation

scholarly journals Research on a novel data-driven aging estimation method for battery systems in real-world electric vehicles

2021 ◽  
Vol 13 (7) ◽  
pp. 168781402110277
Author(s):  
Yankai Hou ◽  
Zhaosheng Zhang ◽  
Peng Liu ◽  
Chunbao Song ◽  
Zhenpo Wang
Keyword(s):  
Electric Vehicles ◽  
Real World ◽  
Regression Models ◽  
Estimation Method ◽  
Recursive Least Squares ◽  
Data Driven ◽  
Accurate Estimation ◽  
Support Vector ◽  
Battery Degradation ◽  
Operational Data

Accurate estimation of the degree of battery aging is essential to ensure safe operation of electric vehicles. In this paper, using real-world vehicles and their operational data, a battery aging estimation method is proposed based on a dual-polarization equivalent circuit (DPEC) model and multiple data-driven models. The DPEC model and the forgetting factor recursive least-squares method are used to determine the battery system’s ohmic internal resistance, with outliers being filtered using boxplots. Furthermore, eight common data-driven models are used to describe the relationship between battery degradation and the factors influencing this degradation, and these models are analyzed and compared in terms of both estimation accuracy and computational requirements. The results show that the gradient descent tree regression, XGBoost regression, and light GBM regression models are more accurate than the other methods, with root mean square errors of less than 6.9 mΩ. The AdaBoost and random forest regression models are regarded as alternative groups because of their relative instability. The linear regression, support vector machine regression, and k-nearest neighbor regression models are not recommended because of poor accuracy or excessively high computational requirements. This work can serve as a reference for subsequent battery degradation studies based on real-time operational data.

Sign in / Sign up

Export Citation Format

Share Document