scholarly journals Investigating the Use of Eye Fixation Data for Emotion Classification in VR

2021 ◽  
Vol 12 (3) ◽  
pp. 1852-1857
Author(s):  
Lim Jia Zheng Et.al
Keyword(s):  
Eye Tracking ◽  
Classification Accuracy ◽  
Preliminary Investigation ◽  
Support Vector ◽  
Tracking Data ◽  
Eye Tracker ◽  
Emotion Classification ◽  
Learning Classifier ◽  
Rbf Kernel ◽  
Tracking Technology

Eye-tracking technology has become popular recently and widely used in research on emotion recognition since its usability. In this paper, we presented a preliminary investigation on a novelty approach for detecting emotions using eye-tracking data in virtual reality (VR) to classify 4-quadrant of emotions according to russell’scircumplex model of affects. A presentation of 3600 videos is used as the experiment stimuli to evoke the emotions of the user in VR. An add-on eye-tracker within the VR headset is used for the recording and collecting device of eye-tracking data. Fixation data is extracted and chosen as the eye feature used in this investigation. The machine learning classifier is support vector machine (SVM) with radial basis function (RBF) kernel. The best classification accuracy achieved is 69.23%. The findings showed that emotion classification using fixation data has promising results in the prediction accuracy from a four-class random classification.

scholarly journals Exploring Pupil Position as An Eye-Tracking Feature for Four-Class Emotion Classification In VR

2021 ◽  
Vol 2129 (1) ◽  
pp. 012069
Author(s):  
Jia Zheng Lim ◽  
James Mountstephens ◽  
Jason Teo
Keyword(s):  
Eye Tracking ◽  
Learning Algorithm ◽  
Preliminary Investigation ◽  
Support Vector ◽  
Machine Learning Algorithm ◽  
Eye Tracker ◽  
Emotion Classification ◽  
Novel Approach ◽  
Four Quadrant ◽  
Stimulation Of

Abstract This paper presented a preliminary investigation of a novel approach on emotion recognition using pupil position in Virtual Reality (VR). We explore pupil position as an eye-tracking feature for four-class emotion classification according to the four-quadrant model of emotions via a presentation of 360° videos in VR. A total of ten subjects participated in this emotional experiment. A 360° video with four sessions of stimulation of emotions will be presented in VR to evoke the user’s emotions. The eye data were recorded and collected using Pupil Labs eye-tracker and the emotion classification was done by using pupil position solely. The classifier used in this investigation is the Support Vector Machine (SVM) machine learning algorithm. The results showed that the best accuracy achieved from this four-class random classification was 59.19%.

scholarly journals The Power of Eye Tracking in Economics Experiments

2016 ◽  
Vol 106 (5) ◽  
pp. 309-313 ◽  
Author(s):  
Joanna N. Lahey ◽  
Douglas Oxley
Keyword(s):  
Economic Theory ◽  
Data Analysis ◽  
Eye Tracking ◽  
Data Management ◽  
Tracking Data ◽  
Eye Tracker ◽  
Hiring Decisions ◽  
Economics Experiments ◽  
Set Up ◽  
Tracking Technology

Eye tracking is a technology that tracks eye activity including how long and where a participant is looking. As eye tracking technology has improved and become more affordable its use has expanded. We discuss how to design, implement, and analyze an experiment using this technology to study economic theory. Using our experience fielding an experiment to study hiring decisions we guide the reader through how to choose an eye tracker, concerns with participants and set-up, types of outputs, limitations of eye tracking, data management and data analysis. We conclude with suggestions for combining eye tracking with other measurements.

scholarly journals Use of machine learning to identify autism with natural social gaze behavior (Preprint)

2021 ◽  
Author(s):  
Zhong Zhao ◽  
Haiming Tang ◽  
Xiaobin Zhang ◽  
Xingda Qu ◽  
Jianping Lu
Keyword(s):  
Machine Learning ◽  
Eye Tracking ◽  
Classification Accuracy ◽  
Autism Spectrum ◽  
Support Vector ◽  
Gaze Behavior ◽  
Linear Discriminant ◽  
Face To Face ◽  
Area Of Interest ◽  
Social Gaze

BACKGROUND Abnormal gaze behavior is a prominent feature of the autism spectrum disorder (ASD). Previous eye tracking studies had participants watch images (i.e., picture, video and webpage), and the application of machine learning (ML) on these data showed promising results in identify ASD individuals. Given the fact that gaze behavior differs in face-to-face interaction from image viewing tasks, no study has investigated whether natural social gaze behavior could accurately identify ASD. OBJECTIVE The objective of this study was to examine whether and what area of interest (AOI)-based features extracted from the natural social gaze behavior could identify ASD. METHODS Both children with ASD and typical development (TD) were eye-tracked when they were engaged in a face-to-face conversation with an interviewer. Four ML classifiers (support vector machine, SVM; linear discriminant analysis, LDA; decision tree, DT; and random forest, RF) were used to determine the maximum classification accuracy and the corresponding features. RESULTS A maximum classification accuracy of 84.62% were achieved with three classifiers (LDA, DT and RF). Results showed that the mouth, but not the eyes AOI, was a powerful feature in detecting ASD. CONCLUSIONS Natural gaze behavior could be leveraged to identify ASD, suggesting that ASD might be objectively screened with eye tracking technology in everyday social interaction. In addition, the comparison between our and previous findings suggests that eye tracking features that could identify ASD might be culture dependent and context sensitive.

scholarly journals An emotion classification method from electroencephalogram based on 1/f fluctuation theory

2020 ◽  
Vol 53 (5-6) ◽  
pp. 824-832
Author(s):  
Hao Li ◽  
Xia Mao ◽  
Lijiang Chen
Keyword(s):  
Real Time ◽  
Classification Accuracy ◽  
Support Vector Machine Classifier ◽  
Fluctuation Theory ◽  
Classification Method ◽  
Support Vector ◽  
Signal Acquisition ◽  
Emotion Classification ◽  
The Real ◽  
Time Performance

Electroencephalogram data are easily affected by artifacts, and a drift may occur during the signal acquisition process. At present, most research focuses on the automatic detection and elimination of artifacts in electrooculograms, electromyograms and electrocardiograms. However, electroencephalogram drift data, which affect the real-time performance, are mainly manually calibrated and abandoned. An emotion classification method based on 1/f fluctuation theory is proposed to classify electroencephalogram data without removing artifacts and drift data. The results show that the proposed method can still achieve a great classification accuracy of 75% in cases in which artifacts and drift data exist when using the support vector machine classifier. In addition, the real-time performance of the proposed method is guaranteed.

scholarly journals Eye-Tracking Analysis for Emotion Recognition

2020 ◽  
Vol 2020 ◽  
pp. 1-13
Author(s):  
Paweł Tarnowski ◽  
Marcin Kołodziej ◽  
Andrzej Majkowski ◽  
Remigiusz Jan Rak
Keyword(s):  
Support Vector Machine ◽  
Eye Movements ◽  
Eye Tracking ◽  
Emotion Recognition ◽  
Classification Accuracy ◽  
Pupil Diameter ◽  
Support Vector ◽  
Svm Classifier ◽  
High Arousal ◽  
Validation Method

This article reports the results of the study related to emotion recognition by using eye-tracking. Emotions were evoked by presenting a dynamic movie material in the form of 21 video fragments. Eye-tracking signals recorded from 30 participants were used to calculate 18 features associated with eye movements (fixations and saccades) and pupil diameter. To ensure that the features were related to emotions, we investigated the influence of luminance and the dynamics of the presented movies. Three classes of emotions were considered: high arousal and low valence, low arousal and moderate valence, and high arousal and high valence. A maximum of 80% classification accuracy was obtained using the support vector machine (SVM) classifier and leave-one-subject-out validation method.

scholarly journals Use of Eye-Tracking Technology by Medical Students Taking the Objective Structured Clinical Examination: Descriptive Study

10.2196/17719 ◽  
2020 ◽  
Vol 22 (8) ◽  
pp. e17719
Author(s):  
M D Grima-Murcia ◽  
Francisco Sanchez-Ferrer ◽  
Jose Manuel Ramos-Rincón ◽  
Eduardo Fernández
Keyword(s):  
Medical Students ◽  
Eye Tracking ◽  
Clinical Examination ◽  
Objective Evaluation ◽  
Objective Structured Clinical Examination ◽  
Eye Tracker ◽  
Clinical Competencies ◽  
Self Evaluation ◽  
Areas Of Interest ◽  
Tracking Technology

Background The objective structured clinical examination (OSCE) is a test used throughout Spain to evaluate the clinical competencies, decision making, problem solving, and other skills of sixth-year medical students. Objective The main goal of this study is to explore the possible applications and utility of portable eye-tracking systems in the setting of the OSCE, particularly questions associated with attention and engagement. Methods We used a portable Tobii Glasses 2 eye tracker, which allows real-time monitoring of where the students were looking and records the voice and ambient sounds. We then performed a qualitative and a quantitative analysis of the fields of vision and gaze points attracting attention as well as the visual itinerary. Results Eye-tracking technology was used in the OSCE with no major issues. This portable system was of the greatest value in the patient simulators and mannequin stations, where interaction with the simulated patient or areas of interest in the mannequin can be quantified. This technology proved useful to better identify the areas of interest in the medical images provided. Conclusions Portable eye trackers offer the opportunity to improve the objective evaluation of candidates and the self-evaluation of the stations used as well as medical simulations by examiners. We suggest that this technology has enough resolution to identify where a student is looking at and could be useful for developing new approaches for evaluating specific aspects of clinical competencies.

scholarly journals Algorithms for the automated correction of vertical drift in eye-tracking data

2021 ◽  
Author(s):  
Jon W. Carr ◽  
Valentina N. Pescuma ◽  
Michele Furlan ◽  
Maria Ktori ◽  
Davide Crepaldi
Keyword(s):  
Eye Tracking ◽  
Vertical Axis ◽  
Great Promise ◽  
Tracking Data ◽  
Eye Tracker ◽  
Algorithm Selection ◽  
Vertical Drift ◽  
Gradual Loss ◽  
Adjacent Line ◽  
Dynamic Time

AbstractA common problem in eye-tracking research is vertical drift—the progressive displacement of fixation registrations on the vertical axis that results from a gradual loss of eye-tracker calibration over time. This is particularly problematic in experiments that involve the reading of multiline passages, where it is critical that fixations on one line are not erroneously recorded on an adjacent line. Correction is often performed manually by the researcher, but this process is tedious, time-consuming, and prone to error and inconsistency. Various methods have previously been proposed for the automated, post hoc correction of vertical drift in reading data, but these methods vary greatly, not just in terms of the algorithmic principles on which they are based, but also in terms of their availability, documentation, implementation languages, and so forth. Furthermore, these methods have largely been developed in isolation with little attempt to systematically evaluate them, meaning that drift correction techniques are moving forward blindly. We document ten major algorithms, including two that are novel to this paper, and evaluate them using both simulated and natural eye-tracking data. Our results suggest that a method based on dynamic time warping offers great promise, but we also find that some algorithms are better suited than others to particular types of drift phenomena and reading behavior, allowing us to offer evidence-based advice on algorithm selection.

scholarly journals A Preliminary Investigation Of Decision Tree Models For Classification Accuracy Rates And Extracting Interpretable Rules In The Credit Scoring Task: A Case Of The German Data Set

2008 ◽  
Vol 12 (3) ◽  
Author(s):  
Jozef Zurada ◽  
Peng C. Lam
Keyword(s):  
Decision Tree ◽  
Classification Accuracy ◽  
Credit Scoring ◽  
Preliminary Investigation ◽  
Machine Learning Techniques ◽  
Support Vector ◽  
Data Set ◽  
Consumer Loans ◽  
Tree Models ◽  
Accuracy Rates

For many years lenders have been using traditional statistical techniques such as logistic regression and discriminant analysis to more precisely distinguish between creditworthy customers who are granted loans and non-creditworthy customers who are denied loans. More recently new machine learning techniques such as neural networks, decision trees, and support vector machines have been successfully employed to classify loan applicants into those who are likely to pay a loan off or default upon a loan. Accurate classification is beneficial to lenders in terms of increased financial profits or reduced losses and to loan applicants who can avoid overcommitment. This paper examines a historical data set from consumer loans issued by a German bank to individuals whom the bank considered to be qualified customers. The data set consists of the financial attributes of each customer and includes a mixture of loans that the customers paid off or defaulted upon. The paper examines and compares the classification accuracy rates of three decision tree techniques as well as analyzes their ability to generate easy to understand rules.

scholarly journals Use of Eye-Tracking Technology by Medical Students Taking the Objective Structured Clinical Examination: Descriptive Study (Preprint)

2020 ◽  
Author(s):  
M D Grima-Murcia ◽  
Francisco Sanchez-Ferrer ◽  
Jose Manuel Ramos-Rincón ◽  
Eduardo Fernández
Keyword(s):  
Medical Students ◽  
Eye Tracking ◽  
Clinical Examination ◽  
Objective Evaluation ◽  
Objective Structured Clinical Examination ◽  
Eye Tracker ◽  
Clinical Competencies ◽  
Self Evaluation ◽  
Areas Of Interest ◽  
Tracking Technology

BACKGROUND The objective structured clinical examination (OSCE) is a test used throughout Spain to evaluate the clinical competencies, decision making, problem solving, and other skills of sixth-year medical students. OBJECTIVE The main goal of this study is to explore the possible applications and utility of portable eye-tracking systems in the setting of the OSCE, particularly questions associated with attention and engagement. METHODS We used a portable Tobii Glasses 2 eye tracker, which allows real-time monitoring of where the students were looking and records the voice and ambient sounds. We then performed a qualitative and a quantitative analysis of the fields of vision and gaze points attracting attention as well as the visual itinerary. RESULTS Eye-tracking technology was used in the OSCE with no major issues. This portable system was of the greatest value in the patient simulators and mannequin stations, where interaction with the simulated patient or areas of interest in the mannequin can be quantified. This technology proved useful to better identify the areas of interest in the medical images provided. CONCLUSIONS Portable eye trackers offer the opportunity to improve the objective evaluation of candidates and the self-evaluation of the stations used as well as medical simulations by examiners. We suggest that this technology has enough resolution to identify where a student is looking at and could be useful for developing new approaches for evaluating specific aspects of clinical competencies.

scholarly journals Feature Extraction and Classification of MRI Using Hybrid RBF Kernel and SVM

2021 ◽  
pp. 418-426
Author(s):  
Suhas S ◽  
Dr. C. R. Venugopal
Keyword(s):  
Support Vector Machine ◽  
Image Retrieval ◽  
Classification Accuracy ◽  
Kernel Functions ◽  
Polynomial Kernel ◽  
Support Vector ◽  
Svm Classifier ◽  
Mr Images ◽  
Rbf Kernel

An enhanced classification system for classification of MR images using association of kernels with support vector machine is developed and presented in this paper along with the design and development of content-based image retrieval (CBIR) system. Content of image retrieval is the process of finding relevant image from large collection of image database using visual queries. Medical images have led to growth in large image collection. Oriented Rician Noise Reduction Anisotropic Diffusion filter is used for image denoising. A modified hybrid Otsu algorithm termed is used for image segmentation. The texture features are extracted using GLCM method. Genetic algorithm with Joint entropy is adopted for feature selection. The classification is done by support vector machine along with various kernels and the performance is validated. A classification accuracy of 98.83% is obtained using SVM with GRBF kernel. Various features have been extracted and these features are used to classify MR images into five different categories. Performance of the MC-SVM classifier is compared with different kernel functions. From the analysis and performance measures like classification accuracy, it is inferred that the brain and spinal cord MRI classification is best done using MC- SVM with Gaussian RBF kernel function than linear and polynomial kernel functions. The proposed system can provide best classification performance with high accuracy and low error rate.

Sign in / Sign up

Export Citation Format

Share Document