Feasibility Study to Identify Brain Activity and Eye-Tracking Features for Assessing Hazard Recognition Using Consumer-Grade Wearables in an Immersive Virtual Environment

2021 ◽  
Vol 147 (9) ◽  
pp. 04021104
Author(s):  
Mojtaba Noghabaei ◽  
Kevin Han ◽  
Alex Albert
Keyword(s):  
Eye Tracking ◽  
Virtual Environment ◽  
Feasibility Study ◽  
Brain Activity ◽  
Immersive Virtual Environment ◽  
Hazard Recognition

scholarly journals Using Brain Activity Patterns to Differentiate Real and Virtual Attended Targets during Augmented Reality Scenarios

Information ◽  
2021 ◽  
Vol 12 (6) ◽  
pp. 226
Author(s):  
Lisa-Marie Vortmann ◽  
Leonid Schwenke ◽  
Felix Putze
Keyword(s):  
Augmented Reality ◽  
Eye Tracking ◽  
Brain Activity ◽  
Activity Patterns ◽  
Training Data ◽  
Machine Learning Techniques ◽  
Neural Net ◽  
Dependent Manner ◽  
Tracking Data ◽  
Average Accuracy

Augmented reality is the fusion of virtual components and our real surroundings. The simultaneous visibility of generated and natural objects often requires users to direct their selective attention to a specific target that is either real or virtual. In this study, we investigated whether this target is real or virtual by using machine learning techniques to classify electroencephalographic (EEG) and eye tracking data collected in augmented reality scenarios. A shallow convolutional neural net classified 3 second EEG data windows from 20 participants in a person-dependent manner with an average accuracy above 70% if the testing data and training data came from different trials. This accuracy could be significantly increased to 77% using a multimodal late fusion approach that included the recorded eye tracking data. Person-independent EEG classification was possible above chance level for 6 out of 20 participants. Thus, the reliability of such a brain–computer interface is high enough for it to be treated as a useful input mechanism for augmented reality applications.

Sign in / Sign up

Export Citation Format

Share Document