scholarly journals Single-Trial Recognition of Video Gamer’s Expertise from Brain Haemodynamic and Facial Emotion Responses

2021 ◽  
Vol 11 (1) ◽  
pp. 106
Author(s):  
Ana R. Andreu-Perez ◽  
Mehrin Kiani ◽  
Javier Andreu-Perez ◽  
Pratusha Reddy ◽  
Jaime Andreu-Abela ◽  
...  

With an increase in consumer demand of video gaming entertainment, the game industry is exploring novel ways of game interaction such as providing direct interfaces between the game and the gamers’ cognitive or affective responses. In this work, gamer’s brain activity has been imaged using functional near infrared spectroscopy (fNIRS) whilst they watch video of a video game (League of Legends) they play. A video of the face of the participants is also recorded for each of a total of 15 trials where a trial is defined as watching a gameplay video. From the data collected, i.e., gamer’s fNIRS data in combination with emotional state estimation from gamer’s facial expressions, the expertise level of the gamers has been decoded per trial in a multi-modal framework comprising of unsupervised deep feature learning and classification by state-of-the-art models. The best tri-class classification accuracy is obtained using a cascade of random convolutional kernel transform (ROCKET) feature extraction method and deep classifier at 91.44%. This is the first work that aims at decoding expertise level of gamers using non-restrictive and portable technologies for brain imaging, and emotional state recognition derived from gamers’ facial expressions. This work has profound implications for novel designs of future human interactions with video games and brain-controlled games.

2019 ◽  
Author(s):  
Shannon Burns ◽  
Lianne N. Barnes ◽  
Ian A. McCulloh ◽  
Munqith M. Dagher ◽  
Emily B. Falk ◽  
...  

The large majority of social neuroscience research uses WEIRD populations – participants from Western, educated, industrialized, rich, and democratic locations. This makes it difficult to claim whether neuropsychological functions are universal or culture specific. In this study, we demonstrate one approach to addressing the imbalance by using portable neuroscience equipment in a study of persuasion conducted in Jordan with an Arabic-speaking sample. Participants were shown persuasive videos on various health and safety topics while their brain activity was measured using functional near infrared spectroscopy (fNIRS). Self-reported persuasiveness ratings for each video were then recorded. Consistent with previous research conducted with American subjects, this work found that activity in the dorsomedial and ventromedial prefrontal cortex predicted how persuasive participants found the videos and how much they intended to engage in the messages’ endorsed behaviors. Further, activity in the left ventrolateral prefrontal cortex was associated with persuasiveness ratings, but only in participants for whom the message was personally relevant. Implications for these results on the understanding of the brain basis of persuasion and on future directions for neuroimaging in diverse populations are discussed.


2021 ◽  
Vol 11 (2) ◽  
pp. 196
Author(s):  
Sébastien Laurent ◽  
Laurence Paire-Ficout ◽  
Jean-Michel Boucheix ◽  
Stéphane Argon ◽  
Antonio Hidalgo-Muñoz

The question of the possible impact of deafness on temporal processing remains unanswered. Different findings, based on behavioral measures, show contradictory results. The goal of the present study is to analyze the brain activity underlying time estimation by using functional near infrared spectroscopy (fNIRS) techniques, which allow examination of the frontal, central and occipital cortical areas. A total of 37 participants (19 deaf) were recruited. The experimental task involved processing a road scene to determine whether the driver had time to safely execute a driving task, such as overtaking. The road scenes were presented in animated format, or in sequences of 3 static images showing the beginning, mid-point, and end of a situation. The latter presentation required a clocking mechanism to estimate the time between the samples to evaluate vehicle speed. The results show greater frontal region activity in deaf people, which suggests that more cognitive effort is needed to process these scenes. The central region, which is involved in clocking according to several studies, is particularly activated by the static presentation in deaf people during the estimation of time lapses. Exploration of the occipital region yielded no conclusive results. Our results on the frontal and central regions encourage further study of the neural basis of time processing and its links with auditory capacity.


Sensors ◽  
2020 ◽  
Vol 20 (8) ◽  
pp. 2362 ◽  
Author(s):  
Alexander E. Hramov ◽  
Vadim Grubov ◽  
Artem Badarin ◽  
Vladimir A. Maksimenko ◽  
Alexander N. Pisarchik

Sensor-level human brain activity is studied during real and imaginary motor execution using functional near-infrared spectroscopy (fNIRS). Blood oxygenation and deoxygenation spatial dynamics exhibit pronounced hemispheric lateralization when performing motor tasks with the left and right hands. This fact allowed us to reveal biomarkers of hemodynamical response of the motor cortex on the motor execution, and use them for designing a sensing method for classification of the type of movement. The recognition accuracy of real movements is close to 100%, while the classification accuracy of imaginary movements is lower but quite high (at the level of 90%). The advantage of the proposed method is its ability to classify real and imaginary movements with sufficiently high efficiency without the need for recalculating parameters. The proposed system can serve as a sensor of motor activity to be used for neurorehabilitation after severe brain injuries, including traumas and strokes.


Author(s):  
Paola Pinti ◽  
Andrea Devoto ◽  
Isobel Greenhalgh ◽  
Ilias Tachtsidis ◽  
Paul W Burgess ◽  
...  

Abstract Anterior prefrontal cortex (PFC, Brodmann area 10) activations are often, but not always, found in neuroimaging studies investigating deception, and the precise role of this area remains unclear. To explore the role of the PFC in face-to-face deception, we invited pairs of participants to play a card game involving lying and lie detection while we used functional near infrared spectroscopy (fNIRS) to record brain activity in the PFC. Participants could win points for successfully lying about the value of their cards or for detecting lies. We contrasted patterns of brain activation when the participants either told the truth or lied, when they were either forced into this or did so voluntarily and when they either succeeded or failed to detect a lie. Activation in the anterior PFC was found in both lie production and detection, unrelated to reward. Analysis of cross-brain activation patterns between participants identified areas of the PFC where the lead player’s brain activity synchronized their partner’s later brain activity. These results suggest that during situations that involve close interpersonal interaction, the anterior PFC supports processing widely involved in deception, possibly relating to the demands of monitoring one’s own and other people’s behaviour.


2005 ◽  
Vol 37 (13-15) ◽  
pp. 1319-1338 ◽  
Author(s):  
Takashi Kojima ◽  
Hitoshi Tsunashima ◽  
Tomoki Shiozawa ◽  
Hiroki Takada ◽  
Takuji Sakai

Sign in / Sign up

Export Citation Format

Share Document