scholarly journals Spatial normalization of facial thermal images using facial landmarks

2021 ◽  
Author(s):  
Kent Nagumo ◽  
Kosuke Oiwa ◽  
Akio Nozawa
Keyword(s):  
Individual Differences ◽  
Skin Temperature ◽  
Correlation Coefficient ◽  
Human Condition ◽  
Psychological State ◽  
Facial Skin ◽  
Spatial Normalization ◽  
Thermal Images ◽  
Psychological States ◽  
Face Shape

AbstractHuman–computer interaction (HCI) is an interaction for mutual communication between humans and computers. HCI needs to recognize the human state quantitatively and in real-time. Although it is possible to quantitatively evaluate the human condition by measuring biological signals, the challenge is that it often requires physical constraints. There is an increasing interest in a non-contact method of estimating physiological and psychological states by measuring facial skin temperature using infrared thermography. However, due to individual differences in face shape, the accuracy of physiological and psychological state estimation using facial thermal images was sometimes low. To solve this problem, we hypothesized that spatial normalization of facial thermal image (SN-FTI) could reduce the effect of individual differences in facial shape. The objective of this study is to develop a method for SN-FTI and to evaluate the effect of SN-FTI on the estimation of physiological and psychological states. First, we attempted spatial normalization using facial features. The results suggested that SN-FTI would result in the same face shape among individuals. Since there are individual differences in facial skin temperature distribution, the inter-individual correlation coefficient is suggested to be lower than the intra-individual correlation coefficient. Next, we modeled the estimated drowsiness level using SN-FTIs and compared it with Normal. The results showed that SN-FTI slightly improved the discrimination rate of drowsiness level. SN-FTIs were suggested to reduce the effect of individual differences in facial structure on the estimation of physiological and psychological states.

scholarly journals Anomaly detection in facial skin temperature using variational autoencoder

2020 ◽  
Author(s):  
Ayaka Masaki ◽  
Kent Nagumo ◽  
Bikash Lamsal ◽  
Kosuke Oiwa ◽  
Akio Nozawa
Keyword(s):  
Anomaly Detection ◽  
Skin Temperature ◽  
Facial Skin ◽  
Autonomic Nervous System Activity ◽  
New Approach ◽  
Thermal Images ◽  
Psychological States ◽  
Detection Model ◽  
Nervous System Activity ◽  
Variational Autoencoder

Abstract Facial skin temperature is a physiological index that varies with skin blood flow controlled by autonomic nervous system activity. The facial skin temperature can be remotely measured using infrared thermography, and it has recently attracted attention as a remote biomarker. For example, studies have been reported to estimate human emotions, drowsiness, and mental stress on facial skin temperature. However, it is impossible to make a machine that can discriminate all infinite physiological and psychological states. Considering the practicality of skin temperature, a machine that can determine the normal state of facial skin temperature may be sufficient. In this study, we propose a completely new approach to incorporate the concept of anomaly detection into the analysis of physiological and psychological states by facial skin temperature. In this paper, the method for separating normal and anomaly facial thermal images using an anomaly detection model was investigated to evaluate the applicability of variational autoencoder (VAE) to facial thermal images.

Deep learning techniques for automated detection of autism spectrum disorder based on thermal imaging

2021 ◽  
pp. 095441192110247
Author(s):  
Kavya Ganesh ◽  
Snekhalatha Umapathy ◽  
Palani Thanaraj Krishnan
Keyword(s):  
Neural Network ◽  
Autism Spectrum Disorder ◽  
Skin Temperature ◽  
Thermal Imaging ◽  
Imaging Modality ◽  
Autism Spectrum ◽  
Spectrum Disorder ◽  
Facial Skin ◽  
Autistic Children ◽  
Thermal Images

Children with autism spectrum disorder have impairments in emotional processing which leads to the inability in recognizing facial expressions. Since emotion is a vital criterion for having fine socialisation, it is incredibly important for the autistic children to recognise emotions. In our study, we have chosen the facial skin temperature as a biomarker to measure emotions. To assess the facial skin temperature, the thermal imaging modality has been used in this study, since it has been recognised as a promising technique to evaluate emotional responses. The aim of this study was the following: (1) to compare the facial skin temperature of autistic and non-autistic children by using thermal imaging across various emotions; (2) to classify the thermal images obtained from the study using the customised convolutional neural network compared with the ResNet 50 network. Fifty autistic and fifty non-autistic participants were included for the study. Thermal imaging was used to obtain the temperature of specific facial regions such as the eyes, cheek, forehead and nose while we evoked emotions (Happiness, anger and sadness) in children using an audio-visual stimulus. Among the emotions considered, the emotion anger had the highest temperature difference between the autistic and non-autistic participants in the region’s eyes (1.9%), cheek (2.38%) and nose (12.6%). The accuracy obtained by classifying the thermal images of the autistic and non-autistic children using Customised Neural Network and ResNet 50 Network was 96% and 90% respectively. This computer aided diagnostic tool can be a predictable and a steadfast method in the diagnosis of the autistic individuals.

Stress Presumption of the Long Driving Using the Facial Thermal Image

2010 ◽  
Vol 22 (6) ◽  
pp. 751-757 ◽  
Author(s):  
Hirotoshi Asano ◽  
◽  
Hitoshi Onogaki ◽  
Takumi Muto ◽  
Syuichi Yokoyama ◽  
...  
Keyword(s):  
Skin Temperature ◽  
Stress Level ◽  
Mental State ◽  
Thermal Image ◽  
Temperature Pattern ◽  
Facial Skin ◽  
Psychological States ◽  
Quantitative Measurements ◽  
Car Accidents ◽  
Close Relationship

There is a close relationship between car accidents and the physiological and psychological states of drivers. Stress may lead to a feeling of fatigue or a decrease in attentiveness. Therefore, it is an important subject from viewpoints such as that of accident prevention to evaluate the mental state of drivers behind the wheel. This research aims at the development of technology that will take quantitative measurements of stress based on facial skin temperature. It is based on the relation between facial skin temperature and changes in mental state. Presumption of stress level of a driver was attempted from the change in temperature pattern of a series of readings.

Measuring Facial Skin Temperature Changes Caused by Mental Work-Load with Infrared Thermography

2016 ◽  
Vol 136 (11) ◽  
pp. 1581-1585 ◽  
Author(s):  
Tota Mizuno ◽  
Takeru Sakai ◽  
Shunsuke Kawazura ◽  
Hirotoshi Asano ◽  
Kota Akehi ◽  
...  
Keyword(s):  
Skin Temperature ◽  
Infrared Thermography ◽  
Work Load ◽  
Facial Skin ◽  
Mental Work ◽  
Temperature Changes ◽  
Mental Work Load

Seeming to Seem

2018 ◽  
Author(s):  
David Rosenthal
Keyword(s):  
Mental States ◽  
Order Theory ◽  
Higher Order ◽  
Psychological State ◽  
Intentional Stance ◽  
First Person ◽  
Psychological States ◽  
Third Person ◽  
Higher Order Theory ◽  
The Third Person

Dennett’s account of consciousness starts from third-person considerations. I argue this is wise, since beginning with first-person access precludes accommodating the third-person access we have to others’ mental states. But Dennett’s first-person operationalism, which seeks to save the first person in third-person, operationalist terms, denies the occurrence of folk-psychological states that one doesn’t believe oneself to be in, and so the occurrence of folk-psychological states that aren’t conscious. This conflicts with Dennett’s intentional-stance approach to the mental, on which we discern others’ mental states independently of those states’ being conscious. We can avoid this conflict with a higher-order theory of consciousness, which saves the spirit of Dennett’s approach, but enables us to distinguish conscious folk-psychological states from nonconscious ones. The intentional stance by itself can’t do this, since it can’t discern a higher-order awareness of a psychological state. But we can supplement the intentional stance with the higher-order theoretical apparatus.

Facial skin temperature decreases in infants with joyful expression

2008 ◽  
Vol 31 (1) ◽  
pp. 137-144 ◽  
Author(s):  
Rie Nakanishi ◽  
Kyoko Imai-Matsumura
Keyword(s):  
Skin Temperature ◽  
Facial Skin

scholarly journals Rapid assessment and simulation study of the physiological and psychological state of coal miners

2021 ◽  
Vol 245 ◽  
pp. 01060
Author(s):  
Jin Gang ◽  
Zhang JinSuo ◽  
Huang YiXin
Keyword(s):  
Physiological State ◽  
Rapid Assessment ◽  
Fuzzy Comprehensive Evaluation ◽  
Evaluation Index System ◽  
Shaanxi Province ◽  
Psychological Status ◽  
Psychological State ◽  
Rapid Evaluation ◽  
Coal Miners ◽  
Psychological States

In order to achieve a rapid evaluation of the physiological and psychological state of miners and to solve the problem of how to prevent human-caused accidents underground. Based on the existing literature and expert interviews, a rapid evaluation index system consisting of 2 aspects of physiological state and psychological state, 11 indicators such as body temperature, blood pressure and heart rate is established, and the index weights are determined by using AHP hierarchical analysis. Based on the weights, the physiological and psychological status of coal miners is classified into four levels: excellent, good, medium, and poor. Evaluation criteria also is established. A fuzzy comprehensive evaluation model of coal miners’ physiological and psychological states is constructed, and the subordination suitable for the evaluation of coal miners’ physiological and psychological states is given. Degree function. Using MATLAB2016a to randomly simulate 1000 sets of index data and perform evaluation and analysis, the results found that the proportions of evaluation as excellent and good are 36% and 35%, respectively; the proportions of neutral and poor are 16% and 13%, respectively. The evaluation of the physiological and psychological states of five coal miners in a coal mine in Shaanxi Province, with all results above “good”, is verified to be consistent with reality. Through simulation analysis and example verification, it is shown that the model is reasonable and applicable to the group of coal miners, and is expected to provide theoretical support for the development of subsequent rapid assessment software systems.

Dogmatism and Individual Differences in Reduction of Dissonance

1964 ◽  
Vol 14 (1) ◽  
pp. 47-50 ◽  
Author(s):  
Samuel Fillenbaum
Keyword(s):  
Individual Differences ◽  
Correlation Coefficient ◽  
Comparable Size ◽  
Dissonance Reduction

The relation between individual differences in amount of dissonance reduction and open-closed mindedeness as indexed by Dogmatism score was determined. In line with expectation, a significant correlation was obtained between these variables ( r = .39, p < .01), the more dogmatic Ss showing greater tendency to dissonance reduction. However, a correlation coefficient of comparable size was also obtained in a control condition. Consideration of some features of the control condition led to the suggestion that this too might well be considered a dissonant situation, from the standpoint of S.

Sign in / Sign up

Export Citation Format

Share Document