Detecting Human Emotions Through Physiological Signals Using Machine Learning

Author(s):  
R. Balamurali ◽  
Priyansh Brannen Lall ◽  
Krati Taneja ◽  
Gautam Krishna
Sensors ◽  
2021 ◽  
Vol 21 (11) ◽  
pp. 3616
Author(s):  
Jan Ubbo van Baardewijk ◽  
Sarthak Agarwal ◽  
Alex S. Cornelissen ◽  
Marloes J. A. Joosen ◽  
Jiska Kentrop ◽  
...  

Early detection of exposure to a toxic chemical, e.g., in a military context, can be life-saving. We propose to use machine learning techniques and multiple continuously measured physiological signals to detect exposure, and to identify the chemical agent. Such detection and identification could be used to alert individuals to take appropriate medical counter measures in time. As a first step, we evaluated whether exposure to an opioid (fentanyl) or a nerve agent (VX) could be detected in freely moving guinea pigs using features from respiration, electrocardiography (ECG) and electroencephalography (EEG), where machine learning models were trained and tested on different sets (across subject classification). Results showed this to be possible with close to perfect accuracy, where respiratory features were most relevant. Exposure detection accuracy rose steeply to over 95% correct during the first five minutes after exposure. Additional models were trained to correctly classify an exposed state as being induced either by fentanyl or VX. This was possible with an accuracy of almost 95%, where EEG features proved to be most relevant. Exposure detection models that were trained on subsets of animals generalized to subsets of animals that were exposed to other dosages of different chemicals. While future work is required to validate the principle in other species and to assess the robustness of the approach under different, realistic circumstances, our results indicate that utilizing different continuously measured physiological signals for early detection and identification of toxic agents is promising.


Sensors ◽  
2021 ◽  
Vol 21 (24) ◽  
pp. 8336
Author(s):  
Hafeez Ur Rehman Siddiqui ◽  
Hina Fatima Shahzad ◽  
Adil Ali Saleem ◽  
Abdul Baqi Khan Khan Khakwani ◽  
Furqan Rustam ◽  
...  

Emotion recognition gained increasingly prominent attraction from a multitude of fields recently due to their wide use in human-computer interaction interface, therapy, and advanced robotics, etc. Human speech, gestures, facial expressions, and physiological signals can be used to recognize different emotions. Despite the discriminating properties to recognize emotions, the first three methods have been regarded as ineffective as the probability of human’s voluntary and involuntary concealing the real emotions can not be ignored. Physiological signals, on the other hand, are capable of providing more objective, and reliable emotion recognition. Based on physiological signals, several methods have been introduced for emotion recognition, yet, predominantly such approaches are invasive involving the placement of on-body sensors. The efficacy and accuracy of these approaches are hindered by the sensor malfunctioning and erroneous data due to human limbs movement. This study presents a non-invasive approach where machine learning complements the impulse radio ultra-wideband (IR-UWB) signals for emotion recognition. First, the feasibility of using IR-UWB for emotion recognition is analyzed followed by determining the state of emotions into happiness, disgust, and fear. These emotions are triggered using carefully selected video clips to human subjects involving both males and females. The convincing evidence that different breathing patterns are linked with different emotions has been leveraged to discriminate between different emotions. Chest movement of thirty-five subjects is obtained using IR-UWB radar while watching the video clips in solitude. Extensive signal processing is applied to the obtained chest movement signals to estimate respiration rate per minute (RPM). The RPM estimated by the algorithm is validated by repeated measurements by a commercially available Pulse Oximeter. A dataset is maintained comprising gender, RPM, age, and associated emotions which are further used with several machine learning algorithms for automatic recognition of human emotions. Experiments reveal that IR-UWB possesses the potential to differentiate between different human emotions with a decent accuracy of 76% without placing any on-body sensors. Separate analysis for male and female participants reveals that males experience high arousal for happiness while females experience intense fear emotions. For disgust emotion, no large difference is found for male and female participants. To the best of the authors’ knowledge, this study presents the first non-invasive approach using the IR-UWB radar for emotion recognition.


IEEE Access ◽  
2019 ◽  
Vol 7 ◽  
pp. 98971-98992 ◽  
Author(s):  
Afsaneh Koohestani ◽  
Moloud Abdar ◽  
Abbas Khosravi ◽  
Saeid Nahavandi ◽  
Mahereh Koohestani

2021 ◽  
pp. 597-608
Author(s):  
Vikas Khullar ◽  
Raj Gaurang Tiwari ◽  
Ambuj Kumar Agarwal ◽  
Soumi Dutta

2016 ◽  
Vol 12 (04) ◽  
pp. 37 ◽  
Author(s):  
Bruno Patrão ◽  
Samuel Pedro ◽  
Paulo Menezes

In this paper we present a Virtual Reality based laboratory experience that can be used to demonstrate the effect that emotions may play in our bodies. For attaining this purpose, a Virtual Reality-based system is presented where three different virtual environments aim at inducing specific sensations and emotions on the students participating in a classroom experiment. The objective is that the students be able to analyze their own physiological data and understand the correlation between data patterns and experienced situation.


Sign in / Sign up

Export Citation Format

Share Document