Quantifying Emotional States Based on Body Language Data Using Non Invasive Sensors

Author(s):  
Ishan Behoora ◽  
Conrad S. Tucker

Determining participant engagement is an important issue across a large number of fields, ranging from entertainment to education. Traditionally, feedback from participants is taken after the activity has been completed. Alternately, continuous observation by trained humans is needed. Thus, there is a need for an automated real time solution. In this paper, the authors propose a data mining driven approach that models a participant’s engagement, based on body language data acquired in real time using non-invasive sensors. Skeletal position data, that approximates human body motions, is acquired from participants using off the shelf, non-invasive sensors. Thereafter, machine learning techniques are employed to detect body language patterns representing emotions such as delight, interest, boredom, frustration, and confusion. The methodology proposed in this paper enables researchers to predict the participants’ engagement levels in real time with high accuracy above 98%. A case study involving human participants enacting eight body language poses, is used to illustrate the effectiveness of the methodology. Finally, this methodology highlights the potential of a real time, automated engagement detection using non-invasive sensors which can ultimately have applications in a large variety of areas such as lectures, gaming and classroom learning.

2020 ◽  
Author(s):  
Shunsuke Ikeda ◽  
Miho Fuyama ◽  
Hayato Saigo ◽  
Tatsuji Takahashi

Machine learning techniques have realized some principal cognitive functionalities such as nonlinear generalization and causal model construction, as far as huge amount of data are available. A next frontier for cognitive modelling would be the ability of humans to transfer past knowledge to novel, ongoing experience, making analogies from the known to the unknown. Novel metaphor comprehension may be considered as an example of such transfer learning and analogical reasoning that can be empirically tested in a relatively straightforward way. Based on some concepts inherent in category theory, we implement a model of metaphor comprehension called the theory of indeterminate natural transformation (TINT), and test its descriptive validity of humans' metaphor comprehension. We simulate metaphor comprehension with two models: one being structure-ignoring, and the other being structure-respecting. The former is a sub-TINT model, while the latter is the minimal-TINT model. As the required input to the TINT models, we gathered the association data from human participants to construct the ``latent category'' for TINT, which is a complete weighted directed graph. To test the validity of metaphor comprehension by the TINT models, we conducted an experiment that examines how humans comprehend a metaphor. While the sub-TINT does not show any significant correlation, the minimal-TINT shows significant correlations with the human data. It suggests that we can capture metaphor comprehension processes in a quite bottom-up manner realized by TINT.


Author(s):  
Siam Islam ◽  
Popin Saha ◽  
Touhidul Chowdhury ◽  
Asif Sorowar ◽  
Raqeebir Rab

2021 ◽  
Author(s):  
K. Emma Knowland ◽  
Christoph Keller ◽  
Krzysztof Wargan ◽  
Brad Weir ◽  
Pamela Wales ◽  
...  

<p>NASA's Global Modeling and Assimilation Office (GMAO) produces high-resolution global forecasts for weather, aerosols, and air quality. The NASA Global Earth Observing System (GEOS) model has been expanded to provide global near-real-time 5-day forecasts of atmospheric composition at unprecedented horizontal resolution of 0.25 degrees (~25 km). This composition forecast system (GEOS-CF) combines the operational GEOS weather forecasting model with the state-of-the-science GEOS-Chem chemistry module (version 12) to provide detailed analysis of a wide range of air pollutants such as ozone, carbon monoxide, nitrogen oxides, and fine particulate matter (PM2.5). Satellite observations are assimilated into the system for improved representation of weather and smoke. The assimilation system is being expanded to include chemically reactive trace gases. We discuss current capabilities of the GEOS Constituent Data Assimilation System (CoDAS) to improve atmospheric composition modeling and possible future directions, notably incorporating new observations (TROPOMI, geostationary satellites) and machine learning techniques. We show how machine learning techniques can be used to correct for sub-grid-scale variability, which further improves model estimates at a given observation site.</p>


Author(s):  
Chandrasekar Ravi

This chapter aims to use the speech signals that are a behavioral bio-marker for Parkinson's disease. The victim's vocabulary is mostly lost, or big gaps are observed when they are talking or the conversation is abruptly stopped. Therefore, speech analysis could help to identify the complications in conversation from the inception of the symptoms of Parkinson's disease in initial phases itself. Speech can be regularly logged in an unobstructed approach and machine learning techniques can be applied and analyzed. Fuzzy logic-based classifier is proposed for learning from the training speech signals and classifying the test speech signals. Brainstorm optimization algorithm is proposed for extracting the fuzzy rules from the speech data, which is used by fuzzy classifier for learning and classification. The performance of the proposed classifier is evaluated using metrics like accuracy, specificity, and sensitivity, and compared with benchmark classifiers like SVM, naïve Bayes, k-means, and decision tree. It is observed that the proposed classifier outperforms the benchmark classifiers.


Inventions ◽  
2020 ◽  
Vol 5 (4) ◽  
pp. 57
Author(s):  
Attique Ur Rehman ◽  
Tek Tjing Lie ◽  
Brice Vallès ◽  
Shafiqur Rahman Tito

The recent advancement in computational capabilities and deployment of smart meters have caused non-intrusive load monitoring to revive itself as one of the promising techniques of energy monitoring. Toward effective energy monitoring, this paper presents a non-invasive load inference approach assisted by feature selection and ensemble machine learning techniques. For evaluation and validation purposes of the proposed approach, one of the major residential load elements having solid potential toward energy efficiency applications, i.e., water heating, is considered. Moreover, to realize the real-life deployment, digital simulations are carried out on low-sampling real-world load measurements: New Zealand GREEN Grid Database. For said purposes, MATLAB and Python (Scikit-Learn) are used as simulation tools. The employed learning models, i.e., standalone and ensemble, are trained on a single household’s load data and later tested rigorously on a set of diverse households’ load data, to validate the generalization capability of the employed models. This paper presents a comprehensive performance evaluation of the presented approach in the context of event detection, feature selection, and learning models. Based on the presented study and corresponding analysis of the results, it is concluded that the proposed approach generalizes well to the unseen testing data and yields promising results in terms of non-invasive load inference.


Energies ◽  
2020 ◽  
Vol 13 (20) ◽  
pp. 5504
Author(s):  
Hyang-A Park ◽  
Gilsung Byeon ◽  
Wanbin Son ◽  
Hyung-Chul Jo ◽  
Jongyul Kim ◽  
...  

Due to the recent development of information and communication technology (ICT), various studies using real-time data are now being conducted. The microgrid research field is also evolving to enable intelligent operation of energy management through digitalization. Problems occur when operating the actual microgrid, causing issues such as difficulty in decision making and system abnormalities. Using digital twin technology, which is one of the technologies representing the fourth industrial revolution, it is possible to overcome these problems by changing the microgrid configuration and operating algorithms of virtual space in various ways and testing them in real time. In this study, we proposed an energy storage system (ESS) operation scheduling model to be applied to virtual space when constructing a microgrid using digital twin technology. An ESS optimal charging/discharging scheduling was established to minimize electricity bills and was implemented using supervised learning techniques such as the decision tree, NARX, and MARS models instead of existing optimization techniques. NARX and decision trees are machine learning techniques. MARS is a nonparametric regression model, and its application has been increasing. Its performance was analyzed by deriving performance evaluation indicators for each model. Using the proposed model, it was found in a case study that the amount of electricity bill savings when operating the ESS is greater than that incurred in the actual ESS operation. The suitability of the model was evaluated by a comparative analysis with the optimization-based ESS charging/discharging scheduling pattern.


Sign in / Sign up

Export Citation Format

Share Document