scholarly journals Employing Multimodal Machine Learning for Stress Detection

2021 ◽  
Vol 2021 ◽  
pp. 1-12
Author(s):  
Rahee Walambe ◽  
Pranav Nayak ◽  
Ashmit Bhardwaj ◽  
Ketan Kotecha

In the current information age, the human lifestyle has become more knowledge-oriented, leading to sedentary employment. This has given rise to a number of health and mental disorders. Mental wellness is one of the most neglected, however crucial, aspects of today’s fast-paced world. Mental health issues can, both directly and indirectly, affect other sections of human physiology and impede an individual’s day-to-day activities and performance. However, identifying the stress and finding the stress trend for an individual that may lead to serious mental ailments is challenging and involves multiple factors. Such identification can be achieved accurately by fusing these multiple modalities (due to various factors) arising from a person’s behavioral patterns. Specific techniques are identified in the literature for this purpose; however, very few machine learning-based methods are proposed for such multimodal fusion tasks. In this work, a multimodal AI-based framework is proposed to monitor a person’s working behavior and stress levels. We propose a methodology for efficiently detecting stress due to workload by concatenating heterogeneous raw sensor data streams (e.g., face expressions, posture, heart rate, and computer interaction). This data can be securely stored and analyzed to understand and discover personalized unique behavioral patterns leading to mental strain and fatigue. The contribution of this work is twofold: firstly, proposing a multimodal AI-based strategy for fusion to detect stress and its level and, secondly, identifying a stress pattern over a period of time. We were able to achieve 96.09% accuracy on the test set in stress detection and classification. Further, we were able to reduce the stress scale prediction model loss to 0.036 using these modalities. This work can prove important for the community at large, specifically those working sedentary jobs, to monitor and identify stress levels, especially in current times of COVID-19.

Sensors ◽  
2021 ◽  
Vol 22 (1) ◽  
pp. 1
Author(s):  
Catherine McVey ◽  
Fushing Hsieh ◽  
Diego Manriquez ◽  
Pablo Pinedo ◽  
Kristina Horback

Large and densely sampled sensor datasets can contain a range of complex stochastic structures that are difficult to accommodate in conventional linear models. This can confound attempts to build a more complete picture of an animal’s behavior by aggregating information across multiple asynchronous sensor platforms. The Livestock Informatics Toolkit (LIT) has been developed in R to better facilitate knowledge discovery of complex behavioral patterns across Precision Livestock Farming (PLF) data streams using novel unsupervised machine learning and information theoretic approaches. The utility of this analytical pipeline is demonstrated using data from a 6-month feed trial conducted on a closed herd of 185 mix-parity organic dairy cows. Insights into the tradeoffs between behaviors in time budgets acquired from ear tag accelerometer records were improved by augmenting conventional hierarchical clustering techniques with a novel simulation-based approach designed to mimic the complex error structures of sensor data. These simulations were then repurposed to compress the information in this data stream into robust empirically-determined encodings using a novel pruning algorithm. Nonparametric and semiparametric tests using mutual and pointwise information subsequently revealed complex nonlinear associations between encodings of overall time budgets and the order that cows entered the parlor to be milked.


2021 ◽  
Vol 10 (1) ◽  
pp. 35-37
Author(s):  
B. K. Kiranashree ◽  
V. Ambika ◽  
A. D. Radhika

Mental stress is a common and major issue nowadays especially among working professional, because employees have family commitments with their over workload, target, achievements, etc. Stress tends various health issues like heart attack, stroke, depression, and suicide. Mental stress is not only in employees even normal people also face this problem but the employees has so many stress management techniques to manage the stress like yoga, meditation etc., but still employees suffer from the stress. Stress calculated by the Traditional stress detection method has two types of physiological parameters one is questionnaire format and another one is physiological signals based on Heart rate variability, galvanic skin response, BP, and electrocardiography, etc., Machine learning techniques are applied to analyze and anticipate stress in employees. In this paper, we mainly focus on different machine learning techniques and physiological parameters for stress detection.


Mental disorders can be recognized by how a person behaves, feels, perceives, or thinks over a period of a lifetime. Nowadays, a large number of people are feeling stressed with the rapid pace of life. Stress and depression may lead to mental disorders. Work pressure, working environment, people we interact, schedule of the day, food habits, etc. are some of the major reasons behind building stress among the people. Thus, stress can be detected through some conventional medical symptoms such as headache, rapid heartbeats, feeling low energy, chest pain, frequent colds, infections, etc. The stress also may reflect in normal behavior while carrying out day-to-day activities. Individuals may share their day-to-day activities and interact with friends on social media. Thus, it may be possible to detect stress through social network data. There are many ways to detect stress levels. Some of the instruments are used to detect stress while there is a medical test to know the stress level. Also, there are apps that analyze the behavior of the person to detect stress. Many researchers had tried to use machine learning techniques including the use of various algorithms such as Decision Tree, Naïve Bayes, Random Forest, etc. which gives a lower accuracy of 70% on average. In this paper, we are using a closeness of stress levels with social media data shared by many users. In our proposed system design, Facebook posts are being accessed using a token. Further, we recommend the use of machine learning algorithms such as Conventional Neural Network (CNN) to extract Facebook posts, Transductive Support Vector Machine (TSVM) to classify posts and K-Nearest Neighbors (KNN) to recommend nearby hospitals. With the help of these algorithms, we predict the stress level of the person as positive, negative. Thus, we are expecting more accuracy to detect the stress along with the preventive recommendation. We have proposed a methodology to detect stress because severe stress may lead to self-harming activities and also it may affect the lives of people around us. Thus, stress detection has become extremely important and we are expecting that our proposed model may detect it with more accuracy.


Sensors ◽  
2021 ◽  
Vol 21 (8) ◽  
pp. 2873
Author(s):  
Kayisan M. Dalmeida ◽  
Giovanni L. Masala

Stress has been identified as one of the major causes of automobile crashes which then lead to high rates of fatalities and injuries each year. Stress can be measured via physiological measurements and in this study the focus will be based on the features that can be extracted by common wearable devices. Hence, the study will be mainly focusing on heart rate variability (HRV). This study is aimed at investigating the role of HRV-derived features as stress markers. This is achieved by developing a good predictive model that can accurately classify stress levels from ECG-derived HRV features, obtained from automobile drivers, by testing different machine learning methodologies such as K-Nearest Neighbor (KNN), Support Vector Machines (SVM), Multilayer Perceptron (MLP), Random Forest (RF) and Gradient Boosting (GB). Moreover, the models obtained with highest predictive power will be used as reference for the development of a machine learning model that would be used to classify stress from HRV features derived from heart rate measurements obtained from wearable devices. We demonstrate that HRV features constitute good markers for stress detection as the best machine learning model developed achieved a Recall of 80%. Furthermore, this study indicates that HRV metrics such as the Average of normal-to-normal (NN) intervals (AVNN), Standard deviation of the average NN intervals (SDNN) and the Root mean square differences of successive NN intervals (RMSSD) were important features for stress detection. The proposed method can be also used on all applications in which is important to monitor the stress levels in a non-invasive manner, e.g., in physical rehabilitation, anxiety relief or mental wellbeing.


2020 ◽  
Author(s):  
Nalika Ulapane ◽  
Karthick Thiyagarajan ◽  
sarath kodagoda

<div>Classification has become a vital task in modern machine learning and Artificial Intelligence applications, including smart sensing. Numerous machine learning techniques are available to perform classification. Similarly, numerous practices, such as feature selection (i.e., selection of a subset of descriptor variables that optimally describe the output), are available to improve classifier performance. In this paper, we consider the case of a given supervised learning classification task that has to be performed making use of continuous-valued features. It is assumed that an optimal subset of features has already been selected. Therefore, no further feature reduction, or feature addition, is to be carried out. Then, we attempt to improve the classification performance by passing the given feature set through a transformation that produces a new feature set which we have named the “Binary Spectrum”. Via a case study example done on some Pulsed Eddy Current sensor data captured from an infrastructure monitoring task, we demonstrate how the classification accuracy of a Support Vector Machine (SVM) classifier increases through the use of this Binary Spectrum feature, indicating the feature transformation’s potential for broader usage.</div><div><br></div>


Author(s):  
Ankush Ambardar

Employee safety and health is considered to be one of the major important human resource functions for any hotel organization. The current paper focuses on the application of occupational safety and health of laundry employees looking at the nature of the tasks performed in day to day operations. OSH is one of the significant factors responsible for employees inspiration and moreover retention in a hotel organization. Health, safety and performance of the employees are dependent on understanding and application of ergonomic practices followed during laundry operations. The paper explores laundry employee protection against various critical factors such as injuries, accidents, work postures, chemical exposure, heat, fire, noise, etc. A questionnaire was used to perpetuate perception of laundry employees in regard to protection from factors concerning safety and health issues from hotels of India. The results reveal that some of the OSH practices are been followed in hotels, while some were missing from hotels such as training, periodical audit and protection against chemical hazards. The present study suggests need for adopting OSH practices and enforcing periodical check for the same in every hotel besides of its categorization.


2021 ◽  
pp. 158-166
Author(s):  
Noah Balestra ◽  
Gaurav Sharma ◽  
Linda M. Riek ◽  
Ania Busza

<b><i>Background:</i></b> Prior studies suggest that participation in rehabilitation exercises improves motor function poststroke; however, studies on optimal exercise dose and timing have been limited by the technical challenge of quantifying exercise activities over multiple days. <b><i>Objectives:</i></b> The objectives of this study were to assess the feasibility of using body-worn sensors to track rehabilitation exercises in the inpatient setting and investigate which recording parameters and data analysis strategies are sufficient for accurately identifying and counting exercise repetitions. <b><i>Methods:</i></b> MC10 BioStampRC® sensors were used to measure accelerometer and gyroscope data from upper extremities of healthy controls (<i>n</i> = 13) and individuals with upper extremity weakness due to recent stroke (<i>n</i> = 13) while the subjects performed 3 preselected arm exercises. Sensor data were then labeled by exercise type and this labeled data set was used to train a machine learning classification algorithm for identifying exercise type. The machine learning algorithm and a peak-finding algorithm were used to count exercise repetitions in non-labeled data sets. <b><i>Results:</i></b> We achieved a repetition counting accuracy of 95.6% overall, and 95.0% in patients with upper extremity weakness due to stroke when using both accelerometer and gyroscope data. Accuracy was decreased when using fewer sensors or using accelerometer data alone. <b><i>Conclusions:</i></b> Our exploratory study suggests that body-worn sensor systems are technically feasible, well tolerated in subjects with recent stroke, and may ultimately be useful for developing a system to measure total exercise “dose” in poststroke patients during clinical rehabilitation or clinical trials.


Sign in / Sign up

Export Citation Format

Share Document