Triple Cross-Domain Attention on Human Activity Recognition Using Wearable Sensors

Human activity recognition (HAR) is essential in many health-related fields. A variety of technologies based on different sensors have been developed for HAR. Among them, fusion from heterogeneous wearable sensors has been developed as it is portable, non-interventional and accurate for HAR. To be applied in real-time use with limited resources, the activity recognition system must be compact and reliable. This requirement can be achieved by feature selection (FS). By eliminating irrelevant and redundant features, the system burden is reduced with good classification performance (CP). This manuscript proposes a two-stage genetic algorithm-based feature selection algorithm with a fixed activation number (GFSFAN), which is implemented on the datasets with a variety of time, frequency and time-frequency domain features extracted from the collected raw time series of nine activities of daily living (ADL). Six classifiers are used to evaluate the effects of selected feature subsets from different FS algorithms on HAR performance. The results indicate that GFSFAN can achieve good CP with a small size. A sensor-to-segment coordinate calibration algorithm and lower-limb joint angle estimation algorithm are introduced. Experiments on the effect of the calibration and the introduction of joint angle on HAR shows that both of them can improve the CP.

Download Full-text

Evaluation of Random Forest for Complex Human Activity Recognition Using Wearable Sensors

2020 International Conference on Networking and Network Applications (NaNA) ◽

10.1109/nana51271.2020.00060 ◽

2020 ◽

Author(s):

Aiguo Wang ◽

Huihui Chen ◽

Chundi Zheng ◽

Liang Zhao ◽

Jinjun Liu ◽

...

Keyword(s):

Random Forest ◽

Activity Recognition ◽

Human Activity ◽

Wearable Sensors ◽

Human Activity Recognition

Download Full-text

Weakly Supervised Human Activity Recognition From Wearable Sensors by Recurrent Attention Learning

IEEE Sensors Journal ◽

10.1109/jsen.2018.2885796 ◽

2019 ◽

Vol 19 (6) ◽

pp. 2287-2297 ◽

Cited By ~ 9

Author(s):

Jun He ◽

Qian Zhang ◽

Liqun Wang ◽

Ling Pei

Keyword(s):

Activity Recognition ◽

Human Activity ◽

Wearable Sensors ◽

Human Activity Recognition ◽

Weakly Supervised

Download Full-text

HARNAS: Human Activity Recognition Based on Automatic Neural Architecture Search Using Evolutionary Algorithms

Sensors ◽

10.3390/s21206927 ◽

2021 ◽

Vol 21 (20) ◽

pp. 6927

Author(s):

Xiaojuan Wang ◽

Xinlei Wang ◽

Tianqi Lv ◽

Lei Jin ◽

Mingshu He

Keyword(s):

Activity Recognition ◽

Human Activity ◽

Search Algorithm ◽

Wearable Sensors ◽

Research Direction ◽

Human Activity Recognition ◽

Nsga Ii ◽

Neural Architecture ◽

Access Cost ◽

Computation Speed

Human activity recognition (HAR) based on wearable sensors is a promising research direction. The resources of handheld terminals and wearable devices limit the performance of recognition and require lightweight architectures. With the development of deep learning, the neural architecture search (NAS) has emerged in an attempt to minimize human intervention. We propose an approach for using NAS to search for models suitable for HAR tasks, namely, HARNAS. The multi-objective search algorithm NSGA-II is used as the search strategy of HARNAS. To make a trade-off between the performance and computation speed of a model, the F1 score and the number of floating-point operations (FLOPs) are selected, resulting in a bi-objective problem. However, the computation speed of a model not only depends on the complexity, but is also related to the memory access cost (MAC). Therefore, we expand the bi-objective search to a tri-objective strategy. We use the Opportunity dataset as the basis for most experiments and also evaluate the portability of the model on the UniMiB-SHAR dataset. The experimental results show that HARNAS designed without manual adjustments can achieve better performance than the best model tweaked by humans. HARNAS obtained an F1 score of 92.16% and parameters of 0.32 MB on the Opportunity dataset.

Download Full-text

Human Activity Recognition of Children with Wearable Devices Using LightGBM Machine Learning

10.21203/rs.3.rs-1076792/v1 ◽

2021 ◽

Author(s):

Gábor Csizmadia ◽

Krisztina Liszkai-Peres ◽

Bence Ferdinandy ◽

Ádám Miklósi ◽

Veronika Konok

Keyword(s):

Machine Learning ◽

Activity Recognition ◽

Human Activity ◽

Learning Algorithm ◽

Binary Classification ◽

Wearable Sensors ◽

Window Size ◽

Human Activity Recognition ◽

Daily Routine ◽

Light Gradient

Abstract Human activity recognition (HAR) using machine learning (ML) methods is a relatively new method for collecting and analyzing large amounts of human behavioral data using special wearable sensors. Our main goal was to find a reliable method which could automatically detect various playful and daily routine activities in children. We defined 40 activities for ML recognition, and we collected activity motion data by means of wearable smartwatches with a special SensKid software. We analyzed the data of 34 children (19 girls, 15 boys; age range: 6.59 – 8.38; median age = 7.47). All children were typically developing first graders from three elementary schools. The activity recognition was a binary classification task which was evaluated with a Light Gradient Boosted Machine (LGBM)learning algorithm, a decision based method with a 3-fold cross validation. We used the sliding window technique during the signal processing, and we aimed at finding the best window size for the analysis of each behavior element to achieve the most effective settings. Seventeen activities out of 40 were successfully recognized with AUC values above 0.8. The window size had no significant effect. The overall accuracy was 0.95, which is at the top segment of the previously published similar HAR data. In summary, the LGBM is a very promising solution for HAR. In line with previous findings, our results provide a firm basis for a more precise and effective recognition system that can make human behavioral analysis faster and more objective.

Download Full-text

Comparison of Different Sets of Features for Human Activity Recognition by Wearable Sensors

Sensors ◽

10.3390/s18124189 ◽

2018 ◽

Vol 18 (12) ◽

pp. 4189 ◽

Cited By ~ 18

Author(s):

Samanta Rosati ◽

Gabriella Balestra ◽

Marco Knaflitz

Keyword(s):

Activity Recognition ◽

Human Activity ◽

Wearable Sensors ◽

Human Activity Recognition ◽

Support Vector ◽

Time Frequency ◽

Security Applications ◽

Biomechanical Behavior ◽

Area Of Interest ◽

Open Point

Human Activity Recognition (HAR) refers to an emerging area of interest for medical, military, and security applications. However, the identification of the features to be used for activity classification and recognition is still an open point. The aim of this study was to compare two different feature sets for HAR. Particularly, we compared a set including time, frequency, and time-frequency domain features widely used in literature (FeatSet_A) with a set of time-domain features derived by considering the physical meaning of the acquired signals (FeatSet_B). The comparison of the two sets were based on the performances obtained using four machine learning classifiers. Sixty-one healthy subjects were asked to perform seven different daily activities wearing a MIMU-based device. Each signal was segmented using a 5-s window and for each window, 222 and 221 variables were extracted for the FeatSet_A and FeatSet_B respectively. Each set was reduced using a Genetic Algorithm (GA) simultaneously performing feature selection and classifier optimization. Our results showed that Support Vector Machine achieved the highest performances using both sets (97.1% and 96.7% for FeatSet_A and FeatSet_B respectively). However, FeatSet_B allows to better understand alterations of the biomechanical behavior in more complex situations, such as when applied to pathological subjects.

Download Full-text