Deep Learning for Smartphone-Based Human Activity Recognition Using Multi-sensor Fusion

2019 ◽  
pp. 65-75
Author(s):  
Charlene V. San Buenaventura ◽  
Nestor Michael C. Tiglao ◽  
Rowel O. Atienza
Keyword(s):  
Deep Learning ◽  
Sensor Fusion ◽  
Activity Recognition ◽  
Human Activity ◽  
Human Activity Recognition

scholarly journals Sensor Data Acquisition and Multimodal Sensor Fusion for Human Activity Recognition Using Deep Learning

Sensors ◽  
2019 ◽  
Vol 19 (7) ◽  
pp. 1716 ◽  
Author(s):  
Seungeun Chung ◽  
Jiyoun Lim ◽  
Kyoung Ju Noh ◽  
Gague Kim ◽  
Hyuntae Jeong
Keyword(s):  
Deep Learning ◽  
Data Acquisition ◽  
Sensor Fusion ◽  
Activity Recognition ◽  
Human Activity ◽  
Short Term Memory ◽  
Sampling Rate ◽  
Human Activity Recognition ◽  
Sensor Data ◽  
Activity Data

In this paper, we perform a systematic study about the on-body sensor positioning and data acquisition details for Human Activity Recognition (HAR) systems. We build a testbed that consists of eight body-worn Inertial Measurement Units (IMU) sensors and an Android mobile device for activity data collection. We develop a Long Short-Term Memory (LSTM) network framework to support training of a deep learning model on human activity data, which is acquired in both real-world and controlled environments. From the experiment results, we identify that activity data with sampling rate as low as 10 Hz from four sensors at both sides of wrists, right ankle, and waist is sufficient in recognizing Activities of Daily Living (ADLs) including eating and driving activity. We adopt a two-level ensemble model to combine class-probabilities of multiple sensor modalities, and demonstrate that a classifier-level sensor fusion technique can improve the classification performance. By analyzing the accuracy of each sensor on different types of activity, we elaborate custom weights for multimodal sensor fusion that reflect the characteristic of individual activities.

scholarly journals On the Use of Sensor Fusion to Reduce the Impact of Rotational and Additive Noise in Human Activity Recognition

Sensors ◽  
2012 ◽  
Vol 12 (6) ◽  
pp. 8039-8054 ◽  
Author(s):  
Oresti Banos ◽  
Miguel Damas ◽  
Hector Pomares ◽  
Ignacio Rojas
Keyword(s):  
Sensor Fusion ◽  
Activity Recognition ◽  
Human Activity ◽  
Additive Noise ◽  
Human Activity Recognition ◽  
The Impact

scholarly journals Study on Human Activity Recognition Using Semi-Supervised Active Transfer Learning

Sensors ◽  
2021 ◽  
Vol 21 (8) ◽  
pp. 2760
Author(s):  
Seungmin Oh ◽  
Akm Ashiquzzaman ◽  
Dongsu Lee ◽  
Yeonggwang Kim ◽  
Jinsul Kim
Keyword(s):  
Deep Learning ◽  
Transfer Learning ◽  
Activity Recognition ◽  
Human Activity ◽  
Random Sampling ◽  
Data Gathering ◽  
Human Activity Recognition ◽  
Learning Models ◽  
Active Transfer ◽  
Existing Data

In recent years, various studies have begun to use deep learning models to conduct research in the field of human activity recognition (HAR). However, there has been a severe lag in the absolute development of such models since training deep learning models require a lot of labeled data. In fields such as HAR, it is difficult to collect data and there are high costs and efforts involved in manual labeling. The existing methods rely heavily on manual data collection and proper labeling of the data, which is done by human administrators. This often results in the data gathering process often being slow and prone to human-biased labeling. To address these problems, we proposed a new solution for the existing data gathering methods by reducing the labeling tasks conducted on new data based by using the data learned through the semi-supervised active transfer learning method. This method achieved 95.9% performance while also reducing labeling compared to the random sampling or active transfer learning methods.

scholarly journals Iss2Image: A Novel Signal-Encoding Technique for CNN-Based Human Activity Recognition

Sensors ◽  
2018 ◽  
Vol 18 (11) ◽  
pp. 3910 ◽  
Author(s):  
Taeho Hur ◽  
Jaehun Bang ◽  
Thien Huynh-The ◽  
Jongwon Lee ◽  
Jee-In Kim ◽  
...  
Keyword(s):  
Deep Learning ◽  
Activity Recognition ◽  
Human Activity ◽  
Expert Knowledge ◽  
Inertial Sensor ◽  
Human Activity Recognition ◽  
Learning Technology ◽  
Sensor Signal ◽  
Signal Encoding ◽  
The Right

The most significant barrier to success in human activity recognition is extracting and selecting the right features. In traditional methods, the features are chosen by humans, which requires the user to have expert knowledge or to do a large amount of empirical study. Newly developed deep learning technology can automatically extract and select features. Among the various deep learning methods, convolutional neural networks (CNNs) have the advantages of local dependency and scale invariance and are suitable for temporal data such as accelerometer (ACC) signals. In this paper, we propose an efficient human activity recognition method, namely Iss2Image (Inertial sensor signal to Image), a novel encoding technique for transforming an inertial sensor signal into an image with minimum distortion and a CNN model for image-based activity classification. Iss2Image converts real number values from the X, Y, and Z axes into three color channels to precisely infer correlations among successive sensor signal values in three different dimensions. We experimentally evaluated our method using several well-known datasets and our own dataset collected from a smartphone and smartwatch. The proposed method shows higher accuracy than other state-of-the-art approaches on the tested datasets.

Sign in / Sign up

Export Citation Format

Share Document