scholarly journals Gimme Signals: Discriminative signal encoding for multimodal activity recognition

Author(s):  
Raphael Memmesheimer ◽  
Nick Theisen ◽  
Dietrich Paulus
Sensors ◽  
2018 ◽  
Vol 18 (11) ◽  
pp. 3910 ◽  
Author(s):  
Taeho Hur ◽  
Jaehun Bang ◽  
Thien Huynh-The ◽  
Jongwon Lee ◽  
Jee-In Kim ◽  
...  

The most significant barrier to success in human activity recognition is extracting and selecting the right features. In traditional methods, the features are chosen by humans, which requires the user to have expert knowledge or to do a large amount of empirical study. Newly developed deep learning technology can automatically extract and select features. Among the various deep learning methods, convolutional neural networks (CNNs) have the advantages of local dependency and scale invariance and are suitable for temporal data such as accelerometer (ACC) signals. In this paper, we propose an efficient human activity recognition method, namely Iss2Image (Inertial sensor signal to Image), a novel encoding technique for transforming an inertial sensor signal into an image with minimum distortion and a CNN model for image-based activity classification. Iss2Image converts real number values from the X, Y, and Z axes into three color channels to precisely infer correlations among successive sensor signal values in three different dimensions. We experimentally evaluated our method using several well-known datasets and our own dataset collected from a smartphone and smartwatch. The proposed method shows higher accuracy than other state-of-the-art approaches on the tested datasets.


2014 ◽  
Vol 134 (3) ◽  
pp. 332-337 ◽  
Author(s):  
Jun Goto ◽  
Takuya Kidokoro ◽  
Tomohiro Ogura ◽  
Satoshi Suzuki

Author(s):  
Arijit Chowdhury ◽  
Taniya Das ◽  
Smriti Rani ◽  
Anwesha Khasnobish ◽  
Tapas Chakravarty

Author(s):  
Chandni ◽  
Alok Kumar Singh Kushwaha ◽  
Jagwinder Kaur Dhillon

2020 ◽  
Author(s):  
Anis Davoudi ◽  
Mamoun T. Mardini ◽  
Dave Nelson ◽  
Fahd Albinali ◽  
Sanjay Ranka ◽  
...  

BACKGROUND Research shows the feasibility of human activity recognition using Wearable accelerometer devices. Different studies have used varying number and placement for data collection using the sensors. OBJECTIVE To compare accuracy performance between multiple and variable placement of accelerometer devices in categorizing the type of physical activity and corresponding energy expenditure in older adults. METHODS Participants (n=93, 72.2±7.1 yrs) completed a total of 32 activities of daily life in a laboratory setting. Activities were classified as sedentary vs. non-sedentary, locomotion vs. non-locomotion, and lifestyle vs. non-lifestyle activities (e.g. leisure walk vs. computer work). A portable metabolic unit was worn during each activity to measure metabolic equivalents (METs). Accelerometers were placed on five different body positions: wrist, hip, ankle, upper arm, and thigh. Accelerometer data from each body position and combinations of positions were used in developing Random Forest models to assess activity category recognition accuracy and MET estimation. RESULTS Model performance for both MET estimation and activity category recognition strengthened with additional accelerometer devices. However, a single accelerometer on the ankle, upper arm, hip, thigh, or wrist had only a 0.03 to 0.09 MET increase in prediction error as compared to wearing all five devices. Balanced accuracy showed similar trends with slight decreases in balanced accuracy for detection of locomotion (0-0.01 METs), sedentary (0.13-0.05 METs) and lifestyle activities (0.08-0.04 METs) compared to all five placements. The accuracy of recognizing activity categories increased with additional placements (0.15-0.29). Notably, the hip was the best single body position for MET estimation and activity category recognition. CONCLUSIONS Additional accelerometer devices only slightly enhance activity recognition accuracy and MET estimation in older adults. However, given the extra burden of wearing additional devices, single accelerometers with appropriate placement appear to be sufficient for estimating energy expenditure and activity category recognition in older adults.


Sign in / Sign up

Export Citation Format

Share Document