Pattern recognition techniques for the identification of Activities of Daily Living using mobile device accelerometer

This paper focuses on the recognition of Activities of Daily Living (ADL) applying pattern recognition techniques to the data acquired by the accelerometer available in the mobile devices. The recognition of ADL is composed by several stages, including data acquisition, data processing, and artificial intelligence methods. The artificial intelligence methods used are related to pattern recognition, and this study focuses on the use of Artificial Neural Networks (ANN). The data processing includes data cleaning, and the feature extraction techniques to define the inputs for the ANN. Due to the low processing power and memory of the mobile devices, they should be mainly used to acquire the data, applying an ANN previously trained for the identification of the ADL. The main purpose of this paper is to present a new method based on ANN for the identification of a defined set of ADL with a reliable accuracy. This paper also presents a comparison of different types of ANN in order to choose the type for the implementation of the final model. Results of this research probes that the best accuracies are achieved with Deep Neural Networks (DNN) with an accuracy higher than 80%. The results obtained are similar with other studies, but we compared tree types of ANN in order to discover the best method in order to obtain these results with less memory, verifying that, after the generation of the model, the DNN method, when compared with others, is also the fastest to obtain the results with better accuracy.

Download Full-text

Pattern recognition techniques for the identification of Activities of Daily Living using mobile device accelerometer

10.7287/peerj.preprints.27225 ◽

2019 ◽

Author(s):

Ivan Miguel Pires ◽

Nuno M. Garcia ◽

Nuno Pombo ◽

Francisco Flórez-Revuelta ◽

Susanna Spinsante ◽

...

Keyword(s):

Artificial Intelligence ◽

Neural Networks ◽

Pattern Recognition ◽

Data Processing ◽

Activities Of Daily Living ◽

Mobile Devices ◽

Daily Living ◽

Pattern Recognition Techniques ◽

Artificial Intelligence Methods ◽

Processing Power

This paper focuses on the recognition of Activities of Daily Living (ADL) applying pattern recognition techniques to the data acquired by the accelerometer available in the mobile devices. The recognition of ADL is composed by several stages, including data acquisition, data processing, and artificial intelligence methods. The artificial intelligence methods used are related to pattern recognition, and this study focuses on the use of Artificial Neural Networks (ANN). The data processing includes data cleaning, and the feature extraction techniques to define the inputs for the ANN. Due to the low processing power and memory of the mobile devices, they should be mainly used to acquire the data, applying an ANN previously trained for the identification of the ADL. The main purpose of this paper is to present a new method based on ANN for the identification of a defined set of ADL with a reliable accuracy. This paper also presents a comparison of different types of ANN in order to choose the type for the implementation of the final model. Results of this research probes that the best accuracies are achieved with Deep Neural Networks (DNN) with an accuracy higher than 80%. The results obtained are similar with other studies, but we compared tree types of ANN in order to discover the best method in order to obtain these results with less memory, verifying that, after the generation of the model, the DNN method, when compared with others, is also the fastest to obtain the results with better accuracy.

Download Full-text

Data Fusion on Motion and Magnetic Sensors embedded on Mobile Devices for the Identification of Activities of Daily Living

10.31224/osf.io/x4r5z ◽

2017 ◽

Cited By ~ 2

Author(s):

Ivan Miguel Serrano Pires ◽

Nuno M. Garcia ◽

Nuno Pombo ◽

Francisco Flórez-Revuelta ◽

Susanna Spinsante

Keyword(s):

Artificial Intelligence ◽

Neural Networks ◽

Data Fusion ◽

Activities Of Daily Living ◽

Mobile Devices ◽

Daily Living ◽

Magnetic Sensors ◽

Pattern Recognition Techniques ◽

Processing Data ◽

Artificial Intelligence Methods

Several types of sensors have been available in off-the-shelf mobile devices, including motion, magnetic, vision, acoustic, and location sensors. This paper focuses on the fusion of the data acquired from motion and magnetic sensors, i.e., accelerometer, gyroscope and magnetometer sensors, for the recognition of Activities of Daily Living (ADL) using pattern recognition techniques. The system developed in this study includes data acquisition, data processing, data fusion, and artificial intelligence methods. Artificial Neural Networks (ANN) are included in artificial intelligence methods, which are used in this study for the recognition of ADL. The purpose of this study is the creation of a new method using ANN for the identification of ADL, comparing three types of ANN, in order to achieve results with a reliable accuracy. The best accuracy was obtained with Deep Learning, which, after the application of the L2 regularization and normalization techniques on the sensors’ data, reports an accuracy of 89.51%.

Download Full-text

Pattern Recognition Techniques for the Identification of Activities of Daily Living Using a Mobile Device Accelerometer

Electronics ◽

10.3390/electronics9030509 ◽

2020 ◽

Vol 9 (3) ◽

pp. 509 ◽

Cited By ~ 8

Author(s):

Ivan Miguel Pires ◽

Gonçalo Marques ◽

Nuno M. Garcia ◽

Francisco Flórez-Revuelta ◽

Maria Canavarro Teixeira ◽

...

Keyword(s):

Neural Networks ◽

Pattern Recognition ◽

Activities Of Daily Living ◽

Mobile Devices ◽

Mobile Device ◽

Daily Living ◽

Accelerometer Data ◽

Pattern Recognition Techniques ◽

Multiple Sensors ◽

Computational Resources

The application of pattern recognition techniques to data collected from accelerometers available in off-the-shelf devices, such as smartphones, allows for the automatic recognition of activities of daily living (ADLs). This data can be used later to create systems that monitor the behaviors of their users. The main contribution of this paper is to use artificial neural networks (ANN) for the recognition of ADLs with the data acquired from the sensors available in mobile devices. Firstly, before ANN training, the mobile device is used for data collection. After training, mobile devices are used to apply an ANN previously trained for the ADLs’ identification on a less restrictive computational platform. The motivation is to verify whether the overfitting problem can be solved using only the accelerometer data, which also requires less computational resources and reduces the energy expenditure of the mobile device when compared with the use of multiple sensors. This paper presents a method based on ANN for the recognition of a defined set of ADLs. It provides a comparative study of different implementations of ANN to choose the most appropriate method for ADLs identification. The results show the accuracy of 85.89% using deep neural networks (DNN).

Download Full-text

Approach for the Development of a Framework for the Identification of Activities of Daily Living Using Mobile Devices’ Sensors

10.20944/preprints201801.0068.v1 ◽

2018 ◽

Cited By ~ 1

Author(s):

Ivan Miguel Pires ◽

Nuno M. Garcia ◽

Nuno Pombo ◽

Francisco Flórez-Revuelta ◽

Susanna Spinsante

Keyword(s):

Machine Learning ◽

Pattern Recognition ◽

Data Fusion ◽

Data Processing ◽

Activities Of Daily Living ◽

Mobile Devices ◽

Daily Living ◽

Automatic Identification ◽

Internet Connection ◽

Processing Data

Sensors available on mobile devices allow the automatic identification of Activities of Daily Living (ADL). This paper describes an approach for the creation of a framework for the identification of ADL, taking in account several concepts, including data acquisition, data processing, data fusion, pattern recognition, and machine learning. These concepts can be mapped in a module of the framework, including the use and creation of several algorithms. For the development of a framework that works in several conditions, e.g., without Internet connection, these algorithms should take in account the hardware and software limitations of the mobile devices to run all main tasks locally. The main purpose of this paper is related to the presentation the sensors, algorithms, and architecture of the proposed approach.

Download Full-text

AN AUTO-PICKING STACKING VELOCITY ALGORITHM BASED ON AN AI AND PR APPROACH

International Journal of Pattern Recognition and Artificial Intelligence ◽

10.1142/s0218001489000097 ◽

1989 ◽

Vol 03 (01) ◽

pp. 103-111

Author(s):

L. WU ◽

Z. LUO ◽

J. ZHOU ◽

H. WANG

Keyword(s):

Artificial Intelligence ◽

Pattern Recognition ◽

Data Processing ◽

Seismic Data ◽

Seismic Data Processing ◽

Pattern Recognition Techniques ◽

Automatic Algorithm

Stacking velocity is a very important parameter in seismic data processing. Until now the determination of stacking velocity has been done manually. This article proposes an automatic algorithm for picking stacking velocity. The algorithm uses artificial intelligence and pattern recognition techniques.

Download Full-text

From Data Acquisition to Data Fusion: A Comprehensive Review and a Roadmap for the Identification of Activities of Daily Living Using Mobile Devices

Sensors ◽

10.3390/s16020184 ◽

2016 ◽

Vol 16 (2) ◽

pp. 184 ◽

Cited By ~ 77

Author(s):

Ivan Pires ◽

Nuno Garcia ◽

Nuno Pombo ◽

Francisco Flórez-Revuelta

Keyword(s):

Data Fusion ◽

Activities Of Daily Living ◽

Mobile Devices ◽

Daily Living ◽

State Of The Art ◽

The State ◽

Sensor Data ◽

Battery Life ◽

Sensor Data Fusion ◽

Processing Power

This paper focuses on the research on the state of the art for sensor fusion techniques, applied to the sensors embedded in mobile devices, as a means to help identify the mobile device user’s daily activities. Sensor data fusion techniques are used to consolidate the data collected from several sensors, increasing the reliability of the algorithms for the identification of the different activities. However, mobile devices have several constraints, e.g., low memory, low battery life and low processing power, and some data fusion techniques are not suited to this scenario. The main purpose of this paper is to present an overview of the state of the art to identify examples of sensor data fusion techniques that can be applied to the sensors available in mobile devices aiming to identify activities of daily living (ADLs).

Download Full-text

Multi-Sensor Mobile Platform for the Recognition of Activities of Daily Living and their Environments based on Artificial Neural Networks

Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence ◽

10.24963/ijcai.2018/859 ◽

2018 ◽

Author(s):

Ivan Miguel Pires ◽

Nuno Pombo ◽

Nuno M. Garcia ◽

Francisco Flórez-Revuelta

Keyword(s):

Neural Networks ◽

Activities Of Daily Living ◽

Mobile Devices ◽

Global Positioning System ◽

Mobile Application ◽

Daily Living ◽

Deep Neural Networks ◽

Gps Receiver ◽

Processing Data ◽

Global Positioning

The recognition of Activities of Daily Living (ADL) and their environments based on sensors available in off-the-shelf mobile devices is an emerging topic. These devices are capable to acquire and process the sensors' data for the correct recognition of the ADL and their environments, providing a fast and reliable feedback to the user. However, the methods implemented in a mobile application for this purpose should be adapted to the low resources of these devices. This paper focuses on the demonstration of a mobile application that implements a framework, that forks their implementation in several modules, including data acquisition, data processing, data fusion and classification methods based on the sensors? data acquired from the accelerometer, gyroscope, magnetometer, microphone and Global Positioning System (GPS) receiver. The framework presented is a function of the number of sensors available in the mobile devices and implements the classification with Deep Neural Networks (DNN) that reports an accuracy between 58.02% and 89.15%.

Download Full-text

Recognition of Activities of Daily Living and Environments Using Acoustic Sensors Embedded on Mobile Devices

Electronics ◽

10.3390/electronics8121499 ◽

2019 ◽

Vol 8 (12) ◽

pp. 1499 ◽

Cited By ~ 11

Author(s):

Ivan Miguel Pires ◽

Gonçalo Marques ◽

Nuno M. Garcia ◽

Nuno Pombo ◽

Francisco Flórez-Revuelta ◽

...

Keyword(s):

Neural Networks ◽

Activities Of Daily Living ◽

Mobile Devices ◽

Daily Living ◽

Feedforward Neural Networks ◽

Magnetic Sensors ◽

Acoustic Sensors ◽

Environment Recognition ◽

The One ◽

Classification Procedures

The identification of Activities of Daily Living (ADL) is intrinsic with the user’s environment recognition. This detection can be executed through standard sensors present in every-day mobile devices. On the one hand, the main proposal is to recognize users’ environment and standing activities. On the other hand, these features are included in a framework for the ADL and environment identification. Therefore, this paper is divided into two parts—firstly, acoustic sensors are used for the collection of data towards the recognition of the environment and, secondly, the information of the environment recognized is fused with the information gathered by motion and magnetic sensors. The environment and ADL recognition are performed by pattern recognition techniques that aim for the development of a system, including data collection, processing, fusion and classification procedures. These classification techniques include distinctive types of Artificial Neural Networks (ANN), analyzing various implementations of ANN and choosing the most suitable for further inclusion in the following different stages of the developed system. The results present 85.89% accuracy using Deep Neural Networks (DNN) with normalized data for the ADL recognition and 86.50% accuracy using Feedforward Neural Networks (FNN) with non-normalized data for environment recognition. Furthermore, the tests conducted present 100% accuracy for standing activities recognition using DNN with normalized data, which is the most suited for the intended purpose.

Download Full-text

Android Library for Recognition of Activities of Daily Living: Implementation Considerations, Challenges, and Solutions

The Open Bioinformatics Journal ◽

10.2174/1875036201811010061 ◽

2018 ◽

Vol 11 (1) ◽

pp. 61-88 ◽

Cited By ~ 11

Author(s):

Ivan Miguel Pires ◽

Maria Canavarro Teixeira ◽

Nuno Pombo ◽

Nuno M. Garcia ◽

Francisco Flórez-Revuelta ◽

...

Keyword(s):

Data Processing ◽

Activities Of Daily Living ◽

Mobile Devices ◽

Assisted Living ◽

Daily Living ◽

Ambient Assisted Living ◽

Living Room ◽

Fusion Data ◽

Student’S T ◽

Cleaning Methods

Background:Off-the-shelf-mobile devices have several sensors available onboard that may be used for the recognition of Activities of Daily Living (ADL) and the environments where they are performed. This research is focused on the development of Ambient Assisted Living (AAL) systems, using mobile devices for the acquisition of the different types of data related to the physical and physiological conditions of the subjects and the environments. Mobile devices with the Android Operating Systems are the least expensive and exhibit the biggest market while providing a variety of models and onboard sensors.Objective:This paper describes the implementation considerations, challenges and solutions about a framework for the recognition of ADL and the environments, provided as an Android library. The framework is a function of the number of sensors available in different mobile devices and utilizes a variety of activity recognition algorithms to provide a rapid feedback to the user.Methods:The Android library includes data fusion, data processing, features engineering and classification methods. The sensors that may be used are the accelerometer, the gyroscope, the magnetometer, the Global Positioning System (GPS) receiver and the microphone. The data processing includes the application of data cleaning methods and the extraction of features, which are used with Deep Neural Networks (DNN) for the classification of ADL and environment. Throughout this work, the limitations of the mobile devices were explored and their effects have been minimized.Results:The implementation of the Android library reported an overall accuracy between 58.02% and 89.15%, depending on the number of sensors used and the number of ADL and environments recognized. Compared with the results available in the literature, the performance of the library reported a mean improvement of 2.93%, and they do not differ at the maximum found in prior work, that based on the Student’s t-test.Conclusion:This study proves that ADL like walking, going upstairs and downstairs, running, watching TV, driving, sleeping and standing activities, and the bedroom, cooking/kitchen, gym, classroom, hall, living room, bar, library and street environments may be recognized with the sensors available in off-the-shelf mobile devices. Finally, these results may act as a preliminary research for the development of a personal digital life coach with a multi-sensor mobile device commonly used daily.

Download Full-text