scholarly journals Approach for the Development of a Framework for the Identification of Activities of Daily Living Using Mobile Devices’ Sensors

2018 ◽  
Author(s):  
Ivan Miguel Pires ◽  
Nuno M. Garcia ◽  
Nuno Pombo ◽  
Francisco Flórez-Revuelta ◽  
Susanna Spinsante
Keyword(s):  
Machine Learning ◽  
Pattern Recognition ◽  
Data Fusion ◽  
Data Processing ◽  
Activities Of Daily Living ◽  
Mobile Devices ◽  
Daily Living ◽  
Automatic Identification ◽  
Internet Connection ◽  
Processing Data

Sensors available on mobile devices allow the automatic identification of Activities of Daily Living (ADL). This paper describes an approach for the creation of a framework for the identification of ADL, taking in account several concepts, including data acquisition, data processing, data fusion, pattern recognition, and machine learning. These concepts can be mapped in a module of the framework, including the use and creation of several algorithms. For the development of a framework that works in several conditions, e.g., without Internet connection, these algorithms should take in account the hardware and software limitations of the mobile devices to run all main tasks locally. The main purpose of this paper is related to the presentation the sensors, algorithms, and architecture of the proposed approach.

scholarly journals Pattern recognition techniques for the identification of Activities of Daily Living using mobile device accelerometer

2018 ◽  
Author(s):  
Ivan Miguel Pires ◽  
Nuno M. Garcia ◽  
Nuno Pombo ◽  
Francisco Flórez-Revuelta ◽  
Susanna Spinsante ◽  
...  
Keyword(s):  
Artificial Intelligence ◽  
Neural Networks ◽  
Pattern Recognition ◽  
Data Processing ◽  
Activities Of Daily Living ◽  
Mobile Devices ◽  
Daily Living ◽  
Pattern Recognition Techniques ◽  
Artificial Intelligence Methods ◽  
Processing Power

This paper focuses on the recognition of Activities of Daily Living (ADL) applying pattern recognition techniques to the data acquired by the accelerometer available in the mobile devices. The recognition of ADL is composed by several stages, including data acquisition, data processing, and artificial intelligence methods. The artificial intelligence methods used are related to pattern recognition, and this study focuses on the use of Artificial Neural Networks (ANN). The data processing includes data cleaning, and the feature extraction techniques to define the inputs for the ANN. Due to the low processing power and memory of the mobile devices, they should be mainly used to acquire the data, applying an ANN previously trained for the identification of the ADL. The main purpose of this paper is to present a new method based on ANN for the identification of a defined set of ADL with a reliable accuracy. This paper also presents a comparison of different types of ANN in order to choose the type for the implementation of the final model. Results of this research probes that the best accuracies are achieved with Deep Neural Networks (DNN) with an accuracy higher than 80%. The results obtained are similar with other studies, but we compared tree types of ANN in order to discover the best method in order to obtain these results with less memory, verifying that, after the generation of the model, the DNN method, when compared with others, is also the fastest to obtain the results with better accuracy.

scholarly journals Pattern recognition techniques for the identification of Activities of Daily Living using mobile device accelerometer

2019 ◽  
Author(s):  
Ivan Miguel Pires ◽  
Nuno M. Garcia ◽  
Nuno Pombo ◽  
Francisco Flórez-Revuelta ◽  
Susanna Spinsante ◽  
...  
Keyword(s):  
Artificial Intelligence ◽  
Neural Networks ◽  
Pattern Recognition ◽  
Data Processing ◽  
Activities Of Daily Living ◽  
Mobile Devices ◽  
Daily Living ◽  
Pattern Recognition Techniques ◽  
Artificial Intelligence Methods ◽  
Processing Power

This paper focuses on the recognition of Activities of Daily Living (ADL) applying pattern recognition techniques to the data acquired by the accelerometer available in the mobile devices. The recognition of ADL is composed by several stages, including data acquisition, data processing, and artificial intelligence methods. The artificial intelligence methods used are related to pattern recognition, and this study focuses on the use of Artificial Neural Networks (ANN). The data processing includes data cleaning, and the feature extraction techniques to define the inputs for the ANN. Due to the low processing power and memory of the mobile devices, they should be mainly used to acquire the data, applying an ANN previously trained for the identification of the ADL. The main purpose of this paper is to present a new method based on ANN for the identification of a defined set of ADL with a reliable accuracy. This paper also presents a comparison of different types of ANN in order to choose the type for the implementation of the final model. Results of this research probes that the best accuracies are achieved with Deep Neural Networks (DNN) with an accuracy higher than 80%. The results obtained are similar with other studies, but we compared tree types of ANN in order to discover the best method in order to obtain these results with less memory, verifying that, after the generation of the model, the DNN method, when compared with others, is also the fastest to obtain the results with better accuracy.

scholarly journals Pattern recognition techniques for the identification of Activities of Daily Living using mobile device accelerometer

2019 ◽  
Author(s):  
Ivan Miguel Pires ◽  
Nuno M. Garcia ◽  
Nuno Pombo ◽  
Francisco Flórez-Revuelta ◽  
Susanna Spinsante ◽  
...  
Keyword(s):  
Artificial Intelligence ◽  
Neural Networks ◽  
Pattern Recognition ◽  
Data Processing ◽  
Activities Of Daily Living ◽  
Mobile Devices ◽  
Daily Living ◽  
Pattern Recognition Techniques ◽  
Artificial Intelligence Methods ◽  
Processing Power

This paper focuses on the recognition of Activities of Daily Living (ADL) applying pattern recognition techniques to the data acquired by the accelerometer available in the mobile devices. The recognition of ADL is composed by several stages, including data acquisition, data processing, and artificial intelligence methods. The artificial intelligence methods used are related to pattern recognition, and this study focuses on the use of Artificial Neural Networks (ANN). The data processing includes data cleaning, and the feature extraction techniques to define the inputs for the ANN. Due to the low processing power and memory of the mobile devices, they should be mainly used to acquire the data, applying an ANN previously trained for the identification of the ADL. The main purpose of this paper is to present a new method based on ANN for the identification of a defined set of ADL with a reliable accuracy. This paper also presents a comparison of different types of ANN in order to choose the type for the implementation of the final model. Results of this research probes that the best accuracies are achieved with Deep Neural Networks (DNN) with an accuracy higher than 80%. The results obtained are similar with other studies, but we compared tree types of ANN in order to discover the best method in order to obtain these results with less memory, verifying that, after the generation of the model, the DNN method, when compared with others, is also the fastest to obtain the results with better accuracy.

scholarly journals Data Fusion on Motion and Magnetic Sensors embedded on Mobile Devices for the Identification of Activities of Daily Living

2017 ◽  
Author(s):  
Ivan Miguel Serrano Pires ◽  
Nuno M. Garcia ◽  
Nuno Pombo ◽  
Francisco Flórez-Revuelta ◽  
Susanna Spinsante
Keyword(s):  
Artificial Intelligence ◽  
Neural Networks ◽  
Data Fusion ◽  
Activities Of Daily Living ◽  
Mobile Devices ◽  
Daily Living ◽  
Magnetic Sensors ◽  
Pattern Recognition Techniques ◽  
Processing Data ◽  
Artificial Intelligence Methods

Several types of sensors have been available in off-the-shelf mobile devices, including motion, magnetic, vision, acoustic, and location sensors. This paper focuses on the fusion of the data acquired from motion and magnetic sensors, i.e., accelerometer, gyroscope and magnetometer sensors, for the recognition of Activities of Daily Living (ADL) using pattern recognition techniques. The system developed in this study includes data acquisition, data processing, data fusion, and artificial intelligence methods. Artificial Neural Networks (ANN) are included in artificial intelligence methods, which are used in this study for the recognition of ADL. The purpose of this study is the creation of a new method using ANN for the identification of ADL, comparing three types of ANN, in order to achieve results with a reliable accuracy. The best accuracy was obtained with Deep Learning, which, after the application of the L2 regularization and normalization techniques on the sensors’ data, reports an accuracy of 89.51%.

scholarly journals From Data Acquisition to Data Fusion: A Comprehensive Review and a Roadmap for the Identification of Activities of Daily Living Using Mobile Devices

Sensors ◽  
2016 ◽  
Vol 16 (2) ◽  
pp. 184 ◽  
Author(s):  
Ivan Pires ◽  
Nuno Garcia ◽  
Nuno Pombo ◽  
Francisco Flórez-Revuelta
Keyword(s):  
Data Fusion ◽  
Activities Of Daily Living ◽  
Mobile Devices ◽  
Daily Living ◽  
State Of The Art ◽  
The State ◽  
Sensor Data ◽  
Battery Life ◽  
Sensor Data Fusion ◽  
Processing Power

This paper focuses on the research on the state of the art for sensor fusion techniques, applied to the sensors embedded in mobile devices, as a means to help identify the mobile device user’s daily activities. Sensor data fusion techniques are used to consolidate the data collected from several sensors, increasing the reliability of the algorithms for the identification of the different activities. However, mobile devices have several constraints, e.g., low memory, low battery life and low processing power, and some data fusion techniques are not suited to this scenario. The main purpose of this paper is to present an overview of the state of the art to identify examples of sensor data fusion techniques that can be applied to the sensors available in mobile devices aiming to identify activities of daily living (ADLs).

scholarly journals Pattern Recognition Techniques for the Identification of Activities of Daily Living Using a Mobile Device Accelerometer

Electronics ◽  
2020 ◽  
Vol 9 (3) ◽  
pp. 509 ◽  
Author(s):  
Ivan Miguel Pires ◽  
Gonçalo Marques ◽  
Nuno M. Garcia ◽  
Francisco Flórez-Revuelta ◽  
Maria Canavarro Teixeira ◽  
...  
Keyword(s):  
Neural Networks ◽  
Pattern Recognition ◽  
Activities Of Daily Living ◽  
Mobile Devices ◽  
Mobile Device ◽  
Daily Living ◽  
Accelerometer Data ◽  
Pattern Recognition Techniques ◽  
Multiple Sensors ◽  
Computational Resources

The application of pattern recognition techniques to data collected from accelerometers available in off-the-shelf devices, such as smartphones, allows for the automatic recognition of activities of daily living (ADLs). This data can be used later to create systems that monitor the behaviors of their users. The main contribution of this paper is to use artificial neural networks (ANN) for the recognition of ADLs with the data acquired from the sensors available in mobile devices. Firstly, before ANN training, the mobile device is used for data collection. After training, mobile devices are used to apply an ANN previously trained for the ADLs’ identification on a less restrictive computational platform. The motivation is to verify whether the overfitting problem can be solved using only the accelerometer data, which also requires less computational resources and reduces the energy expenditure of the mobile device when compared with the use of multiple sensors. This paper presents a method based on ANN for the recognition of a defined set of ADLs. It provides a comparative study of different implementations of ANN to choose the most appropriate method for ADLs identification. The results show the accuracy of 85.89% using deep neural networks (DNN).

scholarly journals Multi-Sensor Mobile Platform for the Recognition of Activities of Daily Living and their Environments based on Artificial Neural Networks

2018 ◽  
Author(s):  
Ivan Miguel Pires ◽  
Nuno Pombo ◽  
Nuno M. Garcia ◽  
Francisco Flórez-Revuelta
Keyword(s):  
Neural Networks ◽  
Activities Of Daily Living ◽  
Mobile Devices ◽  
Global Positioning System ◽  
Mobile Application ◽  
Daily Living ◽  
Deep Neural Networks ◽  
Gps Receiver ◽  
Processing Data ◽  
Global Positioning

The recognition of Activities of Daily Living (ADL) and their environments based on sensors available in off-the-shelf mobile devices is an emerging topic. These devices are capable to acquire and process the sensors' data for the correct recognition of the ADL and their environments, providing a fast and reliable feedback to the user. However, the methods implemented in a mobile application for this purpose should be adapted to the low resources of these devices. This paper focuses on the demonstration of a mobile application that implements a framework, that forks their implementation in several modules, including data acquisition, data processing, data fusion and classification methods based on the sensors? data acquired from the accelerometer, gyroscope, magnetometer, microphone and Global Positioning System (GPS) receiver. The framework presented is a function of the number of sensors available in the mobile devices and implements the classification with Deep Neural Networks (DNN) that reports an accuracy between 58.02% and 89.15%.

scholarly journals Activities of Daily Living and Environment Recognition Using Mobile Devices: A Comparative Study

Electronics ◽  
2020 ◽  
Vol 9 (1) ◽  
pp. 180 ◽  
Author(s):  
José M. Ferreira ◽  
Ivan Miguel Pires ◽  
Gonçalo Marques ◽  
Nuno M. García ◽  
Eftim Zdravevski ◽  
...  
Keyword(s):  
Activities Of Daily Living ◽  
Mobile Devices ◽  
Daily Living ◽  
Living Room ◽  
Complex Data ◽  
Machine Learning Method ◽  
Nearest Neighbour ◽  
Processing Data ◽  
Network Methods ◽  
Environment Recognition

The recognition of Activities of Daily Living (ADL) using the sensors available in off-the-shelf mobile devices with high accuracy is significant for the development of their framework. Previously, a framework that comprehends data acquisition, data processing, data cleaning, feature extraction, data fusion, and data classification was proposed. However, the results may be improved with the implementation of other methods. Similar to the initial proposal of the framework, this paper proposes the recognition of eight ADL, e.g., walking, running, standing, going upstairs, going downstairs, driving, sleeping, and watching television, and nine environments, e.g., bar, hall, kitchen, library, street, bedroom, living room, gym, and classroom, but using the Instance Based k-nearest neighbour (IBk) and AdaBoost methods as well. The primary purpose of this paper is to find the best machine learning method for ADL and environment recognition. The results obtained show that IBk and AdaBoost reported better results, with complex data than the deep neural network methods.

scholarly journals Identification of activities of daily living through data fusion on motion and magnetic sensors embedded on mobile devices

2018 ◽  
Vol 47 ◽  
pp. 78-93 ◽  
Author(s):  
Ivan Miguel Pires ◽  
Nuno M. Garcia ◽  
Nuno Pombo ◽  
Francisco Flórez-Revuelta ◽  
Susanna Spinsante ◽  
...  
Keyword(s):  
Data Fusion ◽  
Activities Of Daily Living ◽  
Mobile Devices ◽  
Daily Living ◽  
Magnetic Sensors

scholarly journals Android Library for Recognition of Activities of Daily Living: Implementation Considerations, Challenges, and Solutions

2018 ◽  
Vol 11 (1) ◽  
pp. 61-88 ◽  
Author(s):  
Ivan Miguel Pires ◽  
Maria Canavarro Teixeira ◽  
Nuno Pombo ◽  
Nuno M. Garcia ◽  
Francisco Flórez-Revuelta ◽  
...  
Keyword(s):  
Data Processing ◽  
Activities Of Daily Living ◽  
Mobile Devices ◽  
Assisted Living ◽  
Daily Living ◽  
Ambient Assisted Living ◽  
Living Room ◽  
Fusion Data ◽  
Student’S T ◽  
Cleaning Methods

Background:Off-the-shelf-mobile devices have several sensors available onboard that may be used for the recognition of Activities of Daily Living (ADL) and the environments where they are performed. This research is focused on the development of Ambient Assisted Living (AAL) systems, using mobile devices for the acquisition of the different types of data related to the physical and physiological conditions of the subjects and the environments. Mobile devices with the Android Operating Systems are the least expensive and exhibit the biggest market while providing a variety of models and onboard sensors.Objective:This paper describes the implementation considerations, challenges and solutions about a framework for the recognition of ADL and the environments, provided as an Android library. The framework is a function of the number of sensors available in different mobile devices and utilizes a variety of activity recognition algorithms to provide a rapid feedback to the user.Methods:The Android library includes data fusion, data processing, features engineering and classification methods. The sensors that may be used are the accelerometer, the gyroscope, the magnetometer, the Global Positioning System (GPS) receiver and the microphone. The data processing includes the application of data cleaning methods and the extraction of features, which are used with Deep Neural Networks (DNN) for the classification of ADL and environment. Throughout this work, the limitations of the mobile devices were explored and their effects have been minimized.Results:The implementation of the Android library reported an overall accuracy between 58.02% and 89.15%, depending on the number of sensors used and the number of ADL and environments recognized. Compared with the results available in the literature, the performance of the library reported a mean improvement of 2.93%, and they do not differ at the maximum found in prior work, that based on the Student’s t-test.Conclusion:This study proves that ADL like walking, going upstairs and downstairs, running, watching TV, driving, sleeping and standing activities, and the bedroom, cooking/kitchen, gym, classroom, hall, living room, bar, library and street environments may be recognized with the sensors available in off-the-shelf mobile devices. Finally, these results may act as a preliminary research for the development of a personal digital life coach with a multi-sensor mobile device commonly used daily.

Sign in / Sign up

Export Citation Format

Share Document