scholarly journals DOLARS, a Distributed On-Line Activity Recognition System by Means of Heterogeneous Sensors in Real-Life Deployments—A Case Study in the Smart Lab of The University of Almería

Sensors ◽  
2021 ◽  
Vol 21 (2) ◽  
pp. 405
Author(s):  
Marcos Lupión ◽  
Javier Medina-Quero ◽  
Juan F. Sanjuan ◽  
Pilar M. Ortigosa
Keyword(s):  
Real Time ◽  
Activity Recognition ◽  
Real Life ◽  
Recognition System ◽  
Machine Learning Algorithms ◽  
Sensor Data ◽  
Heterogeneous Sensors ◽  
On Line ◽  
The University

Activity Recognition (AR) is an active research topic focused on detecting human actions and behaviours in smart environments. In this work, we present the on-line activity recognition platform DOLARS (Distributed On-line Activity Recognition System) where data from heterogeneous sensors are evaluated in real time, including binary, wearable and location sensors. Different descriptors and metrics from the heterogeneous sensor data are integrated in a common feature vector whose extraction is developed by a sliding window approach under real-time conditions. DOLARS provides a distributed architecture where: (i) stages for processing data in AR are deployed in distributed nodes, (ii) temporal cache modules compute metrics which aggregate sensor data for computing feature vectors in an efficient way; (iii) publish-subscribe models are integrated both to spread data from sensors and orchestrate the nodes (communication and replication) for computing AR and (iv) machine learning algorithms are used to classify and recognize the activities. A successful case study of daily activities recognition developed in the Smart Lab of The University of Almería (UAL) is presented in this paper. Results present an encouraging performance in recognition of sequences of activities and show the need for distributed architectures to achieve real time recognition.

scholarly journals Activity Recognition for IoT Devices Using Fuzzy Spatio-Temporal Features as Environmental Sensor Fusion

Sensors ◽  
2019 ◽  
Vol 19 (16) ◽  
pp. 3512 ◽  
Author(s):  
Miguel Ángel López Medina ◽  
Macarena Espinilla ◽  
Cristiano Paggeti ◽  
Javier Medina Quero
Keyword(s):  
Fuzzy Logic ◽  
Activity Recognition ◽  
Heterogeneous Sensors ◽  
Temporal Features ◽  
Constant Change ◽  
Environmental Sensor ◽  
Spatio Temporal ◽  
Iot Devices ◽  
The University

The IoT describes a development field where new approaches and trends are in constant change. In this scenario, new devices and sensors are offering higher precision in everyday life in an increasingly less invasive way. In this work, we propose the use of spatial-temporal features by means of fuzzy logic as a general descriptor for heterogeneous sensors. This fuzzy sensor representation is highly efficient and enables devices with low computing power to develop learning and evaluation tasks in activity recognition using light and efficient classifiers. To show the methodology’s potential in real applications, we deploy an intelligent environment where new UWB location devices, inertial objects, wearable devices, and binary sensors are connected with each other and describe daily human activities. We then apply the proposed fuzzy logic-based methodology to obtain spatial-temporal features to fuse the data from the heterogeneous sensor devices. A case study developed in the UJAmISmart Lab of the University of Jaen (Jaen, Spain) shows the encouraging performance of the methodology when recognizing the activity of an inhabitant using efficient classifiers.

scholarly journals Zero-Shot Human Activity Recognition Using Non-Visual Sensors

Sensors ◽  
2020 ◽  
Vol 20 (3) ◽  
pp. 825 ◽  
Author(s):  
Fadi Al Machot ◽  
Mohammed R. Elkobaisi ◽  
Kyandoghere Kyamakya
Keyword(s):  
Activity Recognition ◽  
High Performance ◽  
Real Life ◽  
Machine Learning Algorithms ◽  
Training Data ◽  
Sensor Data ◽  
Sensor Technology ◽  
Training Dataset ◽  
Data Sets ◽  
Data Set

Due to significant advances in sensor technology, studies towards activity recognition have gained interest and maturity in the last few years. Existing machine learning algorithms have demonstrated promising results by classifying activities whose instances have been already seen during training. Activity recognition methods based on real-life settings should cover a growing number of activities in various domains, whereby a significant part of instances will not be present in the training data set. However, to cover all possible activities in advance is a complex and expensive task. Concretely, we need a method that can extend the learning model to detect unseen activities without prior knowledge regarding sensor readings about those previously unseen activities. In this paper, we introduce an approach to leverage sensor data in discovering new unseen activities which were not present in the training set. We show that sensor readings can lead to promising results for zero-shot learning, whereby the necessary knowledge can be transferred from seen to unseen activities by using semantic similarity. The evaluation conducted on two data sets extracted from the well-known CASAS datasets show that the proposed zero-shot learning approach achieves a high performance in recognizing unseen (i.e., not present in the training dataset) new activities.

Innovative real-time sensing of flow dynamics in groundwater and sediments to map contaminant spreading

2021 ◽  
Author(s):  
Goedele Verreydt ◽  
Niels Van Putte ◽  
Timothy De Kleyn ◽  
Joris Cool ◽  
Bino Maiheu
Keyword(s):  
Surface Water ◽  
Groundwater Flow ◽  
Real Time ◽  
Flow Direction ◽  
Flow Dynamics ◽  
Sensor Data ◽  
Time Data ◽  
Mass Fluxes ◽  
First Case

<p>Groundwater dynamics play a crucial role in the spreading of a soil and groundwater contamination. However, there is still a big gap in the understanding of the groundwater flow dynamics. Heterogeneities and dynamics are often underestimated and therefore not taken into account. They are of crucial input for successful management and remediation measures. The bulk of the mass of mass often is transported through only a small layer or section within the aquifer and is in cases of seepage into surface water very dependent to rainfall and occurring tidal effects.</p><p> </p><p>This study contains the use of novel real-time iFLUX sensors to map the groundwater flow dynamics over time. The sensors provide real-time data on groundwater flow rate and flow direction. The sensor probes consist of multiple bidirectional flow sensors that are superimposed. The probes can be installed directly in the subsoil, riverbed or monitoring well. The measurement setup is unique as it can perform measurements every second, ideal to map rapid changing flow conditions. The measurement range is between 0,5 and 500 cm per day.</p><p> </p><p>We will present the measurement principles and technical aspects of the sensor, together with two case studies.</p><p> </p><p>The first case study comprises the installation of iFLUX sensors in 4 different monitoring wells in a chlorinated solvent plume to map on the one hand the flow patterns in the plume, and on the other hand the flow dynamics that are influenced by the nearby popular trees. The foreseen remediation concept here is phytoremediation. The sensors were installed for a period of in total 4 weeks. Measurement frequency was 5 minutes. The flow profiles and time series will be presented together with the determined mass fluxes.</p><p> </p><p>A second case study was performed on behalf of the remediation of a canal riverbed. Due to industrial production of tar and carbon black in the past, the soil and groundwater next to the small canal ‘De Lieve’ in Ghent, Belgium, got contaminated with aliphatic and (poly)aromatic hydrocarbons. The groundwater contaminants migrate to the canal, impact the surface water quality and cause an ecological risk. The seepage flow and mass fluxes of contaminants into the surface water were measured with the novel iFLUX streambed sensors, installed directly in the river sediment. A site conceptual model was drawn and dimensioned based on the sensor data. The remediation concept to tackle the inflowing pollution: a hydraulic conductive reactive mat on the riverbed that makes use of the natural draining function of the waterbody, the adsorption capacity of a natural or secondary adsorbent and a future habitat for micro-organisms that biodegrade contaminants. The reactive mats were successfully installed and based on the mass flux calculations a lifespan of at least 10 years is expected for the adsorption material.  </p>

scholarly journals Self-Adaptive Multi-Sensor Activity Recognition Systems Based on Gaussian Mixture Models

Informatics ◽  
2018 ◽  
Vol 5 (3) ◽  
pp. 38 ◽  
Author(s):  
Martin Jänicke ◽  
Bernhard Sick ◽  
Sven Tomforde
Keyword(s):  
Activity Recognition ◽  
Gaussian Mixture Models ◽  
Gaussian Mixture ◽  
Recognition System ◽  
Training Data ◽  
Sensor Data ◽  
Activity Data ◽  
High Loss ◽  
New Sensors ◽  
Self Adaptive

Personal wearables such as smartphones or smartwatches are increasingly utilized in everyday life. Frequently, activity recognition is performed on these devices to estimate the current user status and trigger automated actions according to the user’s needs. In this article, we focus on the creation of a self-adaptive activity recognition system based on IMU that includes new sensors during runtime. Starting with a classifier based on GMM, the density model is adapted to new sensor data fully autonomously by issuing the marginalization property of normal distributions. To create a classifier from that, label inference is done, either based on the initial classifier or based on the training data. For evaluation, we used more than 10 h of annotated activity data from the publicly available PAMAP2 benchmark dataset. Using the data, we showed the feasibility of our approach and performed 9720 experiments, to get resilient numbers. One approach performed reasonably well, leading to a system improvement on average, with an increase in the F-score of 0.0053, while the other one shows clear drawbacks due to a high loss of information during label inference. Furthermore, a comparison with state of the art techniques shows the necessity for further experiments in this area.

scholarly journals Multimodal Sensor Data Fusion for Activity Recognition Using Filtered Classifier

Proceedings ◽  
2018 ◽  
Vol 2 (19) ◽  
pp. 1262 ◽  
Author(s):  
Muhammad Razzaq ◽  
Ian Cleland ◽  
Chris Nugent ◽  
Sungyoung Lee
Keyword(s):  
Activity Recognition ◽  
Confusion Matrix ◽  
Machine Learning Algorithms ◽  
Training Data ◽  
Sensor Data ◽  
Test Dataset ◽  
Sensory Data ◽  
Multimodal Sensors ◽  
Imbalanced Class Distribution ◽  
Single Modality

Activity recognition (AR) is a subtask in pervasive computing and context-aware systems, which presents the physical state of human in real-time. These systems offer a new dimension to the widely spread applications by fusing recognized activities obtained from the raw sensory data generated by the obtrusive as well as unobtrusive revolutionary digital technologies. In recent years, an exponential growth has been observed for AR technologies and much literature exists focusing on applying machine learning algorithms on obtrusive single modality sensor devices. However, University of Jaén Ambient Intelligence (UJAmI), a Smart Lab in Spain has initiated a 1st UCAmI Cup challenge by sharing aforementioned varieties of the sensory data in order to recognize the human activities in the smart environment. This paper presents the fusion, both at the feature level and decision level for multimodal sensors by preprocessing and predicting the activities within the context of training and test datasets. Though it achieves 94% accuracy for training data and 47% accuracy for test data. However, this study further evaluates post-confusion matrix also and draws a conclusion for various discrepancies such as imbalanced class distribution within the training and test dataset. Additionally, this study also highlights challenges associated with the datasets for which, could improve further analysis.

Dynamic Data-Driven Spatiotemporal System Behavior Prediction With Simulations and Sensor Measurement Data

2018 ◽  
Author(s):  
Xiangxue Zhao ◽  
Shapour Azarm ◽  
Balakumar Balachandran
Keyword(s):  
Dynamical System ◽  
Real Time ◽  
Measurement Data ◽  
Data Driven ◽  
Sensor Data ◽  
Model Parameters ◽  
High Fidelity ◽  
System Behavior ◽  
Sensor Measurement

Online prediction of dynamical system behavior based on a combination of simulation data and sensor measurement data has numerous applications. Examples include predicting safe flight configurations, forecasting storms and wildfire spread, estimating railway track and pipeline health conditions. In such applications, high-fidelity simulations may be used to accurately predict a system’s dynamical behavior offline (“non-real time”). However, due to the computational expense, these simulations have limited usage for online (“real-time”) prediction of a system’s behavior. To remedy this, one possible approach is to allocate a significant portion of the computational effort to obtain data through offline simulations. The obtained offline data can then be combined with online sensor measurements for online estimation of the system’s behavior with comparable accuracy as the off-line, high-fidelity simulation. The main contribution of this paper is in the construction of a fast data-driven spatiotemporal prediction framework that can be used to estimate general parametric dynamical system behavior. This is achieved through three steps. First, high-order singular value decomposition is applied to map high-dimensional offline simulation datasets into a subspace. Second, Gaussian processes are constructed to approximate model parameters in the subspace. Finally, reduced-order particle filtering is used to assimilate sparsely located sensor data to further improve the prediction. The effectiveness of the proposed approach is demonstrated through a case study. In this case study, aeroelastic response data obtained for an aircraft through simulations is integrated with measurement data obtained from a few sparsely located sensors. Through this case study, the authors show that along with dynamic enhancement of the state estimates, one can also realize a reduction in uncertainty of the estimates.

scholarly journals Real-Time Facial Emotion Recognition Framework for Employees of Organizations Using Raspberry-Pi

2021 ◽  
Vol 11 (22) ◽  
pp. 10540
Author(s):  
Navjot Rathour ◽  
Zeba Khanam ◽  
Anita Gehlot ◽  
Rajesh Singh ◽  
Mamoon Rashid ◽  
...  
Keyword(s):  
Emotion Recognition ◽  
Real Time ◽  
Real Life ◽  
Recognition System ◽  
Facial Emotion Recognition ◽  
Facial Emotion ◽  
Raspberry Pi ◽  
Input Device ◽  
Facial Emotions ◽  
Deep Network

There is a significant interest in facial emotion recognition in the fields of human–computer interaction and social sciences. With the advancements in artificial intelligence (AI), the field of human behavioral prediction and analysis, especially human emotion, has evolved significantly. The most standard methods of emotion recognition are currently being used in models deployed in remote servers. We believe the reduction in the distance between the input device and the server model can lead us to better efficiency and effectiveness in real life applications. For the same purpose, computational methodologies such as edge computing can be beneficial. It can also encourage time-critical applications that can be implemented in sensitive fields. In this study, we propose a Raspberry-Pi based standalone edge device that can detect real-time facial emotions. Although this edge device can be used in variety of applications where human facial emotions play an important role, this article is mainly crafted using a dataset of employees working in organizations. A Raspberry-Pi-based standalone edge device has been implemented using the Mini-Xception Deep Network because of its computational efficiency in a shorter time compared to other networks. This device has achieved 100% accuracy for detecting faces in real time with 68% accuracy, i.e., higher than the accuracy mentioned in the state-of-the-art with the FER 2013 dataset. Future work will implement a deep network on Raspberry-Pi with an Intel Movidious neural compute stick to reduce the processing time and achieve quick real time implementation of the facial emotion recognition system.

scholarly journals IoT Notary : Attestable Sensor Data Capture in IoT Environments

2022 ◽  
Vol 3 (1) ◽  
pp. 1-30
Author(s):  
Nisha Panwar ◽  
Shantanu Sharma ◽  
Guoxi Wang ◽  
Sharad Mehrotra ◽  
Nalini Venkatasubramanian ◽  
...  
Keyword(s):  
Real Time ◽  
Location Based Services ◽  
Third Party ◽  
Sensor Data ◽  
Published Data ◽  
Resource Limited ◽  
User Data ◽  
Data Capturing ◽  
Iot Devices ◽  
The University

Contemporary IoT environments, such as smart buildings, require end-users to trust data-capturing rules published by the systems. There are several reasons why such a trust is misplaced—IoT systems may violate the rules deliberately or IoT devices may transfer user data to a malicious third-party due to cyberattacks, leading to the loss of individuals’ privacy or service integrity. To address such concerns, we propose IoT Notary , a framework to ensure trust in IoT systems and applications. IoT Notary provides secure log sealing on live sensor data to produce a verifiable “proof-of-integrity,” based on which a verifier can attest that captured sensor data adhere to the published data-capturing rules. IoT Notary is an integral part of TIPPERS, a smart space system that has been deployed at the University of California, Irvine to provide various real-time location-based services on the campus. We present extensive experiments over real-time WiFi connectivity data to evaluate IoT Notary , and the results show that IoT Notary imposes nominal overheads. The secure logs only take 21% more storage, while users can verify their one day’s data in less than 2 s even using a resource-limited device.

INSPIRE sustainability internships

2019 ◽  
Vol 20 (3) ◽  
pp. 452-469 ◽  
Author(s):  
Carolyn Susan Hayles
Keyword(s):  
Small Sample Size ◽  
Real Life ◽  
Small Sample ◽  
Multiple Sources ◽  
Student Body ◽  
Content Type ◽  
Study Approach ◽  
Life Context ◽  
The University

Purpose This paper aims to explore the outputs of an internship programme, one of a number of campus-based sustainability activities that have been introduced at the University of Wales, Trinity Saint David, to encourage student-led campus-based greening initiatives. Design/methodology/approach A case study approach was undertaken, allowing the researcher to investigate the programme in its real-life context. The researcher used multiple sources of evidence to gain as holistic a picture as possible. Findings Interns report positive changes in their behaviours towards sustainability, s well as encouraging feedback on their experiential learning, the development of their soft skills and the creation of new knowledge. Moreover, students communicated perceived benefits for their future careers. The reported outcomes reflect mutually beneficial relationships for student and institution, for example, raising the profile of campus greening activities and supporting the University’s aim to embed sustainability throughout its campus, community and culture. Research limitations/implications The researcher recognises the limitations of the research, in particular, the small sample size, which has resulted primarily in qualitative results being presented. Practical implications Feedback from previous interns will be used to shape future internships. In particular, Institute of Sustainable Practice, Innovation and Resource Effectiveness (INSPIRE) will look for opportunities to work more closely with University operations, departments, faculties and alongside University staff, both academic and support staff. Social implications Following student feedback, INSPIRE will give students opportunities for wider involvement, including an opportunity to propose their own projects to shape future internships that meet the needs of student body on campus. Originality/value Despite being one case study from one institution, the research highlights the value of such programmes for other institutions.

Sign in / Sign up

Export Citation Format

Share Document