scholarly journals Real-Time Littering Activity Monitoring Based on Image Classification Method

Smart Cities ◽  
2021 ◽  
Vol 4 (4) ◽  
pp. 1496-1518
Author(s):  
Nyayu Latifah Husni ◽  
Putri Adelia Rahmah Sari ◽  
Ade Silvia Handayani ◽  
Tresna Dewi ◽  
Seyed Amin Hosseini Seno ◽  
...  

This paper describes the implementation of real time human activity recognition systems in public areas. The objective of the study is to develop an alarm system to identify people who do not care for their surrounding environment. In this research, the actions recognized are limited to littering activity using two methods, i.e., CNN and CNN-LSTM. The proposed system captures, classifies, and recognizes the activity by using two main components, a namely camera and mini-PC. The proposed system was implemented in two locations, i.e., Sekanak River and the mini garden near the Sekanak market. It was able to recognize the littering activity successfully. Based on the proposed model, the validation results from the prediction of the testing data in simulation show a loss value of 70% and an accuracy value of 56% for CNN of model 8 that used 500 epochs and a loss value of 10.61%, and an accuracy value of 97% for CNN-LSTM that used 100 epochs. For real experiment of CNN model 8, it is obtained 66.7% and 75% success for detecting littering activity at mini garden and Sekanak River respectively, while using CNN-LSTM in real experiment sequentially gives 94.4% and 100% success for mini garden and Sekanak river.

2011 ◽  
pp. 130-174
Author(s):  
Burak Ozer ◽  
Tiehan Lv ◽  
Wayne Wolf

This chapter focuses on real-time processing techniques for the reconstruction of visual information from multiple views and its analysis for human detection and gesture and activity recognition. It presents a review of the main components of three-dimensional visual processing techniques and visual analysis of multiple cameras, i.e., projection of three-dimensional models onto two-dimensional images and three-dimensional visual reconstruction from multiple images. It discusses real-time aspects of these techniques and shows how these aspects affect the software and hardware architectures. Furthermore, the authors present their multiple-camera system to investigate the relationship between the activity recognition algorithms and the architectures required to perform these tasks in real time. The chapter describes the proposed activity recognition method that consists of a distributed algorithm and a data fusion scheme for two and three-dimensional visual analysis, respectively. The authors analyze the available data independencies for this algorithm and discuss the potential architectures to exploit the parallelism resulting from these independencies.


Sensors ◽  
2018 ◽  
Vol 18 (11) ◽  
pp. 3726 ◽  
Author(s):  
Bandar Almaslukh ◽  
Abdel Artoli ◽  
Jalal Al-Muhtadi

Recently, modern smartphones equipped with a variety of embedded-sensors, such as accelerometers and gyroscopes, have been used as an alternative platform for human activity recognition (HAR), since they are cost-effective, unobtrusive and they facilitate real-time applications. However, the majority of the related works have proposed a position-dependent HAR, i.e., the target subject has to fix the smartphone in a pre-defined position. Few studies have tackled the problem of position-independent HAR. They have tackled the problem either using handcrafted features that are less influenced by the position of the smartphone or by building a position-aware HAR. The performance of these studies still needs more improvement to produce a reliable smartphone-based HAR. Thus, in this paper, we propose a deep convolution neural network model that provides a robust position-independent HAR system. We build and evaluate the performance of the proposed model using the RealWorld HAR public dataset. We find that our deep learning proposed model increases the overall performance compared to the state-of-the-art traditional machine learning method from 84% to 88% for position-independent HAR. In addition, the position detection performance of our model improves superiorly from 89% to 98%. Finally, the recognition time of the proposed model is evaluated in order to validate the applicability of the model for real-time applications.


1994 ◽  
Vol 33 (01) ◽  
pp. 60-63 ◽  
Author(s):  
E. J. Manders ◽  
D. P. Lindstrom ◽  
B. M. Dawant

Abstract:On-line intelligent monitoring, diagnosis, and control of dynamic systems such as patients in intensive care units necessitates the context-dependent acquisition, processing, analysis, and interpretation of large amounts of possibly noisy and incomplete data. The dynamic nature of the process also requires a continuous evaluation and adaptation of the monitoring strategy to respond to changes both in the monitored patient and in the monitoring equipment. Moreover, real-time constraints may imply data losses, the importance of which has to be minimized. This paper presents a computer architecture designed to accomplish these tasks. Its main components are a model and a data abstraction module. The model provides the system with a monitoring context related to the patient status. The data abstraction module relies on that information to adapt the monitoring strategy and provide the model with the necessary information. This paper focuses on the data abstraction module and its interaction with the model.


Author(s):  
Kyungkoo Jun

Background & Objective: This paper proposes a Fourier transform inspired method to classify human activities from time series sensor data. Methods: Our method begins by decomposing 1D input signal into 2D patterns, which is motivated by the Fourier conversion. The decomposition is helped by Long Short-Term Memory (LSTM) which captures the temporal dependency from the signal and then produces encoded sequences. The sequences, once arranged into the 2D array, can represent the fingerprints of the signals. The benefit of such transformation is that we can exploit the recent advances of the deep learning models for the image classification such as Convolutional Neural Network (CNN). Results: The proposed model, as a result, is the combination of LSTM and CNN. We evaluate the model over two data sets. For the first data set, which is more standardized than the other, our model outperforms previous works or at least equal. In the case of the second data set, we devise the schemes to generate training and testing data by changing the parameters of the window size, the sliding size, and the labeling scheme. Conclusion: The evaluation results show that the accuracy is over 95% for some cases. We also analyze the effect of the parameters on the performance.


Sensors ◽  
2020 ◽  
Vol 20 (6) ◽  
pp. 1633 ◽  
Author(s):  
Beom-Su Kim ◽  
Sangdae Kim ◽  
Kyong Hoon Kim ◽  
Tae-Eung Sung ◽  
Babar Shah ◽  
...  

Many applications are able to obtain enriched information by employing a wireless multimedia sensor network (WMSN) in industrial environments, which consists of nodes that are capable of processing multimedia data. However, as many aspects of WMSNs still need to be refined, this remains a potential research area. An efficient application needs the ability to capture and store the latest information about an object or event, which requires real-time multimedia data to be delivered to the sink timely. Motivated to achieve this goal, we developed a new adaptive QoS routing protocol based on the (m,k)-firm model. The proposed model processes captured information by employing a multimedia stream in the (m,k)-firm format. In addition, the model includes a new adaptive real-time protocol and traffic handling scheme to transmit event information by selecting the next hop according to the flow status as well as the requirement of the (m,k)-firm model. Different from the previous approach, two level adjustment in routing protocol and traffic management are able to increase the number of successful packets within the deadline as well as path setup schemes along the previous route is able to reduce the packet loss until a new path is established. Our simulation results demonstrate that the proposed schemes are able to improve the stream dynamic success ratio and network lifetime compared to previous work by meeting the requirement of the (m,k)-firm model regardless of the amount of traffic.


Polymers ◽  
2021 ◽  
Vol 13 (9) ◽  
pp. 1393
Author(s):  
Xiaochang Duan ◽  
Hongwei Yuan ◽  
Wei Tang ◽  
Jingjing He ◽  
Xuefei Guan

This study develops a general temperature-dependent stress–strain constitutive model for polymer-bonded composite materials, allowing for the prediction of deformation behaviors under tension and compression in the testing temperature range. Laboratory testing of the material specimens in uniaxial tension and compression at multiple temperatures ranging from −40 ∘C to 75 ∘C is performed. The testing data reveal that the stress–strain response can be divided into two general regimes, namely, a short elastic part followed by the plastic part; therefore, the Ramberg–Osgood relationship is proposed to build the stress–strain constitutive model at a single temperature. By correlating the model parameters with the corresponding temperature using a response surface, a general temperature-dependent stress–strain constitutive model is established. The effectiveness and accuracy of the proposed model are validated using several independent sets of testing data and third-party data. The performance of the proposed model is compared with an existing reference model. The validation and comparison results show that the proposed model has a lower number of parameters and yields smaller relative errors. The proposed constitutive model is further implemented as a user material routine in a finite element package. A simple structural example using the developed user material is presented and its accuracy is verified.


Sensors ◽  
2021 ◽  
Vol 21 (2) ◽  
pp. 405
Author(s):  
Marcos Lupión ◽  
Javier Medina-Quero ◽  
Juan F. Sanjuan ◽  
Pilar M. Ortigosa

Activity Recognition (AR) is an active research topic focused on detecting human actions and behaviours in smart environments. In this work, we present the on-line activity recognition platform DOLARS (Distributed On-line Activity Recognition System) where data from heterogeneous sensors are evaluated in real time, including binary, wearable and location sensors. Different descriptors and metrics from the heterogeneous sensor data are integrated in a common feature vector whose extraction is developed by a sliding window approach under real-time conditions. DOLARS provides a distributed architecture where: (i) stages for processing data in AR are deployed in distributed nodes, (ii) temporal cache modules compute metrics which aggregate sensor data for computing feature vectors in an efficient way; (iii) publish-subscribe models are integrated both to spread data from sensors and orchestrate the nodes (communication and replication) for computing AR and (iv) machine learning algorithms are used to classify and recognize the activities. A successful case study of daily activities recognition developed in the Smart Lab of The University of Almería (UAL) is presented in this paper. Results present an encouraging performance in recognition of sequences of activities and show the need for distributed architectures to achieve real time recognition.


Polymers ◽  
2021 ◽  
Vol 13 (14) ◽  
pp. 2353
Author(s):  
Xiaochang Duan ◽  
Hongwei Yuan ◽  
Wei Tang ◽  
Jingjing He ◽  
Xuefei Guan

This study develops a unified phenomenological creep model for polymer-bonded composite materials, allowing for predicting the creep behavior in the three creep stages, namely the primary, the secondary, and the tertiary stages under sustained compressive stresses. Creep testing is performed using material specimens under several conditions with a temperature range of 20 °C–50 °C and a compressive stress range of 15 MPa–25 MPa. The testing data reveal that the strain rate–time response exhibits the transient, steady, and unstable stages under each of the testing conditions. A rational function-based creep rate equation is proposed to describe the full creep behavior under each of the testing conditions. By further correlating the resulting model parameters with temperature and stress and developing a Larson–Miller parameter-based rupture time prediction model, a unified phenomenological model is established. An independent validation dataset and third-party testing data are used to verify the effectiveness and accuracy of the proposed model. The performance of the proposed model is compared with that of an existing reference model. The verification and comparison results show that the model can describe all the three stages of the creep process, and the proposed model outperforms the reference model by yielding 28.5% smaller root mean squared errors on average.


Sign in / Sign up

Export Citation Format

Share Document