scholarly journals Low-cost intelligent surveillance system based on fast CNN

2021 ◽  
Vol 7 ◽  
pp. e402
Author(s):  
Zaid Saeb Sabri ◽  
Zhiyong Li
Keyword(s):  
Neural Network ◽  
Real Time ◽  
Tracking System ◽  
Low Cost ◽  
Saliency Detection ◽  
Detection Algorithm ◽  
Raspberry Pi ◽  
Surveillance Systems ◽  
Single Board Computer ◽  
Computational Systems

Smart surveillance systems are used to monitor specific areas, such as homes, buildings, and borders, and these systems can effectively detect any threats. In this work, we investigate the design of low-cost multiunit surveillance systems that can control numerous surveillance cameras to track multiple objects (i.e., people, cars, and guns) and promptly detect human activity in real time using low computational systems, such as compact or single board computers. Deep learning techniques are employed to detect certain objects to surveil homes/buildings and recognize suspicious and vital events to ensure that the system can alarm officers of relevant events, such as stranger intrusions, the presence of guns, suspicious movements, and identified fugitives. The proposed model is tested on two computational systems, specifically, a single board computer (Raspberry Pi) with the Raspbian OS and a compact computer (Intel NUC) with the Windows OS. In both systems, we employ components, such as a camera to stream real-time video and an ultrasonic sensor to alarm personnel of threats when movement is detected in restricted areas or near walls. The system program is coded in Python, and a convolutional neural network (CNN) is used to perform recognition. The program is optimized by using a foreground object detection algorithm to improve recognition in terms of both accuracy and speed. The saliency algorithm is used to slice certain required objects from scenes, such as humans, cars, and airplanes. In this regard, two saliency algorithms, based on local and global patch saliency detection are considered. We develop a system that combines two saliency approaches and recognizes the features extracted using these saliency techniques with a conventional neural network. The field results demonstrate a significant improvement in detection, ranging between 34% and 99.9% for different situations. The low percentage is related to the presence of unclear objects or activities that are different from those involving humans. However, even in the case of low accuracy, recognition and threat identification are performed with an accuracy of 100% in approximately 0.7 s, even when using computer systems with relatively weak hardware specifications, such as a single board computer (Raspberry Pi). These results prove that the proposed system can be practically used to design a low-cost and intelligent security and tracking system.

scholarly journals Deep Learning-Based Portable Device for Audio Distress Signal Recognition in Urban Areas

2020 ◽  
Vol 10 (21) ◽  
pp. 7448
Author(s):  
Jorge Felipe Gaviria ◽  
Alejandra Escalante-Perez ◽  
Juan Camilo Castiblanco ◽  
Nicolas Vergara ◽  
Valentina Parra-Garces ◽  
...  
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Real Time ◽  
Urban Areas ◽  
Low Cost ◽  
Raspberry Pi ◽  
Automatic Identification ◽  
Signal Recognition ◽  
Main Challenge

Real-time automatic identification of audio distress signals in urban areas is a task that in a smart city can improve response times in emergency alert systems. The main challenge in this problem lies in finding a model that is able to accurately recognize these type of signals in the presence of background noise and allows for real-time processing. In this paper, we present the design of a portable and low-cost device for accurate audio distress signal recognition in real urban scenarios based on deep learning models. As real audio distress recordings in urban areas have not been collected and made publicly available so far, we first constructed a database where audios were recorded in urban areas using a low-cost microphone. Using this database, we trained a deep multi-headed 2D convolutional neural network that processed temporal and frequency features to accurately recognize audio distress signals in noisy environments with a significant performance improvement to other methods from the literature. Then, we deployed and assessed the trained convolutional neural network model on a Raspberry Pi that, along with the low-cost microphone, constituted a device for accurate real-time audio recognition. Source code and database are publicly available.

scholarly journals A Low-cost Artificial Neural Network Model for Raspberry Pi

2020 ◽  
Vol 10 (2) ◽  
pp. 5466-5469 ◽  
Author(s):  
S. N. Truong
Keyword(s):  
Neural Network ◽  
Object Recognition ◽  
Embedded System ◽  
Real Time ◽  
Image Recognition ◽  
Low Cost ◽  
Recognition Rate ◽  
Raspberry Pi ◽  
The Neural Network ◽  
Binary Array

In this paper, a ternary neural network with complementary binary arrays is proposed for representing the signed synaptic weights. The proposed ternary neural network is deployed on a low-cost Raspberry Pi board embedded system for the application of speech and image recognition. In conventional neural networks, the signed synaptic weights of –1, 0, and 1 are represented by 8-bit integers. To reduce the amount of required memory for signed synaptic weights, the signed values were represented by a complementary binary array. For the binary inputs, the multiplication of two binary numbers is replaced by the bit-wise AND operation to speed up the performance of the neural network. Regarding image recognition, the MINST dataset was used for training and testing of the proposed neural network. The recognition rate was as high as 94%. The proposed ternary neural network was applied to real-time object recognition. The recognition rate for recognizing 10 simple objects captured from the camera was 89%. The proposed ternary neural network with the complementary binary array for representing the signed synaptic weights can reduce the required memory for storing the model’s parameters and internal parameters by 75%. The proposed ternary neural network is 4.2, 2.7, and 2.4 times faster than the conventional ternary neural network for MNIST image recognition, speech commands recognition, and real-time object recognition respectively.

Low-Cost Smart Heads-Up Display Assist System for Automobiles

2021 ◽  
Vol 7 (2) ◽  
Author(s):  
Gautham G ◽  
Deepika Venkatesh ◽  
A. Kalaiselvi
Keyword(s):  
Fuel Economy ◽  
Low Cost ◽  
Detection Algorithm ◽  
Lane Detection ◽  
Raspberry Pi ◽  
Worst Case ◽  
The Road ◽  
Traffic Conditions ◽  
Metropolitan Cities ◽  
Ingenious Method

In recent years, due to the increasing density of traffic every year, it is been a hassle for drivers in metropolitan cities to maintain lane and speeds on road. The drivers usually waste time and effort in idling their cars to maintain in traffic conditions. The drivers get easily frustrated when they tried to maintain the path because of the havoc created. Transportation Institute found that the odds of a crash(or near crash) more than doubled when the driver took his or her eyes off the road formore than two seconds. This tends to cause about 23% of accidents when not following their lane paths. In worst case the fuel economy often drops and tends to cause increase in pollution about 28% to 36% per vehicle annually. This corresponds to the wastage of fuel. Owing to this problem, we proposed an ingenious method by which the lane detection can be made affordable and applicable to existing automobiles. The proposed prototype of lane detection is carried over with a temporary autonomous bot which is interfaced with Raspberry pi processor, loaded with the lane detection algorithm. This prototype bot is made to get live video which is then processed by the algorithm. Also, the preliminary setups are carried over in such a way that it is easily implemented and accessible at low cost with better efficiency, providing a better impact on future automobiles.

scholarly journals A Portable Fuzzy Driver Drowsiness Estimation System

Sensors ◽  
2020 ◽  
Vol 20 (15) ◽  
pp. 4093
Author(s):  
Alimed Celecia ◽  
Karla Figueiredo ◽  
Marley Vellasco ◽  
René González
Keyword(s):  
Real Time ◽  
Traffic Accidents ◽  
Fuzzy Inference ◽  
Low Cost ◽  
Raspberry Pi ◽  
Inference System ◽  
Visual Occlusion ◽  
Computational Performance ◽  
Estimation System ◽  
Definition Of

The adequate automatic detection of driver fatigue is a very valuable approach for the prevention of traffic accidents. Devices that can determine drowsiness conditions accurately must inherently be portable, adaptable to different vehicles and drivers, and robust to conditions such as illumination changes or visual occlusion. With the advent of a new generation of computationally powerful embedded systems such as the Raspberry Pi, a new category of real-time and low-cost portable drowsiness detection systems could become standard tools. Usually, the proposed solutions using this platform are limited to the definition of thresholds for some defined drowsiness indicator or the application of computationally expensive classification models that limits their use in real-time. In this research, we propose the development of a new portable, low-cost, accurate, and robust drowsiness recognition device. The proposed device combines complementary drowsiness measures derived from a temporal window of eyes (PERCLOS, ECD) and mouth (AOT) states through a fuzzy inference system deployed in a Raspberry Pi with the capability of real-time response. The system provides three degrees of drowsiness (Low-Normal State, Medium-Drowsy State, and High-Severe Drowsiness State), and was assessed in terms of its computational performance and efficiency, resulting in a significant accuracy of 95.5% in state recognition that demonstrates the feasibility of the approach.

scholarly journals Real-time object tracking system based on field-programmable gate array and convolution neural network

2016 ◽  
Vol 14 (1) ◽  
pp. 172988141668270 ◽  
Author(s):  
Congyi Lyu ◽  
Haoyao Chen ◽  
Xin Jiang ◽  
Peng Li ◽  
Yunhui Liu
Keyword(s):  
Neural Network ◽  
Image Processing ◽  
Object Tracking ◽  
Real Time ◽  
Field Programmable Gate Array ◽  
Tracking System ◽  
Convolution Neural Network ◽  
Processing Unit ◽  
Field Programmable ◽  
Gate Array

Vision-based object tracking has lots of applications in robotics, like surveillance, navigation, motion capturing, and so on. However, the existing object tracking systems still suffer from the challenging problem of high computation consumption in the image processing algorithms. The problem can prevent current systems from being used in many robotic applications which have limitations of payload and power, for example, micro air vehicles. In these applications, the central processing unit- or graphics processing unit-based computers are not good choices due to the high weight and power consumption. To address the problem, this article proposed a real-time object tracking system based on field-programmable gate array, convolution neural network, and visual servo technology. The time-consuming image processing algorithms, such as distortion correction, color space convertor, and Sobel edge, Harris corner features detector, and convolution neural network were redesigned using the programmable gates in field-programmable gate array. Based on the field-programmable gate array-based image processing, an image-based visual servo controller was designed to drive a two degree of freedom manipulator to track the target in real time. Finally, experiments on the proposed system were performed to illustrate the effectiveness of the real-time object tracking system.

Sign in / Sign up

Export Citation Format

Share Document