scholarly journals Hybrid Techniques for Object Detection using Deep Learning

2020 ◽  
Vol 8 (6) ◽  
pp. 1959-1963
Keyword(s):  
Deep Learning ◽  
Object Detection ◽  
Lane Detection ◽  
Single Shot ◽  
Efficient Utilization ◽  
The Road ◽  
Detection Model ◽  
Hybrid Techniques ◽  
Geographical Regions ◽  
Improved Performance

Deep learning is a one of the major concept of Artificial Intelligence and Machine learning, which deals with the object detection task. On the other hand, a new targeted dataset is built according to commonly used existing datasets, and two networks called Single Shot Multi box Detector (SSD) and You Only Look Once (YOLO) are chosen to work on this new dataset. Through experimentation strengthen the understanding of these networks, and through the analysis of the results, learn the importance of targeted and inclusive datasets for deep learning. In addition, to this optimize the networks for efficient utilization when integrated with the necessary system or application. Further, explore the applications corresponding to these networks. The implementation includes two major concepts. The first concept is Object detection. Object detection is the process of object recognition and classification. There are several Training sets available online for training an object detection model. But the models are not trained to detect the same object from different geographical regions. The second concept is lane detection and steering suggestion. The model detects using the concept of radius or curvature of the road and also distance of the car from both the lane lines. Using these parameters it also gives steering suggestions such as move right or left by a certain distance. In addition to this it gives the distance and speed attributes of the surrounding objects such as cars, motorcycles, etc. Finally, the model developed is capable of detecting all the parameters required in order to be integrated and to create a self-driving car and it can be used efficiently in India. Using the above parameters that are obtained from the model the car can navigate through lanes in real-time. Its improved performance is due to the fact that it can detect road specific objects and because it is specifically trained for Indian roads.

Deep Learning Based Active Monitoring for Anti-collision between Vessels and Bridges

2019 ◽  
Author(s):  
Limu Chen ◽  
Ye Xia ◽  
Dexiong Pan ◽  
Chengbin Wang
Keyword(s):  
Decision Making ◽  
Deep Learning ◽  
Object Detection ◽  
Large Scale ◽  
Data Augmentation ◽  
Information Support ◽  
Single Shot ◽  
Active Monitoring ◽  
Detection Model ◽  
Comparison Results

<p>Deep-learning based navigational object detection is discussed with respect to active monitoring system for anti-collision between vessel and bridge. Motion based object detection method widely used in existing anti-collision monitoring systems is incompetent in dealing with complicated and changeable waterway for its limitations in accuracy, robustness and efficiency. The video surveillance system proposed contains six modules, including image acquisition, detection, tracking, prediction, risk evaluation and decision-making, and the detection module is discussed in detail. A vessel-exclusive dataset with tons of image samples is established for neural network training and a SSD (Single Shot MultiBox Detector) based object detection model with both universality and pertinence is generated attributing to tactics of sample filtering, data augmentation and large-scale optimization, which make it capable of stable and intelligent vessel detection. Comparison results with conventional methods indicate that the proposed deep-learning method shows remarkable advantages in robustness, accuracy, efficiency and intelligence. In-situ test is carried out at Songpu Bridge in Shanghai, and the results illustrate that the method is qualified for long-term monitoring and providing information support for further analysis and decision making.</p>

scholarly journals Design of Desktop Audiovisual Entertainment System with Deep Learning and Haptic Sensations

Symmetry ◽  
2020 ◽  
Vol 12 (10) ◽  
pp. 1718
Author(s):  
Chien-Hsing Chou ◽  
Yu-Sheng Su ◽  
Che-Ju Hsu ◽  
Kong-Chang Lee ◽  
Ping-Hsuan Han
Keyword(s):  
Deep Learning ◽  
Object Detection ◽  
User Experience ◽  
Recognition System ◽  
Scene Recognition ◽  
Single Shot ◽  
Auditory Signals ◽  
Hot Weather ◽  
Viewing Experience ◽  
At Home

In this study, we designed a four-dimensional (4D) audiovisual entertainment system called Sense. This system comprises a scene recognition system and hardware modules that provide haptic sensations for users when they watch movies and animations at home. In the scene recognition system, we used Google Cloud Vision to detect common scene elements in a video, such as fire, explosions, wind, and rain, and further determine whether the scene depicts hot weather, rain, or snow. Additionally, for animated videos, we applied deep learning with a single shot multibox detector to detect whether the animated video contained scenes of fire-related objects. The hardware module was designed to provide six types of haptic sensations set as line-symmetry to provide a better user experience. After the system considers the results of object detection via the scene recognition system, the system generates corresponding haptic sensations. The system integrates deep learning, auditory signals, and haptic sensations to provide an enhanced viewing experience.

scholarly journals Automatic Roadway Features Detection with Oriented Object Detection

2021 ◽  
Vol 11 (8) ◽  
pp. 3531
Author(s):  
Hesham M. Eraqi ◽  
Karim Soliman ◽  
Dalia Said ◽  
Omar R. Elezaby ◽  
Mohamed N. Moustafa ◽  
...  
Keyword(s):  
Object Detection ◽  
Safety Evaluation ◽  
Autonomous Driving ◽  
Detection Accuracy ◽  
The Road ◽  
Detection Model ◽  
Detection Approach ◽  
Roadway Safety ◽  
Safety Features ◽  
Oriented Object

Extensive research efforts have been devoted to identify and improve roadway features that impact safety. Maintaining roadway safety features relies on costly manual operations of regular road surveying and data analysis. This paper introduces an automatic roadway safety features detection approach, which harnesses the potential of artificial intelligence (AI) computer vision to make the process more efficient and less costly. Given a front-facing camera and a global positioning system (GPS) sensor, the proposed system automatically evaluates ten roadway safety features. The system is composed of an oriented (or rotated) object detection model, which solves an orientation encoding discontinuity problem to improve detection accuracy, and a rule-based roadway safety evaluation module. To train and validate the proposed model, a fully-annotated dataset for roadway safety features extraction was collected covering 473 km of roads. The proposed method baseline results are found encouraging when compared to the state-of-the-art models. Different oriented object detection strategies are presented and discussed, and the developed model resulted in improving the mean average precision (mAP) by 16.9% when compared with the literature. The roadway safety feature average prediction accuracy is 84.39% and ranges between 91.11% and 63.12%. The introduced model can pervasively enable/disable autonomous driving (AD) based on safety features of the road; and empower connected vehicles (CV) to send and receive estimated safety features, alerting drivers about black spots or relatively less-safe segments or roads.

Prediction of Crime Scene Objects Using Deep Learning

2021 ◽  
Vol 9 (VIII) ◽  
pp. 857-864
Author(s):  
Vibhavari B Rao
Keyword(s):  
Deep Learning ◽  
Object Detection ◽  
Computer Architecture ◽  
Real Time ◽  
Surveillance System ◽  
Crime Scene ◽  
Detection Model ◽  
Detection Algorithms ◽  
Performance Metric ◽  
Smart Surveillance

The crime rates today can inevitably put a civilian's life in danger. While consistent efforts are being made to alleviate crime, there is also a dire need to create a smart and proactive surveillance system. Our project implements a smart surveillance system that would alert the authorities in real-time when a crime is being committed. During armed robberies and hostage situations, most often, the police cannot reach the place on time to prevent it from happening, owing to the lag in communication between the informants of the crime scene and the police. We propose an object detection model that implements deep learning algorithms to detect objects of violence such as pistols, knives, rifles from video surveillance footage, and in turn send real-time alerts to the authorities. There are a number of object detection algorithms being developed, each being evaluated under the performance metric mAP. On implementing Faster R-CNN with ResNet 101 architecture we found the mAP score to be about 91%. However, the downside to this is the excessive training and inferencing time it incurs. On the other hand, YOLOv5 architecture resulted in a model that performed very well in terms of speed. Its training speed was found to be 0.012 s / image during training but naturally, the accuracy was not as high as Faster R-CNN. With good computer architecture, it can run at about 40 fps. Thus, there is a tradeoff between speed and accuracy and it's important to strike a balance. We use transfer learning to improve accuracy by training the model on our custom dataset. This project can be deployed on any generic CCTV camera by setting up a live RTSP (real-time streaming protocol) and streaming the footage on a laptop or desktop where the deep learning model is being run.

scholarly journals Comparison of Object Detection and Patch-Based Classification Deep Learning Models on Mid- to Late-Season Weed Detection in UAV Imagery

2020 ◽  
Vol 12 (13) ◽  
pp. 2136 ◽  
Author(s):  
Arun Narenthiran Veeranampalayam Sivakumar ◽  
Jiating Li ◽  
Stephen Scott ◽  
Eric Psota ◽  
Amit J. Jhala ◽  
...  
Keyword(s):  
Object Detection ◽  
Weed Management ◽  
Network Models ◽  
Detection Performance ◽  
Single Shot ◽  
Neural Network Models ◽  
Weed Detection ◽  
Late Season ◽  
Detection Model ◽  
Growing Seasons

Mid- to late-season weeds that escape from the routine early-season weed management threaten agricultural production by creating a large number of seeds for several future growing seasons. Rapid and accurate detection of weed patches in field is the first step of site-specific weed management. In this study, object detection-based convolutional neural network models were trained and evaluated over low-altitude unmanned aerial vehicle (UAV) imagery for mid- to late-season weed detection in soybean fields. The performance of two object detection models, Faster RCNN and the Single Shot Detector (SSD), were evaluated and compared in terms of weed detection performance using mean Intersection over Union (IoU) and inference speed. It was found that the Faster RCNN model with 200 box proposals had similar good weed detection performance to the SSD model in terms of precision, recall, f1 score, and IoU, as well as a similar inference time. The precision, recall, f1 score and IoU were 0.65, 0.68, 0.66 and 0.85 for Faster RCNN with 200 proposals, and 0.66, 0.68, 0.67 and 0.84 for SSD, respectively. However, the optimal confidence threshold of the SSD model was found to be much lower than that of the Faster RCNN model, which indicated that SSD might have lower generalization performance than Faster RCNN for mid- to late-season weed detection in soybean fields using UAV imagery. The performance of the object detection model was also compared with patch-based CNN model. The Faster RCNN model yielded a better weed detection performance than the patch-based CNN with and without overlap. The inference time of Faster RCNN was similar to patch-based CNN without overlap, but significantly less than patch-based CNN with overlap. Hence, Faster RCNN was found to be the best model in terms of weed detection performance and inference time among the different models compared in this study. This work is important in understanding the potential and identifying the algorithms for an on-farm, near real-time weed detection and management.

scholarly journals The Assisted Positioning Technology for High Speed Train Based on Deep Learning

2020 ◽  
Vol 10 (23) ◽  
pp. 8625
Author(s):  
Yali Song ◽  
Yinghong Wen
Keyword(s):  
Deep Learning ◽  
High Speed ◽  
Detection Method ◽  
Generative Adversarial Networks ◽  
Single Shot ◽  
High Speed Train ◽  
Data Set ◽  
Detection Model ◽  
Model Based ◽  
Cumulative Error

In the positioning process of a high-speed train, cumulative error may result in a reduction in the positioning accuracy. The assisted positioning technology based on kilometer posts can be used as an effective method to correct the cumulative error. However, the traditional detection method of kilometer posts is time-consuming and complex, which greatly affects the correction efficiency. Therefore, in this paper, a kilometer post detection model based on deep learning is proposed. Firstly, the Deep Convolutional Generative Adversarial Networks (DCGAN) algorithm is introduced to construct an effective kilometer post data set. This greatly reduces the cost of real data acquisition and provides a prerequisite for the construction of the detection model. Then, by using the existing optimization as a reference and further simplifying the design of the Single Shot multibox Detector (SSD) model according to the specific application scenario of this paper, the kilometer post detection model based on an improved SSD algorithm is established. Finally, from the analysis of the experimental results, we know that the detection model established in this paper ensures both detection accuracy and efficiency. The accuracy of our model reached 98.92%, while the detection time was only 35.43 ms. Thus, our model realizes the rapid and accurate detection of kilometer posts and improves the assisted positioning technology based on kilometer posts by optimizing the detection method.

scholarly journals Detecting Objects from Space: An Evaluation of Deep-Learning Modern Approaches

Electronics ◽  
2020 ◽  
Vol 9 (4) ◽  
pp. 583 ◽  
Author(s):  
Khang Nguyen ◽  
Nhut T. Huynh ◽  
Phat C. Nguyen ◽  
Khanh-Duy Nguyen ◽  
Nguyen D. Vo ◽  
...  
Keyword(s):  
Deep Learning ◽  
Object Detection ◽  
Unmanned Aircraft ◽  
Aerial Images ◽  
Great Success ◽  
Single Shot ◽  
Convolutional Networks ◽  
Image Pyramids ◽  
Fully Convolutional Networks ◽  
Wide Range

Unmanned aircraft systems or drones enable us to record or capture many scenes from the bird’s-eye view and they have been fast deployed to a wide range of practical domains, i.e., agriculture, aerial photography, fast delivery and surveillance. Object detection task is one of the core steps in understanding videos collected from the drones. However, this task is very challenging due to the unconstrained viewpoints and low resolution of captured videos. While deep-learning modern object detectors have recently achieved great success in general benchmarks, i.e., PASCAL-VOC and MS-COCO, the robustness of these detectors on aerial images captured by drones is not well studied. In this paper, we present an evaluation of state-of-the-art deep-learning detectors including Faster R-CNN (Faster Regional CNN), RFCN (Region-based Fully Convolutional Networks), SNIPER (Scale Normalization for Image Pyramids with Efficient Resampling), Single-Shot Detector (SSD), YOLO (You Only Look Once), RetinaNet, and CenterNet for the object detection in videos captured by drones. We conduct experiments on VisDrone2019 dataset which contains 96 videos with 39,988 annotated frames and provide insights into efficient object detectors for aerial images.

scholarly journals Vehicle Owner Recognition and Speed Estimation through LPD using Deep learning (VORSELD)

2021 ◽  
Vol 40 ◽  
pp. 01005
Author(s):  
Mudit Shrivastava ◽  
Rahul Jadhav ◽  
Pranjal Singhal ◽  
Savita R. Bhosale
Keyword(s):  
Deep Learning ◽  
Object Detection ◽  
License Plate ◽  
Speed Estimation ◽  
Moving Vehicle ◽  
Detection Model ◽  
Vehicle Owner ◽  
Made In

As name characterizes understanding of a number plate accordingly, from past decades the use vehicles expanded rapidly, taking into account of this such a majority number of issues like overseeing and controlling trafficante keeping watch on autos and managing parking area zones to overcome this tag recognizer programming is required. The proposed work aims to detect speed of a moving vehicle through its license plate. It will fetch vehicle owner details with the help of CNN model. In this project the main focus is to detect a moving car whenever it crosses dynamic markings. It uses Tensor-flow with an SSD object detection model to detect cars and from the detection in each frame the license plate gets detected and each vehicle can be tracked across a video and can be checked if it crossed the markings made in program itself and hence speed of that vehicle can be calculated. The detected License plate will be forwarded to trained model where PyTesseract is used, which will convert image to text.

Sign in / Sign up

Export Citation Format

Share Document