scholarly journals ISSD: Improved SSD for Insulator and Spacer Online Detection Based on UAV System

Sensors ◽  
2020 ◽  
Vol 20 (23) ◽  
pp. 6961
Author(s):  
Xuan Liu ◽  
Yong Li ◽  
Feng Shuang ◽  
Fang Gao ◽  
Xiang Zhou ◽  
...  
Keyword(s):  
Capture Rate ◽  
Aerial Images ◽  
Detection Accuracy ◽  
Single Shot ◽  
Online Detection ◽  
Feature Maps ◽  
Fast Detection ◽  
Model Size ◽  
Small Model ◽  
Detection Speed

In power inspection tasks, the insulator and spacer are important inspection objects. UAV (unmanned aerial vehicle) power inspection is becoming more and more popular. However, due to the limited computing resources carried by a UAV, a lighter model with small model size, high detection accuracy, and fast detection speed is needed to achieve online detection. In order to realize the online detection of power inspection objects, we propose an improved SSD (single shot multibox detector) insulator and spacer detection algorithm using the power inspection images collected by a UAV. In the proposed algorithm, the lightweight network MnasNet is used as the feature extraction network to generate feature maps. Then, two multiscale feature fusion methods are used to fuse multiple feature maps. Lastly, a power inspection object dataset containing insulators and spacers based on aerial images is built, and the performance of the proposed algorithm is tested on real aerial images and videos. Experimental results show that the proposed algorithm can efficiently detect insulators and spacers. Compared with existing algorithms, the proposed algorithm has the advantages of small model size and fast detection speed. The detection accuracy can achieve 93.8%. The detection time of a single image on TX2 (NVIDIA Jetson TX2) is 154 ms and the capture rate on TX2 is 8.27 fps, which allows realizing online detection.

scholarly journals Key Parts of Transmission Line Detection Using Improved YOLO v3

2021 ◽  
Vol 18 (6) ◽  
Author(s):  
Tu Renwei ◽  
Zhu Zhongjie ◽  
Bai Yongqiang ◽  
Gao Ming ◽  
Ge Zhifeng
Keyword(s):  
Transmission Line ◽  
Detection Accuracy ◽  
Data Sets ◽  
Feature Maps ◽  
Data Set ◽  
Detection Model ◽  
The Neural Network ◽  
Low Efficiency ◽  
The One ◽  
Detection Speed

Unmanned Aerial Vehicle (UAV) inspection has become one of main methods for current transmission line inspection, but there are still some shortcomings such as slow detection speed, low efficiency, and inability for low light environment. To address these issues, this paper proposes a deep learning detection model based on You Only Look Once (YOLO) v3. On the one hand, the neural network structure is simplified, that is the three feature maps of YOLO v3 are pruned into two to meet specific detection requirements. Meanwhile, the K-means++ clustering method is used to calculate the anchor value of the data set to improve the detection accuracy. On the other hand, 1000 sets of power tower and insulator data sets are collected, which are inverted and scaled to expand the data set, and are fully optimized by adding different illumination and viewing angles. The experimental results show that this model using improved YOLO v3 can effectively improve the detection accuracy by 6.0%, flops by 8.4%, and the detection speed by about 6.0%.

scholarly journals A New Method for Detecting Compensation Hole Parameters of Automobile Brake Master Cylinder Based on Machine Vision

2021 ◽  
Vol 2021 ◽  
pp. 1-14
Author(s):  
Changfu Zhao ◽  
Hongchang Ding ◽  
Guohua Cao ◽  
Ying Zhang
Keyword(s):  
Hough Transform ◽  
New Method ◽  
Zernike Moment ◽  
Machining Accuracy ◽  
Detection Accuracy ◽  
Master Cylinder ◽  
Fast Detection ◽  
Detection Technology ◽  
Center Position ◽  
Detection Speed

The machining accuracy of the compensation hole of the automobile brake master cylinder directly determines the safety of the automobile and the reliability of parking. How to detect the parameters of the compensation hole with high precision becomes a crucial issue. In this paper, by analyzing the principle of Hough transform detection technology and several optimization algorithms, a new method combining Zernike moment and improved gradient Hough transform is proposed to detect the circular hole parameters. The simulation experiment shows that the proposed algorithm satisfies 0.1 pixels in the coordinate detection of the center position, and the radius detection accuracy is 0.05 pixels, with fast detection speed and good robustness. Compared with the random Hough transform algorithm and the gradient Hough transform algorithm, the algorithm proposed in this paper has higher detection accuracy, faster detection speed, and better robustness, which meets the online detection accuracy requirements of the brake master cylinder compensation hole.

Insulator Fault Detection in Aerial Images based on the Mixed-grouped Fire Single-shot Multibox Detector

2020 ◽  
Author(s):  
Songbo Chen ◽  
Chao Su ◽  
Zhenxing Kuang ◽  
Ye Ouyang ◽  
Xiang Gong
Keyword(s):  
Feature Fusion ◽  
Complex Structure ◽  
Aerial Images ◽  
Detection Accuracy ◽  
Single Shot ◽  
Small Object ◽  
Two Stage ◽  
One Stage ◽  
Complex Background ◽  
Lower Accuracy

In a complex background, insulator fault is the main factor behind transmission accidents. With the wide application of unmanned aerial vehicle (UAV) photography, digital image recognition technology has been further developed to detect the position and fault of insulators. There are two mainstream methods based on deep learning: the first is the “two-stage” example for a region convolutional neural network and the second is the “one-stage” example such as a single-shot multibox detector (SSD), both of which pose many difficulties and challenges. However, due to the complex background and various types of insulators, few researchers apply the “two-stage” method for the detection of insulator faults in aerial images. Moreover, the detection performance of “one-stage” methods is poor for small targets because of the smaller scope of vision and lower accuracy in target detection. In this article, the authors propose an accurate and real-time method for small object detection, an example for insulator location, and its fault inspection based on a mixed- grouped fire single-shot multibox detector (MGFSSD). Based on SSD and deconvolutional single-shot detector (DSSD) networks, the MGFSSD algorithm solves the problems of inaccurate recognition in small objects of the SSD and complex structure and long running time of the DSSD. To resolve the problems of some target repeated detection and small-target missing detection of the original SSD, the authors describe how to design an effective and lightweight feature fusion module to improve the performance of traditional SSDs so that the classifier network can take full advantage of the relationship between the pyramid layer features without changing the base network closest to the input data. The data processing results show that the method can effectively detect insulator faults. The average detection accuracy of insulator faults is 92.4% and the average recall rate is 91.2%.

scholarly journals SSD7-FFAM: A Real-Time Object Detection Network Friendly to Embedded Devices from Scratch

2021 ◽  
Vol 11 (3) ◽  
pp. 1096
Author(s):  
Qing Li ◽  
Yingcheng Lin ◽  
Wei He
Keyword(s):  
Object Detection ◽  
Real Time ◽  
Large Scale ◽  
Feature Fusion ◽  
Contextual Information ◽  
Attention Mechanism ◽  
Detection Accuracy ◽  
Single Shot ◽  
Feature Maps ◽  
Embedded Devices

The high requirements for computing and memory are the biggest challenges in deploying existing object detection networks to embedded devices. Living lightweight object detectors directly use lightweight neural network architectures such as MobileNet or ShuffleNet pre-trained on large-scale classification datasets, which results in poor network structure flexibility and is not suitable for some specific scenarios. In this paper, we propose a lightweight object detection network Single-Shot MultiBox Detector (SSD)7-Feature Fusion and Attention Mechanism (FFAM), which saves storage space and reduces the amount of calculation by reducing the number of convolutional layers. We offer a novel Feature Fusion and Attention Mechanism (FFAM) method to improve detection accuracy. Firstly, the FFAM method fuses high-level semantic information-rich feature maps with low-level feature maps to improve small objects’ detection accuracy. The lightweight attention mechanism cascaded by channels and spatial attention modules is employed to enhance the target’s contextual information and guide the network to focus on its easy-to-recognize features. The SSD7-FFAM achieves 83.7% mean Average Precision (mAP), 1.66 MB parameters, and 0.033 s average running time on the NWPU VHR-10 dataset. The results indicate that the proposed SSD7-FFAM is more suitable for deployment to embedded devices for real-time object detection.

scholarly journals Using Channel and Network Layer Pruning Based on Deep Learning for Real-Time Detection of Ginger Images

Agriculture ◽  
2021 ◽  
Vol 11 (12) ◽  
pp. 1190
Author(s):  
Lifa Fang ◽  
Yanqiang Wu ◽  
Yuhua Li ◽  
Hongen Guo ◽  
Hua Zhang ◽  
...  
Keyword(s):  
Real Time ◽  
Computational Cost ◽  
Detection Accuracy ◽  
Test Results ◽  
Network Layers ◽  
Solid Foundation ◽  
Time Determination ◽  
Model Size ◽  
Detection Speed

Consistent ginger shoot orientation helps to ensure consistent ginger emergence and meet shading requirements. YOLO v3 is used to recognize ginger images in response to the current ginger seeder’s difficulty in meeting the above agronomic problems. However, it is not suitable for direct application on edge computing devices due to its high computational cost. To make the network more compact and to address the problems of low detection accuracy and long inference time, this study proposes an improved YOLO v3 model, in which some redundant channels and network layers are pruned to achieve real-time determination of ginger shoots and seeds. The test results showed that the pruned model reduced its model size by 87.2% and improved the detection speed by 85%. Meanwhile, its mean average precision (mAP) reached 98.0% for ginger shoots and seeds, only 0.1% lower than the model before pruning. Moreover, after deploying the model to the Jetson Nano, the test results showed that its mAP was 97.94%, the recognition accuracy could reach 96.7%, and detection speed could reach 20 frames·s−1. The results showed that the proposed method was feasible for real-time and accurate detection of ginger images, providing a solid foundation for automatic and accurate ginger seeding.

scholarly journals FASSD: A Feature Fusion and Spatial Attention-Based Single Shot Detector for Small Object Detection

Electronics ◽  
2020 ◽  
Vol 9 (9) ◽  
pp. 1536
Author(s):  
Deng Jiang ◽  
Bei Sun ◽  
Shaojing Su ◽  
Zhen Zuo ◽  
Peng Wu ◽  
...  
Keyword(s):  
Object Detection ◽  
Spatial Attention ◽  
Feature Fusion ◽  
Single Shot ◽  
Small Object ◽  
Feature Maps ◽  
Feature Representations ◽  
Small Object Detection ◽  
High Level ◽  
Detection Speed

Deep learning methods have significantly improved object detection performance, but small object detection remains an extremely difficult and challenging task in computer vision. We propose a feature fusion and spatial attention-based single shot detector (FASSD) for small object detection. We fuse high-level semantic information into shallow layers to generate discriminative feature representations for small objects. To adaptively enhance the expression of small object areas and suppress the feature response of background regions, the spatial attention block learns a self-attention mask to enhance the original feature maps. We also establish a small object dataset (LAKE-BOAT) of a scene with a boat on a lake and tested our algorithm to evaluate its performance. The results show that our FASSD achieves 79.3% mAP (mean average precision) on the PASCAL VOC2007 test with input 300 × 300, which outperforms the original single shot multibox detector (SSD) by 1.6 points, as well as most improved algorithms based on SSD. The corresponding detection speed was 45.3 FPS (frame per second) on the VOC2007 test using a single NVIDIA TITAN RTX GPU. The test results of a simplified FASSD on the LAKE-BOAT dataset indicate that our model achieved an improvement of 3.5% mAP on the baseline network while maintaining a real-time detection speed (64.4 FPS).

scholarly journals Real-time Concealed Object Detection from Passive Millimeter Wave Images Based on the YOLOv3 Algorithm

Sensors ◽  
2020 ◽  
Vol 20 (6) ◽  
pp. 1678 ◽  
Author(s):  
Lei Pang ◽  
Hui Liu ◽  
Yang Chen ◽  
Jungang Miao
Keyword(s):  
Real Time ◽  
Millimeter Wave ◽  
Human Body ◽  
Small Sample ◽  
Detection Accuracy ◽  
Single Shot ◽  
Sample Data ◽  
Detection Of Objects ◽  
Real Time Detection ◽  
Detection Speed

The detection of objects concealed under people’s clothing is a very challenging task, which has crucial applications for security. When testing the human body for metal contraband, the concealed targets are usually small in size and are required to be detected within a few seconds. Focusing on weapon detection, this paper proposes using a real-time detection method for detecting concealed metallic weapons on the human body applied to passive millimeter wave (PMMW) imagery based on the You Only Look Once (YOLO) algorithm, YOLOv3, and a small sample dataset. The experimental results from YOLOv3-13, YOLOv3-53, and Single Shot MultiBox Detector (SSD) algorithm, SSD-VGG16, are compared ultimately, using the same PMMW dataset. For the perspective of detection accuracy, detection speed, and computation resource, it shows that the YOLOv3-53 model had a detection speed of 36 frames per second (FPS) and a mean average precision (mAP) of 95% on a GPU-1080Ti computer, more effective and feasible for the real-time detection of weapon contraband on human body for PMMW images, even with small sample data.

scholarly journals A Single Shot Framework with Multi-Scale Feature Fusion for Geospatial Object Detection

2019 ◽  
Vol 11 (5) ◽  
pp. 594 ◽  
Author(s):  
Shuo Zhuang ◽  
Ping Wang ◽  
Boran Jiang ◽  
Gang Wang ◽  
Cong Wang
Keyword(s):  
Remote Sensing ◽  
Object Detection ◽  
Large Scale ◽  
Feature Fusion ◽  
Aerial Images ◽  
Detection Methods ◽  
Single Shot ◽  
Feature Maps ◽  
Scale Feature ◽  
Multi Scale

With the rapid advances in remote-sensing technologies and the larger number of satellite images, fast and effective object detection plays an important role in understanding and analyzing image information, which could be further applied to civilian and military fields. Recently object detection methods with region-based convolutional neural network have shown excellent performance. However, these two-stage methods contain region proposal generation and object detection procedures, resulting in low computation speed. Because of the expensive manual costs, the quantity of well-annotated aerial images is scarce, which also limits the progress of geospatial object detection in remote sensing. In this paper, on the one hand, we construct and release a large-scale remote-sensing dataset for geospatial object detection (RSD-GOD) that consists of 5 different categories with 18,187 annotated images and 40,990 instances. On the other hand, we design a single shot detection framework with multi-scale feature fusion. The feature maps from different layers are fused together through the up-sampling and concatenation blocks to predict the detection results. High-level features with semantic information and low-level features with fine details are fully explored for detection tasks, especially for small objects. Meanwhile, a soft non-maximum suppression strategy is put into practice to select the final detection results. Extensive experiments have been conducted on two datasets to evaluate the designed network. Results show that the proposed approach achieves a good detection performance and obtains the mean average precision value of 89.0% on a newly constructed RSD-GOD dataset and 83.8% on the Northwestern Polytechnical University very high spatial resolution-10 (NWPU VHR-10) dataset at 18 frames per second (FPS) on a NVIDIA GTX-1080Ti GPU.

scholarly journals Multi-Scale Geospatial Object Detection Based on Shallow-Deep Feature Extraction

2019 ◽  
Vol 11 (21) ◽  
pp. 2525 ◽  
Author(s):  
Dalal AL-Alimi ◽  
Yuxiang Shao ◽  
Ruyi Feng ◽  
Mohammed A. A. Al-qaness ◽  
Mohamed Abd Elaziz ◽  
...  
Keyword(s):  
Feature Extraction ◽  
Object Detection ◽  
Extraction Methods ◽  
Aerial Images ◽  
Detection Accuracy ◽  
Feature Maps ◽  
Deep Convolutional Neural Networks ◽  
Multi Scale ◽  
Deep Feature ◽  
Deep Feature Extraction

Multi-class detection in remote sensing images (RSIs) has garnered wide attention and introduced several service applications in many fields, including civil and military fields. However, several reasons make detection from aerial images very challenging and more difficult than nature scene images: Objects do not have a fixed size, often appear at very various scales and sometimes appear in dense groups, like vehicles and storage tanks, and have different surroundings or background areas. Furthermore, all of this makes the manual annotation of objects very complex and costly. The powerful effect of the feature extraction methods on object detection and the successes of deep convolutional neural networks (CNN) extract deep features more than traditional methods. This study introduced a novel network structure and designed a unique feature extraction which employs squeeze and excitation network (SENet) and residual network (ResNet) to obtain feature maps, named a shallow-deep feature extraction (SDFE), that improves the resolution and the localization at the same time. Furthermore, this novel model reduces the loss of dense groups and small objects, and provides higher and more stable detection accuracy which is not significantly affected by changing the value of the threshold of the intersection over union (IoU) and overcomes the difficulties of RSIs. Moreover, this study introduced strong evidence about the factors that affect the detection of RSIs. The proposed shallow-deep and multi-scale (SD-MS) method outperforms other approaches for the given ten classes of the NWPU VHR-10 dataset.

scholarly journals Autonomous Multiple Tramp Materials Detection in Raw Coal Using Single-Shot Feature Fusion Detector

2021 ◽  
Vol 12 (1) ◽  
pp. 107
Author(s):  
Dongjun Li ◽  
Guoying Meng ◽  
Zhiyuan Sun ◽  
Lili Xu
Keyword(s):  
Feature Fusion ◽  
Detection Algorithm ◽  
Input Image ◽  
Normal Operation ◽  
Detection Accuracy ◽  
Single Shot ◽  
Feature Maps ◽  
Convolutional Network ◽  
Small Targets

In the coal mining process, various types of tramp materials will be mixed into the raw coal, which will affect the quality of the coal and endanger the normal operation of the equipment. Automatic detection of tramp materials objects is an important process and basis for efficient coal sorting. However, previous research has focused on the detection of gangue, ignoring the detection of other types of tramp materials, especially small targets. Because the initial Single Shot MultiBox Detector (SSD) lacks the efficient use of feature maps, it is difficult to obtain stable results when detecting tramp materials objects. In this article, an object detection algorithm based on feature fusion and dense convolutional network is proposed, which is called tramp materials in raw coal single-shot detector (TMRC-SSD), to detect five types of tramp materials such as gangue, bolt, stick, iron sheet, and iron chain. In this algorithm, a modified DenseNet is first designed and a four-stage feature extractor is used to down-sample the feature map stably. After that, we use the dilation convolution and multi-branch structure to enrich the receptive field. Finally, in the feature fusion module, we designed cross-layer feature fusion and attention fusion modules to realize the semantic interaction of feature maps. The experiments show that the module we designed is effective. This method is better than the existing model. When the input image is 300 × 300 pixels, it can reach 96.12% MAP and 24FPS. Especially in the detection of small objects, the detection accuracy has increased by 4.1 to 95.57%. The experimental results show that this method can be applied to the actual detection of tramp materials objects in raw coal.

Sign in / Sign up

Export Citation Format

Share Document