scholarly journals A Block Object Detection Method Based on Feature Fusion Networks for Autonomous Vehicles

Complexity ◽  
2019 ◽  
Vol 2019 ◽  
pp. 1-14 ◽  
Author(s):  
Qiao Meng ◽  
Huansheng Song ◽  
Gang Li ◽  
Yu’an Zhang ◽  
Xiangqing Zhang
Keyword(s):  
Data Augmentation ◽  
Detection Method ◽  
Feature Fusion ◽  
Autonomous Vehicle ◽  
Current Trend ◽  
Climatic Conditions ◽  
Single Shot ◽  
Deep Convolutional Neural Networks ◽  
Multi Objective ◽  
Objective Detection

Nowadays, automatic multi-objective detection remains a challenging problem for autonomous vehicle technologies. In the past decades, deep learning has been demonstrated successful for multi-objective detection, such as the Single Shot Multibox Detector (SSD) model. The current trend is to train the deep Convolutional Neural Networks (CNNs) with online autonomous vehicle datasets. However, network performance usually degrades when small objects are detected. Moreover, the existing autonomous vehicle datasets could not meet the need for domestic traffic environment. To improve the detection performance of small objects and ensure the validity of the dataset, we propose a new method. Specifically, the original images are divided into blocks as input to a VGG-16 network which add the feature map fusion after CNNs. Moreover, the image pyramid is built to project all the blocks detection results at the original objects size as much as possible. In addition to improving the detection method, a new autonomous driving vehicle dataset is created, in which the object categories and labelling criteria are defined, and a data augmentation method is proposed. The experimental results on the new datasets show that the performance of the proposed method is greatly improved, especially for small objects detection in large image. Moreover, the proposed method is adaptive to complex climatic conditions and contributes a lot for autonomous vehicle perception and planning.

scholarly journals Deep Convolutional Neural Networks Object Detector for Real-Time Waste Identification

2020 ◽  
Vol 10 (20) ◽  
pp. 7301
Author(s):  
Daniel Octavian Melinte ◽  
Ana-Maria Travediu ◽  
Dan N. Dumitriu
Keyword(s):  
Neural Network ◽  
Data Augmentation ◽  
Optimization Methods ◽  
Learning Rate ◽  
Municipal Waste ◽  
Single Shot ◽  
Deep Convolutional Neural Networks ◽  
Robot System ◽  
Training Time ◽  
Detection Speed

This paper presents an extensive research carried out for enhancing the performances of convolutional neural network (CNN) object detectors applied to municipal waste identification. In order to obtain an accurate and fast CNN architecture, several types of Single Shot Detectors (SSD) and Regional Proposal Networks (RPN) have been fine-tuned on the TrashNet database. The network with the best performances is executed on one autonomous robot system, which is able to collect detected waste from the ground based on the CNN feedback. For this type of application, a precise identification of municipal waste objects is very important. In order to develop a straightforward pipeline for waste detection, the paper focuses on boosting the performance of pre-trained CNN Object Detectors, in terms of precision, generalization, and detection speed, using different loss optimization methods, database augmentation, and asynchronous threading at inference time. The pipeline consists of data augmentation at the training time followed by CNN feature extraction and box predictor modules for localization and classification at different feature map sizes. The trained model is generated for inference afterwards. The experiments revealed better performances than all other Object Detectors trained on TrashNet or other garbage datasets with a precision of 97.63% accuracy for SSD and 95.76% accuracy for Faster R-CNN, respectively. In order to find the optimal higher and lower bounds of our learning rate where the network is actually learning, we trained our model for several epochs, updating the learning rate after each epoch, starting from 1 × 10−10 and decreasing it until reaching 1 × 10−1.

scholarly journals End-to-End Ship Detection in SAR Images for Complex Scenes Based on Deep CNNs

2021 ◽  
Vol 2021 ◽  
pp. 1-19
Author(s):  
Yao Chen ◽  
Tao Duan ◽  
Changyuan Wang ◽  
Yuanyuan Zhang ◽  
Mo Huang
Keyword(s):  
Data Augmentation ◽  
Feature Fusion ◽  
Detection Methods ◽  
Detection Accuracy ◽  
Deep Convolutional Neural Networks ◽  
Sar Images ◽  
Ship Detection ◽  
End To End ◽  
Sar Imagery ◽  
Detection Speed

Ship detection on synthetic aperture radar (SAR) imagery has many valuable applications for both civil and military fields and has received extraordinary attention in recent years. The traditional detection methods are insensitive to multiscale ships and usually time-consuming, results in low detection accuracy and limitation for real-time processing. To balance the accuracy and speed, an end-to-end ship detection method for complex inshore and offshore scenes based on deep convolutional neural networks (CNNs) is proposed in this paper. First, the SAR images are divided into different grids, and the anchor boxes are predefined based on the responsible grids for dense ship prediction. Then, Darknet-53 with residual units is adopted as a backbone to extract features, and a top-down pyramid structure is added for multiscale feature fusion with concatenation. By this means, abundant hierarchical features containing both spatial and semantic information are extracted. Meanwhile, the strategies such as soft non-maximum suppression (Soft-NMS), mix-up and mosaic data augmentation, multiscale training, and hybrid optimization are used for performance enhancement. Besides, the model is trained from scratch to avoid learning objective bias of pretraining. The proposed one-stage method adopts end-to-end inference by a single network, so the detection speed can be guaranteed due to the concise paradigm. Extensive experiments are performed on the public SAR ship detection dataset (SSDD), and the results show that the method can detect both inshore and offshore ships with higher accuracy than other mainstream methods, yielding the accuracy with an average of 95.52%, and the detection speed is quite fast with about 72 frames per second (FPS). The actual Sentinel-1 and Gaofen-3 data are utilized for verification, and the detection results also show the effectiveness and robustness of the method.

Fabric defect detection based on multi-source feature fusion

2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Zhoufeng Liu ◽  
Shanliang Liu ◽  
Chunlei Li ◽  
Bicao Li
Keyword(s):  
Defect Detection ◽  
Detection Method ◽  
Feature Fusion ◽  
New Method ◽  
Detection Accuracy ◽  
Single Shot ◽  
Content Type ◽  
Fabric Defect Detection ◽  
Promising Tool ◽  
Fabric Defect

PurposeThis paper aims to propose a new method to solve the two problems in fabric defect detection. Current state-of-the-art industrial products defect detectors are deep learning-based, which incurs some additional problems: (1) The model is difficult to train due to too few fabric datasets for the difficulty of collecting pictures; (2) The detection accuracy of existing methods is insufficient to implement in the industrial field. This study intends to propose a new method which can be applied to fabric defect detection in the industrial field.Design/methodology/approachTo cope with exist fabric defect detection problems, the article proposes a novel fabric defect detection method based on multi-source feature fusion. In the training process, both layer features and source model information are fused to enhance robustness and accuracy. Additionally, a novel training model called multi-source feature fusion (MSFF) is proposed to tackle the limited samples and demand to obtain fleet and precise quantification automatically.FindingsThe paper provides a novel fabric defect detection method, experimental results demonstrate that the proposed method achieves an AP of 93.9 and 98.8% when applied to the TILDA(a public dataset) and ZYFD datasets (a real-shot dataset), respectively, and outperforms 5.9% than fine-tuned SSD (single shot multi-box detector).Research limitations/implicationsOur proposed algorithm can provide a promising tool for fabric defect detection.Practical implicationsThe paper includes implications for the development of a powerful brand image, the development of “brand ambassadors” and for managing the balance between stability and change.Social implicationsThis work provides technical support for real-time detection on industrial sites, advances the process of intelligent manual detection of fabric defects and provides a technical reference for object detection on other industrialOriginality/valueTherefore, our proposed algorithm can provide a promising tool for fabric defect detection.

scholarly journals Building Damage Detection from Post-Event Aerial Imagery Using Single Shot Multibox Detector

2019 ◽  
Vol 9 (6) ◽  
pp. 1128 ◽  
Author(s):  
Yundong Li ◽  
Wei Hu ◽  
Han Dong ◽  
Xueyan Zhang
Keyword(s):  
Machine Learning ◽  
Data Augmentation ◽  
Hurricane Sandy ◽  
Training Data ◽  
Aerial Images ◽  
Detection Methods ◽  
Single Shot ◽  
Data Set ◽  
Augmentation Strategies ◽  
Post Disaster

Using aerial cameras, satellite remote sensing or unmanned aerial vehicles (UAV) equipped with cameras can facilitate search and rescue tasks after disasters. The traditional manual interpretation of huge aerial images is inefficient and could be replaced by machine learning-based methods combined with image processing techniques. Given the development of machine learning, researchers find that convolutional neural networks can effectively extract features from images. Some target detection methods based on deep learning, such as the single-shot multibox detector (SSD) algorithm, can achieve better results than traditional methods. However, the impressive performance of machine learning-based methods results from the numerous labeled samples. Given the complexity of post-disaster scenarios, obtaining many samples in the aftermath of disasters is difficult. To address this issue, a damaged building assessment method using SSD with pretraining and data augmentation is proposed in the current study and highlights the following aspects. (1) Objects can be detected and classified into undamaged buildings, damaged buildings, and ruins. (2) A convolution auto-encoder (CAE) that consists of VGG16 is constructed and trained using unlabeled post-disaster images. As a transfer learning strategy, the weights of the SSD model are initialized using the weights of the CAE counterpart. (3) Data augmentation strategies, such as image mirroring, rotation, Gaussian blur, and Gaussian noise processing, are utilized to augment the training data set. As a case study, aerial images of Hurricane Sandy in 2012 were maximized to validate the proposed method’s effectiveness. Experiments show that the pretraining strategy can improve of 10% in terms of overall accuracy compared with the SSD trained from scratch. These experiments also demonstrate that using data augmentation strategies can improve mAP and mF1 by 72% and 20%, respectively. Finally, the experiment is further verified by another dataset of Hurricane Irma, and it is concluded that the paper method is feasible.

scholarly journals CNN Training Using 3D Virtual Models for Assisted Assembly with Mixed Reality and Collaborative Robots

2021 ◽  
Vol 11 (9) ◽  
pp. 4269
Author(s):  
Kamil Židek ◽  
Ján Piteľ ◽  
Michal Balog ◽  
Alexander Hošovský ◽  
Vratislav Hladký ◽  
...  
Keyword(s):  
Mixed Reality ◽  
Current Trend ◽  
Robot Vision ◽  
Processing Unit ◽  
Single Shot ◽  
Vision Systems ◽  
Collaborative Robots ◽  
Training Time ◽  
Position And Orientation ◽  
Collaborative Robot

The assisted assembly of customized products supported by collaborative robots combined with mixed reality devices is the current trend in the Industry 4.0 concept. This article introduces an experimental work cell with the implementation of the assisted assembly process for customized cam switches as a case study. The research is aimed to design a methodology for this complex task with full digitalization and transformation data to digital twin models from all vision systems. Recognition of position and orientation of assembled parts during manual assembly are marked and checked by convolutional neural network (CNN) model. Training of CNN was based on a new approach using virtual training samples with single shot detection and instance segmentation. The trained CNN model was transferred to an embedded artificial processing unit with a high-resolution camera sensor. The embedded device redistributes data with parts detected position and orientation into mixed reality devices and collaborative robot. This approach to assisted assembly using mixed reality, collaborative robot, vision systems, and CNN models can significantly decrease assembly and training time in real production.

scholarly journals A Robust Thermal Infrared Vehicle and Pedestrian Detection Method in Complex Scenes

Sensors ◽  
2021 ◽  
Vol 21 (4) ◽  
pp. 1240
Author(s):  
Yang Liu ◽  
Hailong Su ◽  
Cao Zeng ◽  
Xiaoli Li
Keyword(s):  
Detection Method ◽  
Selection Process ◽  
Pedestrian Detection ◽  
Thermal Infrared ◽  
Single Shot ◽  
Detection Algorithms ◽  
Complex Scenes ◽  
Thermal Infrared Images ◽  
Online Feature Selection ◽  
Huge Challenge

In complex scenes, it is a huge challenge to accurately detect motion-blurred, tiny, and dense objects in the thermal infrared images. To solve this problem, robust thermal infrared vehicle and pedestrian detection method is proposed in this paper. An important weight parameter β is first proposed to reconstruct the loss function of the feature selective anchor-free (FSAF) module in its online feature selection process, and the FSAF module is optimized to enhance the detection performance of motion-blurred objects. The proposal of parameter β provides an effective solution to the challenge of motion-blurred object detection. Then, the optimized anchor-free branches of the FSAF module are plugged into the YOLOv3 single-shot detector and work jointly with the anchor-based branches of the YOLOv3 detector in both training and inference, which efficiently improves the detection precision of the detector for tiny and dense objects. Experimental results show that the method proposed is superior to other typical thermal infrared vehicle and pedestrian detection algorithms due to 72.2% mean average precision (mAP).

scholarly journals Human and bird detection and classification based on Doppler radar spectrograms and vision images using convolutional neural networks

2021 ◽  
Vol 18 (3) ◽  
pp. 172988142110105
Author(s):  
Jnana Sai Abhishek Varma Gokaraju ◽  
Weon Keun Song ◽  
Min-Ho Ka ◽  
Somyot Kaitwanidvilai
Keyword(s):  
Neural Networks ◽  
Object Recognition ◽  
Convolutional Neural Networks ◽  
Doppler Radar ◽  
Autonomous Vehicle ◽  
Sampling Point ◽  
Body Segment ◽  
Kinematic Modeling ◽  
Deep Convolutional Neural Networks ◽  
Kinematic Models

The study investigated object detection and classification based on both Doppler radar spectrograms and vision images using two deep convolutional neural networks. The kinematic models for a walking human and a bird flapping its wings were incorporated into MATLAB simulations to create data sets. The dynamic simulator identified the final position of each ellipsoidal body segment taking its rotational motion into consideration in addition to its bulk motion at each sampling point to describe its specific motion naturally. The total motion induced a micro-Doppler effect and created a micro-Doppler signature that varied in response to changes in the input parameters, such as varying body segment size, velocity, and radar location. Micro-Doppler signature identification of the radar signals returned from the target objects that were animated by the simulator required kinematic modeling based on a short-time Fourier transform analysis of the signals. Both You Only Look Once V3 and Inception V3 were used for the detection and classification of the objects with different red, green, blue colors on black or white backgrounds. The results suggested that clear micro-Doppler signature image-based object recognition could be achieved in low-visibility conditions. This feasibility study demonstrated the application possibility of Doppler radar to autonomous vehicle driving as a backup sensor for cameras in darkness. In this study, the first successful attempt of animated kinematic models and their synchronized radar spectrograms to object recognition was made.

Improved SSD-assisted algorithm for surface defect detection of electromagnetic luminescence

2021 ◽  
pp. 1748006X2199538
Author(s):  
Zhenying Xu ◽  
Ziqian Wu ◽  
Wei Fan
Keyword(s):  
Defect Detection ◽  
Feature Fusion ◽  
Recognition Rate ◽  
Detection Methods ◽  
Small Scale ◽  
Detection Accuracy ◽  
Single Shot ◽  
Surface Defect Detection ◽  
Feature Pyramid ◽  
Small Feature

Defect detection of electromagnetic luminescence (EL) cells is the core step in the production and preparation of solar cell modules to ensure conversion efficiency and long service life of batteries. However, due to the lack of feature extraction capability for small feature defects, the traditional single shot multibox detector (SSD) algorithm performs not well in EL defect detection with high accuracy. Consequently, an improved SSD algorithm with modification in feature fusion in the framework of deep learning is proposed to improve the recognition rate of EL multi-class defects. A dataset containing images with four different types of defects through rotation, denoising, and binarization is established for the EL. The proposed algorithm can greatly improve the detection accuracy of the small-scale defect with the idea of feature pyramid networks. An experimental study on the detection of the EL defects shows the effectiveness of the proposed algorithm. Moreover, a comparison study shows the proposed method outperforms other traditional detection methods, such as the SIFT, Faster R-CNN, and YOLOv3, in detecting the EL defect.

Sign in / Sign up

Export Citation Format

Share Document