scholarly journals An Image-Based Benchmark Dataset and a Novel Object Detector for Water Surface Object Detection

2021 ◽  
Vol 15 ◽  
Author(s):  
Zhiguo Zhou ◽  
Jiaen Sun ◽  
Jiabao Yu ◽  
Kaiyuan Liu ◽  
Junwei Duan ◽  
...  
Keyword(s):  
Object Detection ◽  
Water Surface ◽  
Large Scale ◽  
Autonomous Driving ◽  
Benchmark Dataset ◽  
Detection Methods ◽  
Climate Conditions ◽  
Detection Algorithms ◽  
Art Object ◽  
Surface Object

Water surface object detection is one of the most significant tasks in autonomous driving and water surface vision applications. To date, existing public large-scale datasets collected from websites do not focus on specific scenarios. As a characteristic of these datasets, the quantity of the images and instances is also still at a low level. To accelerate the development of water surface autonomous driving, this paper proposes a large-scale, high-quality annotated benchmark dataset, named Water Surface Object Detection Dataset (WSODD), to benchmark different water surface object detection algorithms. The proposed dataset consists of 7,467 water surface images in different water environments, climate conditions, and shooting times. In addition, the dataset comprises a total of 14 common object categories and 21,911 instances. Simultaneously, more specific scenarios are focused on in WSODD. In order to find a straightforward architecture to provide good performance on WSODD, a new object detector, named CRB-Net, is proposed to serve as a baseline. In experiments, CRB-Net was compared with 16 state-of-the-art object detection methods and outperformed all of them in terms of detection precision. In this paper, we further discuss the effect of the dataset diversity (e.g., instance size, lighting conditions), training set size, and dataset details (e.g., method of categorization). Cross-dataset validation shows that WSODD significantly outperforms other relevant datasets and that the adaptability of CRB-Net is excellent.

scholarly journals Real-Time Water Surface Object Detection Based on Improved Faster R-CNN

Sensors ◽  
2019 ◽  
Vol 19 (16) ◽  
pp. 3523 ◽  
Author(s):  
Lili Zhang ◽  
Yi Zhang ◽  
Zhen Zhang ◽  
Jie Shen ◽  
Huibin Wang
Keyword(s):  
Object Detection ◽  
Real Time ◽  
Water Surface ◽  
Detection Methods ◽  
Detection Accuracy ◽  
Natural Scenes ◽  
The North ◽  
Aspect Ratios ◽  
High Level ◽  
Surface Object

In this paper, we consider water surface object detection in natural scenes. Generally, background subtraction and image segmentation are the classical object detection methods. The former is highly susceptible to variable scenes, so its accuracy will be greatly reduced when detecting water surface objects due to the changing of the sunlight and waves. The latter is more sensitive to the selection of object features, which will lead to poor generalization as a result, so it cannot be applied widely. Consequently, methods based on deep learning have recently been proposed. The River Chief System has been implemented in China recently, and one of the important requirements is to detect and deal with the water surface floats in a timely fashion. In response to this case, we propose a real-time water surface object detection method in this paper which is based on the Faster R-CNN. The proposed network model includes two modules and integrates low-level features with high-level features to improve detection accuracy. Moreover, we propose to set the different scales and aspect ratios of anchors by analyzing the distribution of object scales in our dataset, so our method has good robustness and high detection accuracy for multi-scale objects in complex natural scenes. We utilized the proposed method to detect the floats on the water surface via a three-day video surveillance stream of the North Canal in Beijing, and validated its performance. The experiments show that the mean average precision (MAP) of the proposed method was 83.7%, and the detection speed was 13 frames per second. Therefore, our method can be applied in complex natural scenes and mostly meets the requirements of accuracy and speed of water surface object detection online.

scholarly journals Deep-Learning-Based Road Crack Detection Frameworks for Dashcam-captured Images under Different Illumination Conditions

2021 ◽  
Author(s):  
Da-Ren Chen ◽  
Wei-Min Chiu
Keyword(s):  
Object Detection ◽  
Large Scale ◽  
Crack Detection ◽  
State Of The Art ◽  
Gaussian Mixture Models ◽  
Gaussian Mixture ◽  
Machine Learning Techniques ◽  
Detection Accuracy ◽  
The Road ◽  
Art Object

Abstract Machine learning techniques have been used to increase detection accuracy of cracks in road surfaces. Most studies failed to consider variable illumination conditions on the target of interest (ToI), and only focus on detecting the presence or absence of road cracks. This paper proposes a new road crack detection method, IlumiCrack, which integrates Gaussian mixture models (GMM) and object detection CNN models. This work provides the following contributions: 1) For the first time, a large-scale road crack image dataset with a range of illumination conditions (e.g., day and night) is prepared using a dashcam. 2) Based on GMM, experimental evaluations on 2 to 4 levels of brightness are conducted for optimal classification. 3) the IlumiCrack framework is used to integrate state-of-the-art object detecting methods with CNN to classify the road crack images into eight types with high accuracy. Experimental results show that IlumiCrack outperforms the state-of-the-art R-CNN object detection frameworks.

scholarly journals Water surface object detection using panoramic vision based on improved single-shot multibox detector

2021 ◽  
Vol 2021 (1) ◽  
Author(s):  
Aofeng Li ◽  
Xufang Zhu ◽  
Shuo He ◽  
Jiawei Xia
Keyword(s):  
Object Detection ◽  
Water Surface ◽  
Detection Algorithm ◽  
Single Shot ◽  
Panoramic Vision ◽  
Feature Pyramid ◽  
The Mean ◽  
Detection Effect ◽  
Surface Object ◽  
Improved Algorithm

AbstractIn view of the deficiencies in traditional visual water surface object detection, such as the existence of non-detection zones, failure to acquire global information, and deficiencies in a single-shot multibox detector (SSD) object detection algorithm such as remote detection and low detection precision of small objects, this study proposes a water surface object detection algorithm from panoramic vision based on an improved SSD. We reconstruct the backbone network for the SSD algorithm, replace VVG16 with a ResNet-50 network, and add five layers of feature extraction. More abundant semantic information of the shallow feature graph is obtained through a feature pyramid network structure with deconvolution. An experiment is conducted by building a water surface object dataset. Results showed the mean Average Precision (mAP) of the improved algorithm are increased by 4.03%, compared with the existing SSD detecting Algorithm. Improved algorithm can effectively improve the overall detection precision of water surface objects and enhance the detection effect of remote objects.

scholarly journals Deep Learning Approaches for Object Detection

2020 ◽  
pp. 123-145
Author(s):  
Sushma Jaiswal ◽  
Tarun Jaiswal
Keyword(s):  
Deep Learning ◽  
Object Detection ◽  
Autonomous Driving ◽  
General Idea ◽  
Detection Methods ◽  
Learning Approaches ◽  
Detection Techniques ◽  
Second Stage ◽  
Fast Pace ◽  
Benchmark Datasets

In computer vision, object detection is a very important, exciting and mind-blowing study. Object detection work in numerous fields such as observing security, independently/autonomous driving and etc. Deep-learning based object detection techniques have developed at a very fast pace and have attracted the attention of many researchers. The main focus of the 21st century is the development of the object-detection framework, comprehensively and genuinely. In this investigation, we initially investigate and evaluate the various object detection approaches and designate the benchmark datasets. We also delivered the wide-ranging general idea of object detection approaches in an organized way. We covered the first and second stage detectors of object detection methods. And lastly, we consider the construction of these object detection approaches to give dimensions for further research.

scholarly journals A modified YOLOv3 detection method for vision-based water surface garbage capture robot

2020 ◽  
Vol 17 (3) ◽  
pp. 172988142093271
Author(s):  
Xiali Li ◽  
Manjun Tian ◽  
Shihan Kong ◽  
Licheng Wu ◽  
Junzhi Yu
Keyword(s):  
Object Detection ◽  
Real Time ◽  
Water Surface ◽  
High Speed ◽  
Detection Method ◽  
Training Data ◽  
Aquatic Environments ◽  
Valuable Insight ◽  
Data Set ◽  
Detection Algorithms

To tackle the water surface pollution problem, a vision-based water surface garbage capture robot has been developed in our lab. In this article, we present a modified you only look once v3-based garbage detection method, allowing real-time and high-precision object detection in dynamic aquatic environments. More specifically, to improve the real-time detection performance, the detection scales of you only look once v3 are simplified from 3 to 2. Besides, to guarantee the accuracy of detection, the anchor boxes of our training data set are reclustered for replacing some of the original you only look once v3 prior anchor boxes that are not appropriate to our data set. By virtue of the proposed detection method, the capture robot has the capability of cleaning floating garbage in the field. Experimental results demonstrate that both detection speed and accuracy of the modified you only look once v3 are better than those of other object detection algorithms. The obtained results provide valuable insight into the high-speed detection and grasping of dynamic objects in complex aquatic environments autonomously and intelligently.

Uncertainty Estimation of a global Remote Sensing Water Surface Time-Series: the DLR Global WaterPack

2020 ◽  
Author(s):  
Stefan Mayr ◽  
Igor Klein ◽  
Claudia Künzer ◽  
Martin Rutzinger
Keyword(s):  
Remote Sensing ◽  
Time Series ◽  
Water Surface ◽  
Large Scale ◽  
Binary Classification ◽  
Uncertainty Estimation ◽  
Detection Methods ◽  
High Temporal Resolution ◽  
Surface Time ◽  
Uncertainty Estimates

<p>Large-scale remote sensing products offer opportunities to address global society relevant questions. One of the most vital resources of our planet is fresh water. To monitor dynamics, the application of water surface time-series has proven to be an effective tool, but to access reliable information, validation efforts are essential. Furthermore, increased utilization of remote sensing time-series products can be seen in modelling applications. In this process, uncertainty estimation of input datasets is typically required. Especially for large-scale remote sensing products with high temporal resolution, common validation approaches as comparison to in situ data or intercomparison to similar products is hardly viable. Here we propose the use of supervised- and unsupervised outlier detection methods to yield pixel-wise uncertainty estimates in an internal validation. Therefore, several algorithms are applied on a global, MODIS (Moderate Resolution Imaging Spectroradiometer) based daily accessible water surface product (DLR Global WaterPack). Two main sources have been identified to introduce uncertainty to the binary classification of cloud free observations. As mixed pixels (water/non-water) and water impurities contribute to changes in the RED-NIR profile, we evaluate their effects by utilizing classified Landsat 8 images to determine water subpixel fractions and identify turbid water. Results are analyzed and compared in initial test regions across the globe.</p>

scholarly journals A Survey on 3D Object Detection Methods for Autonomous Driving Applications

2019 ◽  
Vol 20 (10) ◽  
pp. 3782-3795 ◽  
Author(s):  
Eduardo Arnold ◽  
Omar Y. Al-Jarrah ◽  
Mehrdad Dianati ◽  
Saber Fallah ◽  
David Oxtoby ◽  
...  
Keyword(s):  
Object Detection ◽  
Autonomous Driving ◽  
Detection Methods ◽  
3D Object ◽  
3D Object Detection

scholarly journals A Fast Orientation Invariant Detector Based on the One-stage Method

2018 ◽  
Vol 232 ◽  
pp. 04036
Author(s):  
Jun Yin ◽  
Huadong Pan ◽  
Hui Su ◽  
Zhonggeng Liu ◽  
Zhirong Peng
Keyword(s):  
Object Detection ◽  
Loss Function ◽  
High Efficiency ◽  
Detection Method ◽  
State Of The Art ◽  
Orientation Angle ◽  
Detection Methods ◽  
Detection Algorithms ◽  
Bounding Boxes ◽  
The One

We propose an object detection method that predicts the orientation bounding boxes (OBB) to estimate objects locations, scales and orientations based on YOLO (You Only Look Once), which is one of the top detection algorithms performing well both in accuracy and speed. Horizontal bounding boxes(HBB), which are not robust to orientation variances, are used in the existing object detection methods to detect targets. The proposed orientation invariant YOLO (OIYOLO) detector can effectively deal with the bird’s eye viewpoint images where the orientation angles of the objects are arbitrary. In order to estimate the rotated angle of objects, we design a new angle loss function. Therefore, the training of OIYOLO forces the network to learn the annotated orientation angle of objects, making OIYOLO orientation invariances. The proposed approach that predicts OBB can be applied in other detection frameworks. In additional, to evaluate the proposed OIYOLO detector, we create an UAV-DAHUA datasets that annotated with objects locations, scales and orientation angles accurately. Extensive experiments conducted on UAV-DAHUA and DOTA datasets demonstrate that OIYOLO achieves state-of-the-art detection performance with high efficiency comparing with the baseline YOLO algorithms.

scholarly journals Uncertainty Evaluation of Object Detection Algorithms for Autonomous Vehicles

2021 ◽  
Author(s):  
Liang Peng ◽  
Hong Wang ◽  
Jun Li
Keyword(s):  
Object Detection ◽  
Autonomous Vehicles ◽  
Confusion Matrix ◽  
Autonomous Driving ◽  
Detection Algorithm ◽  
Risk Identification ◽  
Practical Implementation ◽  
Complex Object ◽  
Detection Algorithms ◽  
Online Risk

AbstractThe safety of the intended functionality (SOTIF) has become one of the hottest topics in the field of autonomous driving. However, no testing and evaluating system for SOTIF performance has been proposed yet. Therefore, this paper proposes a framework based on the advanced You Only Look Once (YOLO) algorithm and the mean Average Precision (mAP) method to evaluate the object detection performance of the camera under SOTIF-related scenarios. First, a dataset is established, which contains road images with extreme weather and adverse lighting conditions. Second, the Monte Carlo dropout (MCD) method is used to analyze the uncertainty of the algorithm and draw the uncertainty region of the predicted bounding box. Then, the confidence of the algorithm is calibrated based on uncertainty results so that the average confidence after calibration can better reflect the real accuracy. The uncertainty results and the calibrated confidence are proposed to be used for online risk identification. Finally, the confusion matrix is extended according to the several possible mistakes that the object detection algorithm may make, and then the mAP is calculated as an index for offline evaluation and comparison. This paper offers suggestions to apply the MCD method to complex object detection algorithms and to find the relationship between the uncertainty and the confidence of the algorithm. The experimental results verified by specific SOTIF scenarios proof the feasibility and effectiveness of the proposed uncertainty acquisition approach for object detection algorithm, which provides potential practical implementation chance to address perceptual related SOTIF risk for autonomous vehicles.

Sign in / Sign up

Export Citation Format

Share Document