scholarly journals Improved Oriented Object Detection in Remote Sensing Images Based on a Three-Point Regression Method

2021 ◽  
Vol 13 (22) ◽  
pp. 4517
Author(s):  
Falin Wu ◽  
Jiaqi He ◽  
Guopeng Zhou ◽  
Haolun Li ◽  
Yushuang Liu ◽  
...  
Keyword(s):  
Remote Sensing ◽  
Object Detection ◽  
Poor Performance ◽  
Regression Method ◽  
Remote Sensing Images ◽  
Sensing Applications ◽  
Bounding Box ◽  
Bounding Boxes ◽  
Fully Connected ◽  
Oriented Object

Object detection in remote sensing images plays an important role in both military and civilian remote sensing applications. Objects in remote sensing images are different from those in natural images. They have the characteristics of scale diversity, arbitrary directivity, and dense arrangement, which causes difficulties in object detection. For objects with a large aspect ratio and that are oblique and densely arranged, using an oriented bounding box can help to avoid deleting some correct detection bounding boxes by mistake. The classic rotational region convolutional neural network (R2CNN) has advantages for text detection. However, R2CNN has poor performance in the detection of slender objects with arbitrary directivity in remote sensing images, and its fault tolerance rate is low. In order to solve this problem, this paper proposes an improved R2CNN based on a double detection head structure and a three-point regression method, namely, TPR-R2CNN. The proposed network modifies the original R2CNN network structure by applying a double fully connected (2-fc) detection head and classification fusion. One detection head is for classification and horizontal bounding box regression, the other is for classification and oriented bounding box regression. The three-point regression method (TPR) is proposed for oriented bounding box regression, which determines the positions of the oriented bounding box by regressing the coordinates of the center point and the first two vertices. The proposed network was validated on the DOTA-v1.5 and HRSC2016 datasets, and it achieved a mean average precision (mAP) of 3.90% and 15.27%, respectively, from feature pyramid network (FPN) baselines with a ResNet-50 backbone.

scholarly journals A Lightweight Keypoint-Based Oriented Object Detection of Remote Sensing Images

2021 ◽  
Vol 13 (13) ◽  
pp. 2459
Author(s):  
Yangyang Li ◽  
Heting Mao ◽  
Ruijiao Liu ◽  
Xuan Pei ◽  
Licheng Jiao ◽  
...  
Keyword(s):  
Remote Sensing ◽  
Object Detection ◽  
Large Scale ◽  
Detection Methods ◽  
Gaussian Kernel ◽  
Remote Sensing Images ◽  
Computational Overhead ◽  
Comparable Performance ◽  
Bounding Boxes ◽  
Oriented Object

Object detection in remote sensing images has been widely used in military and civilian fields and is a challenging task due to the complex background, large-scale variation, and dense arrangement in arbitrary orientations of objects. In addition, existing object detection methods rely on the increasingly deeper network, which increases a lot of computational overhead and parameters, and is unfavorable to deployment on the edge devices. In this paper, we proposed a lightweight keypoint-based oriented object detector for remote sensing images. First, we propose a semantic transfer block (STB) when merging shallow and deep features, which reduces noise and restores the semantic information. Then, the proposed adaptive Gaussian kernel (AGK) is adapted to objects of different scales, and further improves detection performance. Finally, we propose the distillation loss associated with object detection to obtain a lightweight student network. Experiments on the HRSC2016 and UCAS-AOD datasets show that the proposed method adapts to different scale objects, obtains accurate bounding boxes, and reduces the influence of complex backgrounds. The comparison with mainstream methods proves that our method has comparable performance under lightweight.

scholarly journals Object Detection in Remote Sensing Images Based on Improved Bounding Box Regression and Multi-Level Features Fusion

2020 ◽  
Vol 12 (1) ◽  
pp. 143 ◽  
Author(s):  
Xiaoliang Qian ◽  
Sheng Lin ◽  
Gong Cheng ◽  
Xiwen Yao ◽  
Hangli Ren ◽  
...  
Keyword(s):  
Remote Sensing ◽  
Object Detection ◽  
State Of The Art ◽  
Remote Sensing Images ◽  
Baseline Method ◽  
Deep Network ◽  
Features Fusion ◽  
Bounding Box ◽  
Multi Level ◽  
Bounding Boxes

The objective of detection in remote sensing images is to determine the location and category of all targets in these images. The anchor based methods are the most prevalent deep learning based methods, and still have some problems that need to be addressed. First, the existing metric (i.e., intersection over union (IoU)) could not measure the distance between two bounding boxes when they are nonoverlapping. Second, the exsiting bounding box regression loss could not directly optimize the metric in the training process. Third, the existing methods which adopt a hierarchical deep network only choose a single level feature layer for the feature extraction of region proposals, meaning they do not take full use of the advantage of multi-level features. To resolve the above problems, a novel object detection method for remote sensing images based on improved bounding box regression and multi-level features fusion is proposed in this paper. First, a new metric named generalized IoU is applied, which can quantify the distance between two bounding boxes, regardless of whether they are overlapping or not. Second, a novel bounding box regression loss is proposed, which can not only optimize the new metric (i.e., generalized IoU) directly but also overcome the problem that existing bounding box regression loss based on the new metric cannot adaptively change the gradient based on the metric value. Finally, a multi-level features fusion module is proposed and incorporated into the existing hierarchical deep network, which can make full use of the multi-level features for each region proposal. The quantitative comparisons between the proposed method and baseline method on the large scale dataset DIOR demonstrate that incorporating the proposed bounding box regression loss, multi-level features fusion module, and a combination of both into the baseline method can obtain an absolute gain of 0.7%, 1.4%, and 2.2% or so in terms of mAP, respectively. Comparing this with the state-of-the-art methods demonstrates that the proposed method has achieved a state-of-the-art performance. The curves of average precision with different thresholds show that the advantage of the proposed method is more evident when the threshold of generalized IoU (or IoU) is relatively high, which means that the proposed method can improve the precision of object localization. Similar conclusions can be obtained on a NWPU VHR-10 dataset.

scholarly journals CGP Box: An effective direction representation strategy for oriented object detection in remote sensing images

2021 ◽  
Vol 42 (17) ◽  
pp. 6670-6691
Author(s):  
Qiuyu Guan ◽  
Zhenshen Qu ◽  
Ming Zeng ◽  
Jianxiong Shen ◽  
Jingda Du
Keyword(s):  
Remote Sensing ◽  
Object Detection ◽  
Remote Sensing Images ◽  
Oriented Object

scholarly journals Arbitrary-Oriented Object Detection in Remote Sensing Images Based on Polar Coordinates

IEEE Access ◽  
2020 ◽  
Vol 8 ◽  
pp. 223373-223384
Author(s):  
Lin Zhou ◽  
Haoran Wei ◽  
Hao Li ◽  
Wenzhe Zhao ◽  
Yi Zhang ◽  
...  
Keyword(s):  
Remote Sensing ◽  
Object Detection ◽  
Polar Coordinates ◽  
Remote Sensing Images ◽  
Oriented Object

scholarly journals VaryBlock: A Novel Approach for Object Detection in Remote Sensed Images

Sensors ◽  
2019 ◽  
Vol 19 (23) ◽  
pp. 5284 ◽  
Author(s):  
Heng Zhang ◽  
Jiayu Wu ◽  
Yanli Liu ◽  
Jia Yu
Keyword(s):  
Remote Sensing ◽  
Object Detection ◽  
Poor Performance ◽  
Detection Methods ◽  
Optical Remote Sensing ◽  
Remote Sensing Images ◽  
Novel Approach ◽  
Challenging Tasks ◽  
The Mean ◽  
General Object

In recent years, the research on optical remote sensing images has received greater and greater attention. Object detection, as one of the most challenging tasks in the area of remote sensing, has been remarkably promoted by convolutional neural network (CNN)-based methods like You Only Look Once (YOLO) and Faster R-CNN. However, due to the complexity of backgrounds and the distinctive object distribution, directly applying these general object detection methods to the remote sensing object detection usually renders poor performance. To tackle this problem, a highly efficient and robust framework based on YOLO is proposed. We devise and integrate VaryBlock to the architecture which effectively offsets some of the information loss caused by downsampling. In addition, some techniques are utilized to facilitate the performance and to avoid overfitting. Experimental results show that our proposed method can enormously improve the mean average precision by a large margin on the NWPU VHR-10 dataset.

scholarly journals Learning Rotated Inscribed Ellipse for Oriented Object Detection in Remote Sensing Images

2021 ◽  
Vol 13 (18) ◽  
pp. 3622
Author(s):  
Xu He ◽  
Shiping Ma ◽  
Linyuan He ◽  
Le Ru ◽  
Chen Wang
Keyword(s):  
Remote Sensing ◽  
Aspect Ratio ◽  
Object Detection ◽  
Large Scale ◽  
Large Aspect Ratio ◽  
Remote Sensing Images ◽  
Orientation Error ◽  
Multi Scale ◽  
Half Axis ◽  
Oriented Object

Oriented object detection in remote sensing images (RSIs) is a significant yet challenging Earth Vision task, as the objects in RSIs usually emerge with complicated backgrounds, arbitrary orientations, multi-scale distributions, and dramatic aspect ratio variations. Existing oriented object detectors are mostly inherited from the anchor-based paradigm. However, the prominent performance of high-precision and real-time detection with anchor-based detectors is overshadowed by the design limitations of tediously rotated anchors. By using the simplicity and efficiency of keypoint-based detection, in this work, we extend a keypoint-based detector to the task of oriented object detection in RSIs. Specifically, we first simplify the oriented bounding box (OBB) as a center-based rotated inscribed ellipse (RIE), and then employ six parameters to represent the RIE inside each OBB: the center point position of the RIE, the offsets of the long half axis, the length of the short half axis, and an orientation label. In addition, to resolve the influence of complex backgrounds and large-scale variations, a high-resolution gated aggregation network (HRGANet) is designed to identify the targets of interest from complex backgrounds and fuse multi-scale features by using a gated aggregation model (GAM). Furthermore, by analyzing the influence of eccentricity on orientation error, eccentricity-wise orientation loss (ewoLoss) is proposed to assign the penalties on the orientation loss based on the eccentricity of the RIE, which effectively improves the accuracy of the detection of oriented objects with a large aspect ratio. Extensive experimental results on the DOTA and HRSC2016 datasets demonstrate the effectiveness of the proposed method.

scholarly journals Constraint Loss for Rotated Object Detection in Remote Sensing Images

2021 ◽  
Vol 13 (21) ◽  
pp. 4291
Author(s):  
Luyang Zhang ◽  
Haitao Wang ◽  
Lingfeng Wang ◽  
Chunhong Pan ◽  
Qiang Liu ◽  
...  
Keyword(s):  
Remote Sensing ◽  
Object Detection ◽  
Loss Function ◽  
Sudden Change ◽  
Aerial Image ◽  
Detection Methods ◽  
License Plate ◽  
Horizontal Line ◽  
Remote Sensing Images ◽  
Bounding Box

Rotated object detection is an extension of object detection that uses an oriented bounding box instead of a general horizontal bounding box to define the object position. It is widely used in remote sensing images, scene text, and license plate recognition. The existing rotated object detection methods usually add an angle prediction channel in the bounding box prediction branch, and smooth L1 loss is used as the regression loss function. However, we argue that smooth L1 loss causes a sudden change in loss and slow convergence due to the angle solving mechanism of openCV (the angle between the horizontal line and the first side of the bounding box in the counter-clockwise direction is defined as the rotation angle), and this problem exists in most existing regression loss functions. To solve the above problems, we propose a decoupling modulation mechanism to overcome the problem of sudden changes in loss. On this basis, we also proposed a constraint mechanism, the purpose of which is to accelerate the convergence of the network and ensure optimization toward the ideal direction. In addition, the proposed decoupling modulation mechanism and constraint mechanism can be integrated into the popular regression loss function individually or together, which further improves the performance of the model and makes the model converge faster. The experimental results show that our method achieves 75.2% performance on the aerial image dataset DOTA (OBB task), and saves more than 30% of computing resources. The method also achieves a state-of-the-art performance in HRSC2016, and saved more than 40% of computing resources, which confirms the applicability of the approach.

Sign in / Sign up

Export Citation Format

Share Document