Boosting Small Ship Detection in Optical Remote Sensing Images via Image Super-Resolution

2021 ◽  
Author(s):  
Linhao Li ◽  
Zhiqiang Zhou ◽  
Saijia Cui
Keyword(s):  
Remote Sensing ◽  
Super Resolution ◽  
Optical Remote Sensing ◽  
Remote Sensing Images ◽  
Ship Detection ◽  
Image Super Resolution ◽  
Small Ship

scholarly journals Small Object Detection in Remote Sensing Images with Residual Feature Aggregation-Based Super-Resolution and Object Detector Network

2021 ◽  
Vol 13 (9) ◽  
pp. 1854
Author(s):  
Syed Muhammad Arsalan Bashir ◽  
Yi Wang
Keyword(s):  
Remote Sensing ◽  
Object Detection ◽  
Resolution Enhancement ◽  
Super Resolution ◽  
Detection Performance ◽  
Image Resolution ◽  
Small Object ◽  
Remote Sensing Images ◽  
Feature Aggregation ◽  
Image Super Resolution

This paper deals with detecting small objects in remote sensing images from satellites or any aerial vehicle by utilizing the concept of image super-resolution for image resolution enhancement using a deep-learning-based detection method. This paper provides a rationale for image super-resolution for small objects by improving the current super-resolution (SR) framework by incorporating a cyclic generative adversarial network (GAN) and residual feature aggregation (RFA) to improve detection performance. The novelty of the method is threefold: first, a framework is proposed, independent of the final object detector used in research, i.e., YOLOv3 could be replaced with Faster R-CNN or any object detector to perform object detection; second, a residual feature aggregation network was used in the generator, which significantly improved the detection performance as the RFA network detected complex features; and third, the whole network was transformed into a cyclic GAN. The image super-resolution cyclic GAN with RFA and YOLO as the detection network is termed as SRCGAN-RFA-YOLO, which is compared with the detection accuracies of other methods. Rigorous experiments on both satellite images and aerial images (ISPRS Potsdam, VAID, and Draper Satellite Image Chronology datasets) were performed, and the results showed that the detection performance increased by using super-resolution methods for spatial resolution enhancement; for an IoU of 0.10, AP of 0.7867 was achieved for a scale factor of 16.

scholarly journals Ship Detection in Panchromatic Optical Remote Sensing Images Based on Visual Saliency and Multi-Dimensional Feature Description

2020 ◽  
Vol 12 (1) ◽  
pp. 152 ◽  
Author(s):  
Ting Nie ◽  
Xiyu Han ◽  
Bin He ◽  
Xiansheng Li ◽  
Hongxing Liu ◽  
...  
Keyword(s):  
Remote Sensing ◽  
Fourier Transform ◽  
Detection Method ◽  
Saliency Detection ◽  
Visual Saliency ◽  
Saliency Map ◽  
False Alarms ◽  
Optical Remote Sensing ◽  
Remote Sensing Images ◽  
Ship Detection

Ship detection in panchromatic optical remote sensing images is faced with two major challenges, locating candidate regions from complex backgrounds quickly and describing ships effectively to reduce false alarms. Here, a practical method was proposed to solve these issues. Firstly, we constructed a novel visual saliency detection method based on a hyper-complex Fourier transform of a quaternion to locate regions of interest (ROIs), which can improve the accuracy of the subsequent discrimination process for panchromatic images, compared with the phase spectrum quaternary Fourier transform (PQFT) method. In addition, the Gaussian filtering of different scales was performed on the transformed result to synthesize the best saliency map. An adaptive method based on GrabCut was then used for binary segmentation to extract candidate positions. With respect to the discrimination stage, a rotation-invariant modified local binary pattern (LBP) description was achieved by combining shape, texture, and moment invariant features to describe the ship targets more powerfully. Finally, the false alarms were eliminated through SVM training. The experimental results on panchromatic optical remote sensing images demonstrated that the presented saliency model under various indicators is superior, and the proposed ship detection method is accurate and fast with high robustness, based on detailed comparisons to existing efforts.

scholarly journals Automatic Ship Detection in Optical Remote Sensing Images Based on Anomaly Detection and SPP-PCANet

2018 ◽  
Vol 11 (1) ◽  
pp. 47 ◽  
Author(s):  
Nan Wang ◽  
Bo Li ◽  
Qizhi Xu ◽  
Yonghua Wang
Keyword(s):  
Remote Sensing ◽  
Anomaly Detection ◽  
Superior Performance ◽  
Optical Remote Sensing ◽  
Remote Sensing Images ◽  
Low Contrast ◽  
Ship Detection ◽  
Wide Range ◽  
Spatial Pyramid Pooling ◽  
Spatial Pyramid

Automatic ship detection technology in optical remote sensing images has a wide range of applications in civilian and military fields. Among most important challenges encountered in ship detection, we focus on the following three selected ones: (a) ships with low contrast; (b) sea surface in complex situations; and (c) false alarm interference such as clouds and reefs. To overcome these challenges, this paper proposes coarse-to-fine ship detection strategies based on anomaly detection and spatial pyramid pooling pcanet (SPP-PCANet). The anomaly detection algorithm, based on the multivariate Gaussian distribution, regards a ship as an abnormal marine area, effectively extracting candidate regions of ships. Subsequently, we combine PCANet and spatial pyramid pooling to reduce the amount of false positives and improve the detection rate. Furthermore, the non-maximum suppression strategy is adopted to eliminate the overlapped frames on the same ship. To validate the effectiveness of the proposed method, GF-1 images and GF-2 images were utilized in the experiment, including the three scenarios mentioned above. Extensive experiments demonstrate that our method obtains superior performance in the case of complex sea background, and has a certain degree of robustness to external factors such as uneven illumination and low contrast on the GF-1 and GF-2 satellite image data.

scholarly journals Transferred Multi-Perception Attention Networks for Remote Sensing Image Super-Resolution

2019 ◽  
Vol 11 (23) ◽  
pp. 2857 ◽  
Author(s):  
Xiaoyu Dong ◽  
Zhihong Xi ◽  
Xu Sun ◽  
Lianru Gao
Keyword(s):  
Remote Sensing ◽  
Learning Strategy ◽  
State Of The Art ◽  
Spatial Scales ◽  
Super Resolution ◽  
Natural Image ◽  
Training Procedure ◽  
Remote Sensing Images ◽  
Objective Criterion ◽  
Image Super Resolution

Image super-resolution (SR) reconstruction plays a key role in coping with the increasing demand on remote sensing imaging applications with high spatial resolution requirements. Though many SR methods have been proposed over the last few years, further research is needed to improve SR processes with regard to the complex spatial distribution of the remote sensing images and the diverse spatial scales of ground objects. In this paper, a novel multi-perception attention network (MPSR) is developed with performance exceeding those of many existing state-of-the-art models. By incorporating the proposed enhanced residual block (ERB) and residual channel attention group (RCAG), MPSR can super-resolve low-resolution remote sensing images via multi-perception learning and multi-level information adaptive weighted fusion. Moreover, a pre-train and transfer learning strategy is introduced, which improved the SR performance and stabilized the training procedure. Experimental comparisons are conducted using 13 state-of-the-art methods over a remote sensing dataset and benchmark natural image sets. The proposed model proved its excellence in both objective criterion and subjective perspective.

Sign in / Sign up

Export Citation Format

Share Document