scholarly journals Intelligent Ship Detection in Remote Sensing Images Based on Multi-Layer Convolutional Feature Fusion

2020 ◽  
Vol 12 (20) ◽  
pp. 3316 ◽  
Author(s):  
Yulian Zhang ◽  
Lihong Guo ◽  
Zengfa Wang ◽  
Yang Yu ◽  
Xinwei Liu ◽  
...  
Keyword(s):  
Remote Sensing ◽  
Feature Fusion ◽  
Atmospheric Correction ◽  
Recall Rate ◽  
Google Earth ◽  
Superior Performance ◽  
Detection Accuracy ◽  
Remote Sensing Images ◽  
Feature Maps ◽  
Ship Detection

Intelligent detection and recognition of ships from high-resolution remote sensing images is an extraordinarily useful task in civil and military reconnaissance. It is difficult to detect ships with high precision because various disturbances are present in the sea such as clouds, mist, islands, coastlines, ripples, and so on. To solve this problem, we propose a novel ship detection network based on multi-layer convolutional feature fusion (CFF-SDN). Our ship detection network consists of three parts. Firstly, the convolutional feature extraction network is used to extract ship features of different levels. Residual connection is introduced so that the model can be designed very deeply, and it is easy to train and converge. Secondly, the proposed network fuses fine-grained features from shallow layers with semantic features from deep layers, which is beneficial for detecting ship targets with different sizes. At the same time, it is helpful to improve the localization accuracy and detection accuracy of small objects. Finally, multiple fused feature maps are used for classification and regression, which can adapt to ships of multiple scales. Since the CFF-SDN model uses a pruning strategy, the detection speed is greatly improved. In the experiment, we create a dataset for ship detection in remote sensing images (DSDR), including actual satellite images from Google Earth and aerial images from electro-optical pod. The DSDR dataset contains not only visible light images, but also infrared images. To improve the robustness to various sea scenes, images under different scales, perspectives and illumination are obtained through data augmentation or affine transformation methods. To reduce the influence of atmospheric absorption and scattering, a dark channel prior is adopted to solve atmospheric correction on the sea scenes. Moreover, soft non-maximum suppression (NMS) is introduced to increase the recall rate for densely arranged ships. In addition, better detection performance is observed in comparison with the existing models in terms of precision rate and recall rate. The experimental results show that the proposed detection model can achieve the superior performance of ship detection in optical remote sensing image.

scholarly journals Automatic Ship Detection in Optical Remote Sensing Images Based on Anomaly Detection and SPP-PCANet

2018 ◽  
Vol 11 (1) ◽  
pp. 47 ◽  
Author(s):  
Nan Wang ◽  
Bo Li ◽  
Qizhi Xu ◽  
Yonghua Wang
Keyword(s):  
Remote Sensing ◽  
Anomaly Detection ◽  
Superior Performance ◽  
Optical Remote Sensing ◽  
Remote Sensing Images ◽  
Low Contrast ◽  
Ship Detection ◽  
Wide Range ◽  
Spatial Pyramid Pooling ◽  
Spatial Pyramid

Automatic ship detection technology in optical remote sensing images has a wide range of applications in civilian and military fields. Among most important challenges encountered in ship detection, we focus on the following three selected ones: (a) ships with low contrast; (b) sea surface in complex situations; and (c) false alarm interference such as clouds and reefs. To overcome these challenges, this paper proposes coarse-to-fine ship detection strategies based on anomaly detection and spatial pyramid pooling pcanet (SPP-PCANet). The anomaly detection algorithm, based on the multivariate Gaussian distribution, regards a ship as an abnormal marine area, effectively extracting candidate regions of ships. Subsequently, we combine PCANet and spatial pyramid pooling to reduce the amount of false positives and improve the detection rate. Furthermore, the non-maximum suppression strategy is adopted to eliminate the overlapped frames on the same ship. To validate the effectiveness of the proposed method, GF-1 images and GF-2 images were utilized in the experiment, including the three scenarios mentioned above. Extensive experiments demonstrate that our method obtains superior performance in the case of complex sea background, and has a certain degree of robustness to external factors such as uneven illumination and low contrast on the GF-1 and GF-2 satellite image data.

scholarly journals Explore the application of high-resolution nighttime light remote sensing images in nighttime marine ship detection: A case study of LJ1-01 data

2020 ◽  
Vol 12 (1) ◽  
pp. 1169-1184
Author(s):  
Liang Zhong ◽  
Xiaosheng Liu ◽  
Peng Yang ◽  
Rizhi Lin
Keyword(s):  
Remote Sensing ◽  
High Resolution ◽  
Infrared Imaging ◽  
Detection Methods ◽  
Detection Accuracy ◽  
Constant False Alarm Rate ◽  
Remote Sensing Images ◽  
Ship Detection ◽  
Application Potential ◽  
Nighttime Light

AbstractNighttime light remote sensing images show significant application potential in marine ship monitoring, but in areas where ships are densely distributed, the detection accuracy of the current methods is still limited. This article considered the LJ1-01 data as an example, compared with the National Polar-orbiting Partnership (NPP)/Visible Infrared Imaging Radiometer Suite (VIIRS) data, and explored the application of high-resolution nighttime light images in marine ship detection. The radiation values of the aforementioned two images were corrected to achieve consistency, and the interference light sources of the ship light were filtered. Then, when the threshold segmentation and two-parameter constant false alarm rate methods are combined, the ships’ location information was with obtained, and the reliability of the results was analyzed. The results show that the LJ1-01 data can not only record more potential ship light but also distinguish the ship light and background noise in the data. The detection accuracy of the LJ1-01 data in both ship detection methods is significantly higher than that of the NPP/VIIRS data. This study analyzes the characteristics, performance, and application potential of the high-resolution nighttime light data in the detection of marine vessels. The relevant results can provide a reference for the high-precision monitoring of nighttime marine ships.

scholarly journals Subtask Attention Based Object Detection in Remote Sensing Images

2021 ◽  
Vol 13 (10) ◽  
pp. 1925
Author(s):  
Shengzhou Xiong ◽  
Yihua Tan ◽  
Yansheng Li ◽  
Cai Wen ◽  
Pei Yan
Keyword(s):  
Remote Sensing ◽  
Object Detection ◽  
Feature Fusion ◽  
Detection Task ◽  
Feature Representation ◽  
Detection Accuracy ◽  
Remote Sensing Images ◽  
Attention Network ◽  
Multi Scale ◽  
Automatic Interpretation

Object detection in remote sensing images (RSIs) is one of the basic tasks in the field of remote sensing image automatic interpretation. In recent years, the deep object detection frameworks of natural scene images (NSIs) have been introduced into object detection on RSIs, and the detection performance has improved significantly because of the powerful feature representation. However, there are still many challenges concerning the particularities of remote sensing objects. One of the main challenges is the missed detection of small objects which have less than five percent of the pixels of the big objects. Generally, the existing algorithms choose to deal with this problem by multi-scale feature fusion based on a feature pyramid. However, the benefits of this strategy are limited, considering that the location of small objects in the feature map will disappear when the detection task is processed at the end of the network. In this study, we propose a subtask attention network (StAN), which handles the detection task directly on the shallow layer of the network. First, StAN contains one shared feature branch and two subtask attention branches of a semantic auxiliary subtask and a detection subtask based on the multi-task attention network (MTAN). Second, the detection branch uses only low-level features considering small objects. Third, the attention map guidance mechanism is put forward to optimize the network for keeping the identification ability. Fourth, the multi-dimensional sampling module (MdS), global multi-view channel weights (GMulW) and target-guided pixel attention (TPA) are designed for further improvement of the detection accuracy in complex scenes. The experimental results on the NWPU VHR-10 dataset and DOTA dataset demonstrated that the proposed algorithm achieved the SOTA performance, and the missed detection of small objects decreased. On the other hand, ablation experiments also proved the effects of MdS, GMulW and TPA.

scholarly journals A New Method of Different Neural Network Depth and Feature Map Size on Remote Sensing Small Target Detection

2021 ◽  
Vol 24 (68) ◽  
pp. 21-32
Author(s):  
Yaming Cao ◽  
ZHEN YANG ◽  
CHEN GAO
Keyword(s):  
Neural Network ◽  
Remote Sensing ◽  
Neural Networks ◽  
Target Detection ◽  
Detection Efficiency ◽  
Detection Accuracy ◽  
Small Target ◽  
Remote Sensing Images ◽  
Feature Maps ◽  
Small Target Detection

Convolutional neural networks (CNNs) have shown strong learning capabilities in computer vision tasks such as classification and detection. Especially with the introduction of excellent detection models such as YOLO (V1, V2 and V3) and Faster R-CNN, CNNs have greatly improved detection efficiency and accuracy. However, due to the special angle of view, small size, few features, and complicated background, CNNs that performs well in the ground perspective dataset, fails to reach a good detection accuracy in the remote sensing image dataset. To this end, based on the YOLO V3 model, we used feature maps of different depths as detection outputs to explore the reasons for the poor detection rate of small targets in remote sensing images by deep neural networks. We also analyzed the effect of neural network depth on small target detection, and found that the excessive deep semantic information of neural network has little effect on small target detection. Finally, the verification on the VEDAI dataset shows, that the fusion of shallow feature maps with precise location information and deep feature maps with rich semantics in the CNNs can effectively improve the accuracy of small target detection in remote sensing images.

scholarly journals Elongated Small Object Detection from Remote Sensing Images Using Hierarchical Scale-Sensitive Networks

2021 ◽  
Vol 13 (16) ◽  
pp. 3182
Author(s):  
Zheng He ◽  
Li Huang ◽  
Weijiang Zeng ◽  
Xining Zhang ◽  
Yongxin Jiang ◽  
...  
Keyword(s):  
Remote Sensing ◽  
Object Detection ◽  
Large Scale ◽  
Small Scale ◽  
Detection Accuracy ◽  
Small Object ◽  
Direction Vector ◽  
Remote Sensing Images ◽  
Ship Detection ◽  
Hierarchical Scale

The detection of elongated objects, such as ships, from satellite images has very important application prospects in marine transportation, shipping management, and many other scenarios. At present, the research of general object detection using neural networks has made significant progress. However, in the context of ship detection from remote sensing images, due to the elongated shape of ship structure and the wide variety of ship size, the detection accuracy is often unsatisfactory. In particular, the detection accuracy of small-scale ships is much lower than that of the large-scale ones. To this end, in this paper, we propose a hierarchical scale sensitive CenterNet (HSSCenterNet) for ship detection from remote sensing images. HSSCenterNet adopts a multi-task learning strategy. First, it presents a dual-direction vector to represent the posture or direction of the tilted bounding box, and employs a two-layer network to predict the dual direction vector, which improves the detection block of CenterNet, and cultivates the ability of detecting targets with tilted posture. Second, it divides the full-scale detection task into three parallel sub-tasks for large-scale, medium-scale, and small-scale ship detection, respectively, and obtains the final results with non-maximum suppression. Experimental results show that, HSSCenterNet achieves a significant improved performance in detecting small-scale ship targets while maintaining a high performance at medium and large scales.

scholarly journals A Novel Coarse-to-Fine Method of Ship Detection in Optical Remote Sensing Images Based on a Deep Residual Dense Network

2020 ◽  
Vol 12 (19) ◽  
pp. 3115 ◽  
Author(s):  
Liqiong Chen ◽  
Wenxuan Shi ◽  
Cien Fan ◽  
Lian Zou ◽  
Dexiang Deng
Keyword(s):  
Remote Sensing ◽  
Large Scale ◽  
False Alarms ◽  
Discrete Wavelet ◽  
Detection Accuracy ◽  
Optical Remote Sensing ◽  
Dense Network ◽  
Remote Sensing Images ◽  
Ship Detection ◽  
Coarse To Fine

Automatic ship detection in optical remote sensing images is of great significance due to its broad applications in maritime security and fishery control. Most ship detection algorithms utilize a single-band image to design low-level and hand-crafted features, which are easily influenced by interference like clouds and strong waves and not robust for large-scale variation of ships. In this paper, we propose a novel coarse-to-fine ship detection method based on discrete wavelet transform (DWT) and a deep residual dense network (DRDN) to address these problems. First, multi-spectral images are adopted for sea-land segmentation, and an enhanced DWT is employed to quickly extract ship candidate regions with missing alarms as low as possible. Second, panchromatic images with clear spatial details are used for ship classification. Specifically, we propose the local residual dense block (LRDB) to fully extract semantic feature via local residual connection and densely connected convolutional layers. DRDN mainly consists of four LRDBs and is designed to further remove false alarms. Furthermore, we exploit the multiclass classification strategy, which can overcome the large intra-class difference of targets and identify ships of different sizes. Extensive experiments demonstrate that the proposed method has high robustness in complex image backgrounds and achieves higher detection accuracy than other state-of-the-art methods.

scholarly journals Non-locally Enhanced Feature Fusion Network for Aircraft Recognition in Remote Sensing Images

2020 ◽  
Vol 12 (4) ◽  
pp. 681
Author(s):  
Yunsheng Xiong ◽  
Xin Niu ◽  
Yong Dou ◽  
Hang Qie ◽  
Kang Wang
Keyword(s):  
Remote Sensing ◽  
Loss Function ◽  
Feature Fusion ◽  
Remote Sensing Images ◽  
Feature Maps ◽  
Long Distance ◽  
Test Dataset ◽  
Fine Grained ◽  
Recognition Ability ◽  
Discriminative Parts

Aircraft recognition has great application value, but aircraft in remote sensing images have some problems such as low resolution, poor contrasts, poor sharpness, and lack of details caused by the vertical view, which make the aircraft recognition very difficult. Especially when there are many kinds of aircraft and the differences between aircraft are subtle, the fine-grained recognition of aircraft is more challenging. In this paper, we propose a non-locally enhanced feature fusion network(NLFFNet) and attempt to make full use of the features from discriminative parts of aircraft. First, according to the long-distance self-correlation in aircraft images, we adopt non-locally enhanced operation and guide the network to pay more attention to the discriminating areas and enhance the features beneficial to classification. Second, we propose a part-level feature fusion mechanism(PFF), which crops 5 parts of the aircraft on the shared feature maps, then extracts the subtle features inside the parts through the part full connection layer(PFC) and fuses the features of these parts together through the combined full connection layer(CFC). In addition, by adopting the improved loss function, we can enhance the weight of hard examples in the loss function meanwhile reducing the weight of excessively hard examples, which improves the overall recognition ability of the network. The dataset includes 47 categories of aircraft, including many aircraft of the same family with slight differences in appearance, and our method can achieve 89.12% accuracy on the test dataset, which proves the effectiveness of our method.

scholarly journals Real-Time Object Detection in Remote Sensing Images Based on Visual Perception and Memory Reasoning

Electronics ◽  
2019 ◽  
Vol 8 (10) ◽  
pp. 1151 ◽  
Author(s):  
Xia Hua ◽  
Xinqing Wang ◽  
Ting Rui ◽  
Dong Wang ◽  
Faming Shao
Keyword(s):  
Remote Sensing ◽  
Visual Perception ◽  
Object Detection ◽  
Real Time ◽  
Detection Accuracy ◽  
Small Object ◽  
Remote Sensing Images ◽  
Feature Maps ◽  
Convolutional Network ◽  
Fully Convolutional Network

Aiming at the real-time detection of multiple objects and micro-objects in large-scene remote sensing images, a cascaded convolutional neural network real-time object-detection framework for remote sensing images is proposed, which integrates visual perception and convolutional memory network reasoning. The detection framework is composed of two fully convolutional networks, namely, the strengthened object self-attention pre-screening fully convolutional network (SOSA-FCN) and the object accurate detection fully convolutional network (AD-FCN). SOSA-FCN introduces a self-attention module to extract attention feature maps and constructs a depth feature pyramid to optimize the attention feature maps by combining convolutional long-term and short-term memory networks. It guides the acquisition of potential sub-regions of the object in the scene, reduces the computational complexity, and enhances the network’s ability to extract multi-scale object features. It adapts to the complex background and small object characteristics of a large-scene remote sensing image. In AD-FCN, the object mask and object orientation estimation layer are designed to achieve fine positioning of candidate frames. The performance of the proposed algorithm is compared with that of other advanced methods on NWPU_VHR-10, DOTA, UCAS-AOD, and other open datasets. The experimental results show that the proposed algorithm significantly improves the efficiency of object detection while ensuring detection accuracy and has high adaptability. It has extensive engineering application prospects.

Sign in / Sign up

Export Citation Format

Share Document