scholarly journals Unsupervised Deep Feature Learning for Remote Sensing Image Retrieval

2018 ◽  
Vol 10 (8) ◽  
pp. 1243 ◽  
Author(s):  
Xu Tang ◽  
Xiangrong Zhang ◽  
Fang Liu ◽  
Licheng Jiao
Keyword(s):  
Remote Sensing ◽  
Image Retrieval ◽  
Feature Learning ◽  
Remote Sensing Image ◽  
Code Word ◽  
Image Features ◽  
Learning Method ◽  
L1 Norm ◽  
Image Descriptor ◽  
Image Archives

Due to the specific characteristics and complicated contents of remote sensing (RS) images, remote sensing image retrieval (RSIR) is always an open and tough research topic in the RS community. There are two basic blocks in RSIR, including feature learning and similarity matching. In this paper, we focus on developing an effective feature learning method for RSIR. With the help of the deep learning technique, the proposed feature learning method is designed under the bag-of-words (BOW) paradigm. Thus, we name the obtained feature deep BOW (DBOW). The learning process consists of two parts, including image descriptor learning and feature construction. First, to explore the complex contents within the RS image, we extract the image descriptor in the image patch level rather than the whole image. In addition, instead of using the handcrafted feature to describe the patches, we propose the deep convolutional auto-encoder (DCAE) model to deeply learn the discriminative descriptor for the RS image. Second, the k-means algorithm is selected to generate the codebook using the obtained deep descriptors. Then, the final histogrammic DBOW features are acquired by counting the frequency of the single code word. When we get the DBOW features from the RS images, the similarities between RS images are measured using L1-norm distance. Then, the retrieval results can be acquired according to the similarity order. The encouraging experimental results counted on four public RS image archives demonstrate that our DBOW feature is effective for the RSIR task. Compared with the existing RS image features, our DBOW can achieve improved behavior on RSIR.

scholarly journals Large-Scale Remote Sensing Image Retrieval Based on Semi-Supervised Adversarial Hashing

2019 ◽  
Vol 11 (17) ◽  
pp. 2055 ◽  
Author(s):  
Xu Tang ◽  
Chao Liu ◽  
Jingjing Ma ◽  
Xiangrong Zhang ◽  
Fang Liu ◽  
...  
Keyword(s):  
Remote Sensing ◽  
Image Retrieval ◽  
Large Scale ◽  
Remote Sensing Image ◽  
Content Organization ◽  
Hash Code ◽  
Improved Performance ◽  
Hashing Function ◽  
Image Archives ◽  
Class Variable

Remote sensing image retrieval (RSIR), a superior content organization technique, plays an important role in the remote sensing (RS) community. With the number of RS images increases explosively, not only the retrieval precision but also the retrieval efficiency is emphasized in the large-scale RSIR scenario. Therefore, the approximate nearest neighborhood (ANN) search attracts the researchers’ attention increasingly. In this paper, we propose a new hash learning method, named semi-supervised deep adversarial hashing (SDAH), to accomplish the ANN for the large-scale RSIR task. The assumption of our model is that the RS images have been represented by the proper visual features. First, a residual auto-encoder (RAE) is developed to generate the class variable and hash code. Second, two multi-layer networks are constructed to regularize the obtained latent vectors using the prior distribution. These two modules mentioned are integrated under the generator adversarial framework. Through the minimax learning, the class variable would be a one-hot-like vector while the hash code would be the binary-like vector. Finally, a specific hashing function is formulated to enhance the quality of the generated hash code. The effectiveness of the hash codes learned by our SDAH model was proved by the positive experimental results counted on three public RS image archives. Compared with the existing hash learning methods, the proposed method reaches improved performance.

scholarly journals A Semantic-Preserving Deep Hashing Model for Multi-Label Remote Sensing Image Retrieval

2021 ◽  
Vol 13 (24) ◽  
pp. 4965
Author(s):  
Qimin Cheng ◽  
Haiyan Huang ◽  
Lan Ye ◽  
Peng Fu ◽  
Deqiao Gan ◽  
...  
Keyword(s):  
Remote Sensing ◽  
Image Retrieval ◽  
Semantic Information ◽  
Nearest Neighbor ◽  
Remote Sensing Data ◽  
Semantic Content ◽  
Remote Sensing Image ◽  
Image Features ◽  
Practical Applications ◽  
Deep Hashing

Conventional remote sensing image retrieval (RSIR) systems perform single-label retrieval with a single label to represent the most dominant semantic content for an image. Improved spatial resolution dramatically boosts the remote sensing image scene complexity, as a remote sensing image always contains multiple categories of surface features. In this case, a single label cannot comprehensively describe the semantic content of a complex remote sensing image scene and therefore results in poor retrieval performance in practical applications. As a result, researchers have begun to pay attention to multi-label image retrieval. However, in the era of massive remote sensing data, how to increase retrieval efficiency and reduce feature storage while preserving semantic information remains unsolved. Considering the powerful capability of hashing learning in overcoming the curse of dimensionality caused by high-dimensional image representation in Approximate Nearest Neighbor (ANN) search problems, we propose a new semantic-preserving deep hashing model for multi-label remote sensing image retrieval. Our model consists of three main components: (1) a convolutional neural network to extract image features; (2) a hash layer to generate binary codes; (3) a new loss function to better maintain the multi-label semantic information of hash learning contained in context remote sensing image scene. As far as we know, this is the first attempt to apply deep hashing into the multi-label remote sensing image retrieval. Experimental results indicate the effectiveness and promising of the introduction of hashing methods in the multi-label remote sensing image retrieval.

scholarly journals A Discriminative Feature Learning Approach for Remote Sensing Image Retrieval

2019 ◽  
Vol 11 (3) ◽  
pp. 281 ◽  
Author(s):  
Wei Xiong ◽  
Yafei Lv ◽  
Yaqi Cui ◽  
Xiaohan Zhang ◽  
Xiangqi Gu
Keyword(s):  
Remote Sensing ◽  
Image Retrieval ◽  
Network Structure ◽  
Feature Learning ◽  
Decisive Role ◽  
Remote Sensing Image ◽  
Feature Representations ◽  
Discriminative Feature ◽  
Comparison Of The Results ◽  
Significant Effort

Effective feature representations play a decisive role in content-based remote sensing image retrieval (CBRSIR). Recently, learning-based features have been widely used in CBRSIR and they show powerful ability of feature representations. In addition, a significant effort has been made to improve learning-based features from the perspective of the network structure. However, these learning-based features are not sufficiently discriminative for CBRSIR. In this paper, we propose two effective schemes for generating discriminative features for CBRSIR. In the first scheme, the attention mechanism and a new attention module are introduced to the Convolutional Neural Networks (CNNs) structure, causing more attention towards salient features, and the suppression of other features. In the second scheme, a multi-task learning network structure is proposed, to force learning-based features to be more discriminative, with inter-class dispersion and intra-class compaction, through penalizing the distances between the feature representations and their corresponding class centers. Then, a new method for constructing more challenging datasets is first used for remote sensing image retrieval, to better validate our schemes. Extensive experiments on challenging datasets are conducted to evaluate the effectiveness of our two schemes, and the comparison of the results demonstrate that our proposed schemes, especially the fusion of the two schemes, can improve the baseline methods by a significant margin.

Sign in / Sign up

Export Citation Format

Share Document