scholarly journals A NOVEL SELF-TAUGHT LEARNING FRAMEWORK USING SPATIAL PYRAMID MATCHING FOR SCENE CLASSIFICATION

2020 ◽  
Vol XLIII-B2-2020 ◽  
pp. 725-729
Author(s):  
Y. Yang ◽  
D. Zhu ◽  
F. Ren ◽  
C. Cheng
Keyword(s):  
Remote Sensing ◽  
Classification Accuracy ◽  
Earth Observation ◽  
Data Sets ◽  
Scene Classification ◽  
Data Set ◽  
Spatial Pyramid Matching ◽  
Learning Framework ◽  
Pyramid Matching ◽  
Spatial Pyramid

Abstract. Remote sensing earth observation images have a wide range of applications in areas like urban planning, agriculture, environment monitoring, etc. While the industrial world benefits from availability of high resolution earth observation images since recent years, interpreting such images has become more challenging than ever. Among many machine learning based methods that have worked out successfully in remote sensing scene classification, spatial pyramid matching using sparse coding (ScSPM) is a classical model that has achieved promising classification accuracy on many benchmark data sets. ScSPM is a three-stage algorithm, composed of dictionary learning, sparse representation and classification. It is generally believed that in the dictionary learning stage, although unsupervised, one should use the same data set as classification stage to get good results. However, recent studies in transfer learning suggest that it might be a better strategy to train the dictionary on a larger data set different from the one to classify.In our work, we propose an algorithm that combines ScSPM with self-taught learning, a transfer learning framework that trains a dictionary on an unlabeled data set and uses it for multiple classification tasks. In the experiments, we learn the dictionary on Caltech-101 data set, and classify two remote sensing scene image data sets: UC Merced LandUse data set and Changping data set. Experimental results show that the classification accuracy of proposed method is compatible to that of ScSPM. Our work thus provides a new way to reduce resource cost in learning a remote sensing scene image classifier.

scholarly journals Weighted Spatial Pyramid Matching Collaborative Representation for Remote-Sensing-Image Scene Classification

2019 ◽  
Vol 11 (5) ◽  
pp. 518 ◽  
Author(s):  
Bao-Di Liu ◽  
Jie Meng ◽  
Wen-Yang Xie ◽  
Shuai Shao ◽  
Ye Li ◽  
...  
Keyword(s):  
Remote Sensing ◽  
Spatial Information ◽  
Remote Sensing Image ◽  
Superior Performance ◽  
Collaborative Representation ◽  
Scene Classification ◽  
Spatial Pyramid Matching ◽  
Classification Tasks ◽  
Pyramid Matching ◽  
Spatial Pyramid

At present, nonparametric subspace classifiers, such as collaborative representation-based classification (CRC) and sparse representation-based classification (SRC), are widely used in many pattern-classification and -recognition tasks. Meanwhile, the spatial pyramid matching (SPM) scheme, which considers spatial information in representing the image, is efficient for image classification. However, for SPM, the weights to evaluate the representation of different subregions are fixed. In this paper, we first introduce the spatial pyramid matching scheme to remote-sensing (RS)-image scene-classification tasks to improve performance. Then, we propose a weighted spatial pyramid matching collaborative-representation-based classification method, combining the CRC method with the weighted spatial pyramid matching scheme. The proposed method is capable of learning the weights of different subregions in representing an image. Finally, extensive experiments on several benchmark remote-sensing-image datasets were conducted and clearly demonstrate the superior performance of our proposed algorithm when compared with state-of-the-art approaches.

scholarly journals A New Scene Classification Method Based on Local Gabor Features

2015 ◽  
Vol 2015 ◽  
pp. 1-14 ◽  
Author(s):  
Baoyu Dong ◽  
Guang Ren
Keyword(s):  
Classification Method ◽  
Scene Classification ◽  
Spatial Pyramid Matching ◽  
Visual Words ◽  
Feature Vectors ◽  
Feature Descriptors ◽  
Gabor Features ◽  
Gabor Feature ◽  
Pyramid Matching ◽  
Spatial Pyramid

A new scene classification method is proposed based on the combination of local Gabor features with a spatial pyramid matching model. First, new local Gabor feature descriptors are extracted from dense sampling patches of scene images. These local feature descriptors are embedded into a bag-of-visual-words (BOVW) model, which is combined with a spatial pyramid matching framework. The new local Gabor feature descriptors have sufficient discrimination abilities for dense regions of scene images. Then the efficient feature vectors of scene images can be obtained byK-means clustering method and visual word statistics. Second, in order to decrease classification time and improve accuracy, an improved kernel principal component analysis (KPCA) method is applied to reduce the dimensionality of pyramid histogram of visual words (PHOW). The principal components with the bigger interclass separability are retained in feature vectors, which are used for scene classification by the linear support vector machine (SVM) method. The proposed method is evaluated on three commonly used scene datasets. Experimental results demonstrate the effectiveness of the method.

Indoor Scene recognition for Micro Aerial Vehicles Navigation using Enhanced SIFT-ScSPM Descriptors

2019 ◽  
Vol 73 (1) ◽  
pp. 37-55 ◽  
Author(s):  
B. Anbarasu ◽  
G. Anitha
Keyword(s):  
State Of The Art ◽  
Scene Recognition ◽  
Support Vector ◽  
Scene Classification ◽  
Spatial Pyramid Matching ◽  
Speeded Up Robust Features ◽  
Indoor Scene ◽  
Visual Descriptors ◽  
Pyramid Matching ◽  
Spatial Pyramid

In this paper, a new scene recognition visual descriptor called Enhanced Scale Invariant Feature Transform-based Sparse coding Spatial Pyramid Matching (Enhanced SIFT-ScSPM) descriptor is proposed by combining a Bag of Words (BOW)-based visual descriptor (SIFT-ScSPM) and Gist-based descriptors (Enhanced Gist-Enhanced multichannel Gist (Enhanced mGist)). Indoor scene classification is carried out by multi-class linear and non-linear Support Vector Machine (SVM) classifiers. Feature extraction methodology and critical review of several visual descriptors used for indoor scene recognition in terms of experimental perspectives have been discussed in this paper. An empirical study is conducted on the Massachusetts Institute of Technology (MIT) 67 indoor scene classification data set and assessed the classification accuracy of state-of-the-art visual descriptors and the proposed Enhanced mGist, Speeded Up Robust Features-Spatial Pyramid Matching (SURF-SPM) and Enhanced SIFT-ScSPM visual descriptors. Experimental results show that the proposed Enhanced SIFT-ScSPM visual descriptor performs better with higher classification rate, precision, recall and area under the Receiver Operating Characteristic (ROC) curve values with respect to the state-of-the-art and the proposed Enhanced mGist and SURF-SPM visual descriptors.

scholarly journals A Multi-Branch Feature Fusion Strategy Based on an Attention Mechanism for Remote Sensing Image Scene Classification

2021 ◽  
Vol 13 (10) ◽  
pp. 1950
Author(s):  
Cuiping Shi ◽  
Xin Zhao ◽  
Liguo Wang
Keyword(s):  
Remote Sensing ◽  
Feature Extraction ◽  
Classification Accuracy ◽  
Feature Fusion ◽  
State Of The Art ◽  
Rapid Development ◽  
Remote Sensing Image ◽  
Classification Performance ◽  
Attention Mechanism ◽  
Scene Classification

In recent years, with the rapid development of computer vision, increasing attention has been paid to remote sensing image scene classification. To improve the classification performance, many studies have increased the depth of convolutional neural networks (CNNs) and expanded the width of the network to extract more deep features, thereby increasing the complexity of the model. To solve this problem, in this paper, we propose a lightweight convolutional neural network based on attention-oriented multi-branch feature fusion (AMB-CNN) for remote sensing image scene classification. Firstly, we propose two convolution combination modules for feature extraction, through which the deep features of images can be fully extracted with multi convolution cooperation. Then, the weights of the feature are calculated, and the extracted deep features are sent to the attention mechanism for further feature extraction. Next, all of the extracted features are fused by multiple branches. Finally, depth separable convolution and asymmetric convolution are implemented to greatly reduce the number of parameters. The experimental results show that, compared with some state-of-the-art methods, the proposed method still has a great advantage in classification accuracy with very few parameters.

scholarly journals Sentinel-1 and Sentinel-2 Data Fusion for Mapping and Monitoring Wetlands

2018 ◽  
Author(s):  
Gordana Kaplan ◽  
Ugur Avdan
Keyword(s):  
Remote Sensing ◽  
Satellite Data ◽  
Classification Accuracy ◽  
Accuracy Assessment ◽  
Geographical Information ◽  
Wetland Classification ◽  
Significant Information ◽  
Data Set ◽  
Object Based ◽  
Sentinel 2

Wetlands benefits can be summarized but are not limited to their ability to store floodwaters and improve water quality, providing habitats for wildlife and supporting biodiversity, as well as aesthetic values. Over the past few decades, remote sensing and geographical information technologies has proven to be a useful and frequent applications in monitoring and mapping wetlands. Combining both optical and microwave satellite data can give significant information about the biophysical characteristics of wetlands and wetlands` vegetation. Also, fusing data from different sensors, such as radar and optical remote sensing data, can increase the wetland classification accuracy. In this paper we investigate the ability of fusion two fine spatial resolution satellite data, Sentinel-2 and the Synthetic Aperture Radar Satellite, Sentinel-1, for mapping wetlands. As a study area in this paper, Balikdami wetland located in the Anatolian part of Turkey has been selected. Both Sentinel-1 and Sentinel-2 images require pre-processing before their use. After the pre-processing, several vegetation indices calculated from the Sentinel-2 bands were included in the data set. Furthermore, an object-based classification was performed. For the accuracy assessment of the obtained results, number of random points were added over the study area. In addition, the results were compared with data from Unmanned Aerial Vehicle collected on the same data of the overpass of the Sentinel-2, and three days before the overpass of Sentinel-1 satellite. The accuracy assessment showed that the results significant and satisfying in the wetland classification using both multispectral and microwave data. The statistical results of the fusion of the optical and radar data showed high wetland mapping accuracy, with an overall classification accuracy of approximately 90% in the object-based classification. Compared with the high resolution UAV data, the classification results give promising results for mapping and monitoring not just wetlands, but also the sub-classes of the study area. For future research, multi-temporal image use and terrain data collection are recommended.

scholarly journals Precipitation Trends over the Indus Basin

Climate ◽  
2019 ◽  
Vol 7 (10) ◽  
pp. 116 ◽  
Author(s):  
Nir Y. Krakauer ◽  
Tarendra Lakhankar ◽  
Ghulam H. Dars
Keyword(s):  
Remote Sensing ◽  
Large Population ◽  
Tropical Rainfall Measuring Mission ◽  
Indus Basin ◽  
Data Sets ◽  
Precipitation Trend ◽  
Precipitation Data ◽  
Data Set ◽  
Station Data ◽  
Precipitation Trends

A large population relies on water input to the Indus basin, yet basinwide precipitation amounts and trends are not well quantified. Gridded precipitation data sets covering different time periods and based on either station observations, satellite remote sensing, or reanalysis were compared with available station observations and analyzed for basinwide precipitation trends. Compared to observations, some data sets tended to greatly underestimate precipitation, while others overestimate it. Additionally, the discrepancies between data set and station precipitation showed significant time trends in such cases, suggesting that the precipitation trends of those data sets were not consistent with station data. Among the data sets considered, the station-based Global Precipitation Climatology Centre (GPCC) gridded data set showed good agreement with observations in terms of mean amount, trend, and spatial and temporal pattern. GPCC had average precipitation of about 500 mm per year over the basin and an increase in mean precipitation of about 15% between 1891 and 2016. For the more recent past, since 1958 or 1979, no significant precipitation trend was seen. Among the remote sensing based data sets, the Tropical Rainfall Measuring Mission Multi-Satellite Precipitation Analysis (TMPA) compared best to station observations and, though available for a shorter time period than station-based data sets such as GPCC, may be especially valuable for parts of the basin without station data. The reanalyses tended to have substantial biases in precipitation mean amount or trend relative to the station data. This assessment of precipitation data set quality and precipitation trends over the Indus basin may be helpful for water planning and management.

Sign in / Sign up

Export Citation Format

Share Document