scholarly journals Deep Convolutional Capsule Network for Hyperspectral Image Spectral and Spectral-Spatial Classification

2019 ◽  
Vol 11 (3) ◽  
pp. 223 ◽  
Author(s):  
Kaiqiang Zhu ◽  
Yushi Chen ◽  
Pedram Ghamisi ◽  
Xiuping Jia ◽  
Jón Atli Benediktsson
Keyword(s):  
Network Architecture ◽  
Hyperspectral Image ◽  
Principal Component ◽  
Hyperspectral Data ◽  
Support Vector ◽  
Data Sets ◽  
Spatial Classification ◽  
Training Samples ◽  
Vector Machines ◽  
Kernel Support Vector Machines

Capsule networks can be considered to be the next era of deep learning and have recently shown their advantages in supervised classification. Instead of using scalar values to represent features, the capsule networks use vectors to represent features, which enriches the feature presentation capability. This paper introduces a deep capsule network for hyperspectral image (HSI) classification to improve the performance of the conventional convolutional neural networks (CNNs). Furthermore, a modification of the capsule network named Conv-Capsule is proposed. Instead of using full connections, local connections and shared transform matrices, which are the core ideas of CNNs, are used in the Conv-Capsule network architecture. In Conv-Capsule, the number of trainable parameters is reduced compared to the original capsule, which potentially mitigates the overfitting issue when the number of available training samples is limited. Specifically, we propose two schemes: (1) A 1D deep capsule network is designed for spectral classification, as a combination of principal component analysis, CNN, and the Conv-Capsule network, and (2) a 3D deep capsule network is designed for spectral-spatial classification, as a combination of extended multi-attribute profiles, CNN, and the Conv-Capsule network. The proposed classifiers are tested on three widely-used hyperspectral data sets. The obtained results reveal that the proposed models provide competitive results compared to the state-of-the-art methods, including kernel support vector machines, CNNs, and recurrent neural network.

An Incremental Isomap Method for Hyperspectral Dimensionality Reduction and Classification

2021 ◽  
Vol 87 (6) ◽  
pp. 445-455
Author(s):  
Yi Ma ◽  
Zezhong Zheng ◽  
Yutang Ma ◽  
Mingcang Zhu ◽  
Ran Huang ◽  
...  
Keyword(s):  
Manifold Learning ◽  
Nearest Neighbor ◽  
Hyperspectral Image ◽  
Hyperspectral Data ◽  
Training Data ◽  
Support Vector ◽  
Data Sets ◽  
K Nearest Neighbor ◽  
Data Set ◽  
Data Points

Many manifold learning algorithms conduct an eigen vector analysis on a data-similarity matrix with a size of N×N, where N is the number of data points. Thus, the memory complexity of the analysis is no less than O(N2). We pres- ent in this article an incremental manifold learning approach to handle large hyperspectral data sets for land use identification. In our method, the number of dimensions for the high-dimensional hyperspectral-image data set is obtained with the training data set. A local curvature varia- tion algorithm is utilized to sample a subset of data points as landmarks. Then a manifold skeleton is identified based on the landmarks. Our method is validated on three AVIRIS hyperspectral data sets, outperforming the comparison algorithms with a k–nearest-neighbor classifier and achieving the second best performance with support vector machine.

scholarly journals Hyperspectral image classification using support vector machines

2020 ◽  
Vol 9 (4) ◽  
pp. 684
Author(s):  
Jonnadula Dr.J.Harikiran Harikiran
Keyword(s):  
Support Vector Machines ◽  
Image Classification ◽  
Hyperspectral Image ◽  
Principal Component ◽  
Support Vector ◽  
Hyperspectral Image Classification ◽  
Novel Approach ◽  
Mode Decomposition ◽  
Vector Machines ◽  
Bidimensional Empirical Mode Decomposition

In this paper, a novel approach for hyperspectral image classification technique is presented using principal component analysis (PCA), bidimensional empirical mode decomposition (BEMD) and support vector machines (SVM). In this process, using PCA feature extraction technique on Hyperspectral Dataset, the first principal component is extracted. This component is supplied as input to BEMD algorithm, which divides the component into four parts, the first three parts represents intrensic mode functions (IMF) and last part shows the residue. These BIMFs and residue image is further taken as input to the SVM for classification. The results of experiments on two popular datasets of hyperspectral remote sensing scenes represent that the proposed-model offers a competitive analyticalperformance in comparison to some established methods.

scholarly journals Differential Privacy Principal Component Analysis for Support Vector Machines

2021 ◽  
Vol 2021 ◽  
pp. 1-12
Author(s):  
Yuxian Huang ◽  
Geng Yang ◽  
Yahong Xu ◽  
Hao Zhou
Keyword(s):  
Principal Component Analysis ◽  
Classification Accuracy ◽  
Differential Privacy ◽  
Principal Component ◽  
Component Analysis ◽  
High Dimensional ◽  
Support Vector ◽  
Data Sets ◽  
Vector Machines ◽  
Fast Classification

In big data era, massive and high-dimensional data is produced at all times, increasing the difficulty of analyzing and protecting data. In this paper, in order to realize dimensionality reduction and privacy protection of data, principal component analysis (PCA) and differential privacy (DP) are combined to handle these data. Moreover, support vector machine (SVM) is used to measure the availability of processed data in our paper. Specifically, we introduced differential privacy mechanisms at different stages of the algorithm PCA-SVM and obtained the algorithms DPPCA-SVM and PCADP-SVM. Both algorithms satisfy ε , 0 -DP while achieving fast classification. In addition, we evaluate the performance of two algorithms in terms of noise expectation and classification accuracy from the perspective of theoretical proof and experimental verification. To verify the performance of DPPCA-SVM, we also compare our DPPCA-SVM with other algorithms. Results show that DPPCA-SVM provides excellent utility for different data sets despite guaranteeing stricter privacy.

Semi-Supervised Classification for Hyperspectral Image Based on Tri-Training

2014 ◽  
Vol 687-691 ◽  
pp. 3644-3647 ◽  
Author(s):  
Li Guo Wang ◽  
Yue Shuang Yang ◽  
Ting Ting Lu
Keyword(s):  
Supervised Classification ◽  
Hyperspectral Image ◽  
Learning Algorithm ◽  
Hyperspectral Data ◽  
Data Sets ◽  
Hyperspectral Image Classification ◽  
Training Set ◽  
De Algorithm ◽  
Training Samples ◽  
Limited Training Samples

Hyperspectral image classification is difficult due to the high dimensional features but limited training samples. Tri-training learning is a widely used semi-supervised classification method that addresses the problem of lacking of labeled examples. In this paper, a novel semi-supervised learning algorithm based on tri-training method is proposed. The proposed algorithm combines margin sampling (MS) technique and differential evolution (DE) algorithm to select the most informative samples and perturb them randomly. Then the samples we obtained, which can fulfill the labeled data distribution and introduce diversity to multiple classifiers, are added to training set to train base classifiers for tri-training. The proposed algorithm is experimentally validated using real hyperspectral data sets, indicating that the combination of MS and DE can significantly reduce the need of labeled samples while achieving high accuracy compared with state-of-the-art algorithms.

scholarly journals Hyperspectral Image Classification with Capsule Network Using Limited Training Samples

Sensors ◽  
2018 ◽  
Vol 18 (9) ◽  
pp. 3153 ◽  
Author(s):  
Fei Deng ◽  
Shengliang Pu ◽  
Xuehong Chen ◽  
Yusheng Shi ◽  
Ting Yuan ◽  
...  
Keyword(s):  
Neural Networks ◽  
Deep Learning ◽  
Network Architecture ◽  
Hyperspectral Image ◽  
Machine Learning Algorithms ◽  
Superior Performance ◽  
Support Vector ◽  
Complex Data ◽  
Training Samples ◽  
Limited Training Samples

Deep learning techniques have boosted the performance of hyperspectral image (HSI) classification. In particular, convolutional neural networks (CNNs) have shown superior performance to that of the conventional machine learning algorithms. Recently, a novel type of neural networks called capsule networks (CapsNets) was presented to improve the most advanced CNNs. In this paper, we present a modified two-layer CapsNet with limited training samples for HSI classification, which is inspired by the comparability and simplicity of the shallower deep learning models. The presented CapsNet is trained using two real HSI datasets, i.e., the PaviaU (PU) and SalinasA datasets, representing complex and simple datasets, respectively, and which are used to investigate the robustness or representation of every model or classifier. In addition, a comparable paradigm of network architecture design has been proposed for the comparison of CNN and CapsNet. Experiments demonstrate that CapsNet shows better accuracy and convergence behavior for the complex data than the state-of-the-art CNN. For CapsNet using the PU dataset, the Kappa coefficient, overall accuracy, and average accuracy are 0.9456, 95.90%, and 96.27%, respectively, compared to the corresponding values yielded by CNN of 0.9345, 95.11%, and 95.63%. Moreover, we observed that CapsNet has much higher confidence for the predicted probabilities. Subsequently, this finding was analyzed and discussed with probability maps and uncertainty analysis. In terms of the existing literature, CapsNet provides promising results and explicit merits in comparison with CNN and two baseline classifiers, i.e., random forests (RFs) and support vector machines (SVMs).

scholarly journals Spatial–Spectral Squeeze-and-Excitation Residual Network for Hyperspectral Image Classification

2019 ◽  
Vol 11 (7) ◽  
pp. 884 ◽  
Author(s):  
Li Wang ◽  
Jiangtao Peng ◽  
Weiwei Sun
Keyword(s):  
Network Architecture ◽  
Spatial Information ◽  
Hyperspectral Image ◽  
Hyperspectral Data ◽  
Data Sets ◽  
Learning Networks ◽  
Hyperspectral Image Classification ◽  
Residual Network ◽  
Noise Interference ◽  
Spectral Bands

Jointly using spectral and spatial information has become a mainstream strategy in the field of hyperspectral image (HSI) processing, especially for classification. However, due to the existence of noisy or correlated spectral bands in the spectral domain and inhomogeneous pixels in the spatial neighborhood, HSI classification results are often degraded and unsatisfactory. Motivated by the attention mechanism, this paper proposes a spatial–spectral squeeze-and-excitation (SSSE) module to adaptively learn the weights for different spectral bands and for different neighboring pixels. The SSSE structure can suppress or motivate features at a certain position, which can effectively resist noise interference and improve the classification results. Furthermore, we embed several SSSE modules into a residual network architecture and generate an SSSE-based residual network (SSSERN) model for HSI classification. The proposed SSSERN method is compared with several existing deep learning networks on two benchmark hyperspectral data sets. Experimental results demonstrate the effectiveness of our proposed network.

scholarly journals Locating Impact on Structural Plate Using Principal Component Analysis and Support Vector Machines

2013 ◽  
Vol 2013 ◽  
pp. 1-8 ◽  
Author(s):  
Heming Fu ◽  
Qingsong Xu
Keyword(s):  
Principal Component Analysis ◽  
Support Vector Machines ◽  
Principal Component ◽  
Original Data ◽  
Component Analysis ◽  
Support Vector ◽  
Data Sets ◽  
Vector Machines ◽  
Pca Algorithm ◽  
The Impact

A new method which integrates principal component analysis (PCA) and support vector machines (SVM) is presented to predict the location of impact on a clamped aluminum plate structure. When the plate is knocked using an instrumented hammer, the induced time-varying strain signals are collected by four piezoelectric sensors which are mounted on the plate surface. The PCA algorithm is adopted for the dimension reduction of the large original data sets. Afterwards, a new two-layer SVM regression framework is proposed to improve the impact location accuracy. For a comparison study, the conventional backpropagation neural networks (BPNN) approach is implemented as well. Experimental results show that the proposed strategy achieves much better locating accuracy in comparison with the conventional approach.

scholarly journals Hyperspectral image classification based on multi-layer feature extraction

2018 ◽  
Vol 246 ◽  
pp. 03046
Author(s):  
Yongfeng Qi ◽  
Xujie Yang
Keyword(s):  
Feature Extraction ◽  
Image Classification ◽  
Hyperspectral Image ◽  
Recognition Rate ◽  
Principal Component ◽  
Feature Reduction ◽  
Data Sets ◽  
Hyperspectral Image Classification ◽  
Training Samples ◽  
Linear Svm

The Hyperspectral image classification is an important issue, which has been pursued in recent year. The field of application involves many aspects of life. Hyperspectral images (HSIs) exhibit a limited number of labeled high-dimensional training samples, which limits the performance of some classification methods on feature extraction or feature reduction. In the paper, we propose a supervised method based on the PCA network (PCANet) and linear SVM for HSIs classification. We used PCANet (principal component analysis network) to learn the character features. We verified the influence of these parameters on the performance of PCANet by modifying the key parameters of the experiment. We carry out extensive experiments on India pines dataset. The results demonstrate that our method significantly outperforms PCA+KNN methods . And the results not only are optimistic but also the recognition rate can reach 94.29%. At last, we compared the experimental results of the same algorithm on different data sets and so on.

scholarly journals Hyperspectral Image Spectral–Spatial Classification Method Based on Deep Adaptive Feature Fusion

2021 ◽  
Vol 13 (4) ◽  
pp. 746
Author(s):  
Caihong Mu ◽  
Yijin Liu ◽  
Yi Liu
Keyword(s):  
Short Term Memory ◽  
Hyperspectral Image ◽  
Feature Fusion ◽  
Principal Component ◽  
Classification Method ◽  
Spectral Features ◽  
Spatial Classification ◽  
Training Samples ◽  
Adaptive Fusion ◽  
Edge Features

Convolutional neural networks (CNNs) have been widely used in hyperspectral image (HSI) classification. Many algorithms focus on the deep extraction of a single kind of feature to improve classification. There have been few studies on the deep extraction of two or more kinds of fusion features and the combination of spatial and spectral features for classification. The authors of this paper propose an HSI spectral–spatial classification method based on deep adaptive feature fusion (SSDF). This method first implements the deep adaptive fusion of two hyperspectral features, and then it performs spectral–spatial classification on the fused features. In SSDF, a U-shaped deep network model with the principal component features as the model input and the edge features as the model label is designed to adaptively fuse two kinds of different features. One comprises the edge features of the HSIs extracted by the guided filter, and the other comprises the principal component features obtained by dimensionality reduction of HSIs using principal component analysis. The fused new features are input into a multi-scale and multi-level feature extraction model for further extraction of deep features, which are then combined with the spectral features extracted by the long short-term memory (LSTM) model for classification. The experimental results on three datasets demonstrated that the performance of the proposed SSDF was superior to several state-of-the-art methods. Additionally, SSDF was found to be able to perform best as the number of training samples decreased sharply, and it could also obtain a high classification accuracy for categories with few samples.

Sign in / Sign up

Export Citation Format

Share Document