scholarly journals Random Collective Representation-Based Detector with Multiple Features for Hyperspectral Images

2021 ◽  
Vol 13 (4) ◽  
pp. 721
Author(s):  
Zhongheng Li ◽  
Fang He ◽  
Haojie Hu ◽  
Fei Wang ◽  
Weizhong Yu
Keyword(s):  
Anomaly Detection ◽  
Hyperspectral Image ◽  
Spectral Feature ◽  
Collaborative Representation ◽  
Detection Accuracy ◽  
Spatial Features ◽  
Collective Representation ◽  
Detection Approach ◽  
Adaptive Weight ◽  
Gabor Feature

Collaborative representation-based detector (CRD), as the most representative anomaly detection method, has been widely applied in the field of hyperspectral anomaly detection (HAD). However, the sliding dual window of the original CRD introduces high computational complexity. Moreover, most HAD models only consider a single spectral or spatial feature of the hyperspectral image (HSI), which is unhelpful for improving detection accuracy. To solve these problems, in terms of speed and accuracy, we propose a novel anomaly detection approach, named Random Collective Representation-based Detector with Multiple Feature (RCRDMF). This method includes the following steps. This method first extract the different features include spectral feature, Gabor feature, extended multiattribute profile (EMAP) feature, and extended morphological profile (EMP) feature matrix from the HSI image, which enables us to improve the accuracy of HAD by combining the multiple spectral and spatial features. The ensemble and random collaborative representation detector (ERCRD) method is then applied, which can improve the anomaly detection speed. Finally, an adaptive weight approach is proposed to calculate the weight for each feature. Experimental results on six hyperspectral datasets demonstrate that the proposed approach has the superiority over accuracy and speed.

scholarly journals A Spectral Spatial Attention Fusion with Deformable Convolutional Residual Network for Hyperspectral Image Classification

2021 ◽  
Vol 13 (18) ◽  
pp. 3590
Author(s):  
Tianyu Zhang ◽  
Cuiping Shi ◽  
Diling Liao ◽  
Liguo Wang
Keyword(s):  
Image Classification ◽  
Spatial Attention ◽  
Hyperspectral Image ◽  
Spectral Feature ◽  
Hyperspectral Images ◽  
Spectral Features ◽  
Hyperspectral Image Classification ◽  
Residual Network ◽  
Spatial Features ◽  
Training Samples

Convolutional neural networks (CNNs) have exhibited excellent performance in hyperspectral image classification. However, due to the lack of labeled hyperspectral data, it is difficult to achieve high classification accuracy of hyperspectral images with fewer training samples. In addition, although some deep learning techniques have been used in hyperspectral image classification, due to the abundant information of hyperspectral images, the problem of insufficient spatial spectral feature extraction still exists. To address the aforementioned issues, a spectral–spatial attention fusion with a deformable convolution residual network (SSAF-DCR) is proposed for hyperspectral image classification. The proposed network is composed of three parts, and each part is connected sequentially to extract features. In the first part, a dense spectral block is utilized to reuse spectral features as much as possible, and a spectral attention block that can refine and optimize the spectral features follows. In the second part, spatial features are extracted and selected by a dense spatial block and attention block, respectively. Then, the results of the first two parts are fused and sent to the third part, and deep spatial features are extracted by the DCR block. The above three parts realize the effective extraction of spectral–spatial features, and the experimental results for four commonly used hyperspectral datasets demonstrate that the proposed SSAF-DCR method is superior to some state-of-the-art methods with very few training samples.

scholarly journals Hyperspectral Anomaly Detection Based on Separability-Aware Sample Cascade

2019 ◽  
Vol 11 (21) ◽  
pp. 2537 ◽  
Author(s):  
Dandan Ma ◽  
Yuan Yuan ◽  
Qi Wang
Keyword(s):  
Anomaly Detection ◽  
Large Scale ◽  
Hyperspectral Image ◽  
Superior Performance ◽  
Detection Methods ◽  
Background Information ◽  
Detection Accuracy ◽  
Layer By Layer ◽  
Edge Preserving ◽  
Image Pixels

A hyperspectral image usually covers a large scale of ground scene, which contains various materials with different spectral properties. When directly exploring the background information using all the image pixels, complex spectral interactions and inter-/intra-difference of different samples will significantly reduce the accuracy of background evaluation and further affect the detection performance. To address this problem, this paper proposes a novel hyperspectral anomaly detection method based on separability-aware sample cascade model. Through identifying separability of hyperspectral pixels, background samples are sifted out layer-by-layer according to their separable degrees from anomalies, which can ensure the accuracy and distinctiveness of background representation. First, as spatial structure is beneficial for recognizing target, a new spectral–spatial feature extraction technique is used in this work based on the PCA technique and edge-preserving filtering. Second, depending on different separability computed by sparse representation, samples are separated into different sets which can effectively and completely reflect various characteristics of background across all the cascade layers. Meanwhile, some potential abnormal targets are removed at each selection step to avoid their effects on subsequent layers. Finally, comprehensively taking different good properties of all the separability-aware layers into consideration, a simple multilayer anomaly detection strategy is adopted to obtain the final detection map. Extensive experimental results on five real-world hyperspectral images demonstrate our method’s superior performance. Compared with seven representative anomaly detection methods, our method improves the average detection accuracy with great advantages.

scholarly journals Structured Background Modeling for Hyperspectral Anomaly Detection

Sensors ◽  
2018 ◽  
Vol 18 (9) ◽  
pp. 3137 ◽  
Author(s):  
Fei Li ◽  
Lei Zhang ◽  
Xiuwei Zhang ◽  
Yanjia Chen ◽  
Dongmei Jiang ◽  
...  
Keyword(s):  
Anomaly Detection ◽  
Hyperspectral Image ◽  
Principal Component ◽  
Background Modeling ◽  
Low Rank ◽  
Detection Methods ◽  
Detection Accuracy ◽  
Scene Modeling ◽  
Real World Datasets ◽  
Block Diagonal

Background modeling has been proven to be a promising method of hyperspectral anomaly detection. However, due to the cluttered imaging scene, modeling the background of an hyperspectral image (HSI) is often challenging. To mitigate this problem, we propose a novel structured background modeling-based hyperspectral anomaly detection method, which clearly improves the detection accuracy through exploiting the block-diagonal structure of the background. Specifically, to conveniently model the multi-mode characteristics of background, we divide the full-band patches in an HSI into different background clusters according to their spatial-spectral features. A spatial-spectral background dictionary is then learned for each cluster with a principal component analysis (PCA) learning scheme. When being represented onto those dictionaries, the background often exhibits a block-diagonal structure, while the anomalous target shows a sparse structure. In light of such an observation, we develop a low-rank representation based anomaly detection framework that can appropriately separate the sparse anomaly from the block-diagonal background. To optimize this framework effectively, we adopt the standard alternating direction method of multipliers (ADMM) algorithm. With extensive experiments on both synthetic and real-world datasets, the proposed method achieves an obvious improvement in detection accuracy, compared with several state-of-the-art hyperspectral anomaly detection methods.

scholarly journals DBMF: A Novel Method for Tree Species Fusion Classification Based on Multi-Source Images

Forests ◽  
2021 ◽  
Vol 13 (1) ◽  
pp. 33
Author(s):  
Xueliang Wang ◽  
Honge Ren
Keyword(s):  
Tree Species ◽  
Short Term Memory ◽  
Hyperspectral Image ◽  
Species Recognition ◽  
Spectral Feature ◽  
Activation Function ◽  
Spectral Features ◽  
Spatial Features ◽  
Source Data ◽  
Fusion Methods

Multi-source data remote sensing provides innovative technical support for tree species recognition. Tree species recognition is relatively poor despite noteworthy advancements in image fusion methods because the features from multi-source data for each pixel in the same region cannot be deeply exploited. In the present paper, a novel deep learning approach for hyperspectral imagery is proposed to improve accuracy for the classification of tree species. The proposed method, named the double branch multi-source fusion (DBMF) method, could more deeply determine the relationship between multi-source data and provide more effective information. The DBMF method does this by fusing spectral features extracted from a hyperspectral image (HSI) captured by the HJ-1A satellite and spatial features extracted from a multispectral image (MSI) captured by the Sentinel-2 satellite. The network has two branches in the spatial branch to avoid the risk of information loss, of which, sandglass blocks are embedded into a convolutional neural network (CNN) to extract the corresponding spatial neighborhood features from the MSI. Simultaneously, to make the useful spectral feature transfer more effective in the spectral branch, we employed bidirectional long short-term memory (Bi-LSTM) with a triple attention mechanism to extract the spectral features of each pixel in the HSI with low resolution. The feature information is fused to classify the tree species after the addition of a fusion activation function, which could allow the network to obtain more interactive information. Finally, the fusion strategy allows for the prediction of the full classification map of three study areas. Experimental results on a multi-source dataset show that DBMF has a significant advantage over other state-of-the-art frameworks.

scholarly journals Anomaly Detection for Hyperspectral Imagery Based on the Regularized Subspace Method and Collaborative Representation

2019 ◽  
Vol 11 (11) ◽  
pp. 1318 ◽  
Author(s):  
Kun Tan ◽  
Zengfu Hou ◽  
Fuyu Wu ◽  
Qian Du ◽  
Yu Chen
Keyword(s):  
Anomaly Detection ◽  
Spatial Information ◽  
Collaborative Representation ◽  
Detection Accuracy ◽  
Subspace Method ◽  
Outlier Removal ◽  
Computational Speed ◽  
Anomaly Detector ◽  
Computationally Expensive ◽  
Inverse Distance

Most of the conventional anomaly detectors only take advantage of the spectral information and do not consider the spatial information within neighboring pixels. Recently, the spectral-spatial based local summation anomaly detection (LSAD) algorithm has achieved excellent detection performances. In order to obtain various local spatial distributions with the neighboring pixels of the pixels under test, the LSAD algorithm exploits a multiple-window sliding filter, which can be computationally expensive and time-consuming. In this paper, to address these issues, two modified LSAD-based methods are proposed. The first method, called local summation unsupervised nearest regularized subspace with an outlier removal anomaly detector (LSUNRSORAD), is based on the concept that each pixel in the background can be approximately represented by its spatial neighborhood. The second method, called local summation anomaly detection based on collaborative representation and inverse distance weight (LSAD-CR-IDW), uses the surrounding pixels collected inside the outer window, while outside the inner window, to linearly represent the test pixel and introduces collaborative representation and inverse distance weight to further improve the computational speed and detection precision, respectively. The proposed methods were applied to a synthetic dataset and three real datasets. The experimental results show that the proposed methods have a better detection accuracy and computational speed when compared with the LSAD algorithm and others.

scholarly journals A Spatial-Spectral Feature Descriptor for Hyperspectral Image Matching

2021 ◽  
Vol 13 (23) ◽  
pp. 4912
Author(s):  
Yang Yu ◽  
Yong Ma ◽  
Xiaoguang Mei ◽  
Fan Fan ◽  
Jun Huang ◽  
...  
Keyword(s):  
Image Matching ◽  
Hyperspectral Image ◽  
Spectral Feature ◽  
Feature Descriptor ◽  
Spectral Features ◽  
Grayscale Image ◽  
Critical Problem ◽  
Spatial Features ◽  
Feature Descriptors ◽  
Wide Range

Hyperspectral Images (HSIs) have been utilized in many fields which contain spatial and spectral features of objects simultaneously. Hyperspectral image matching is a fundamental and critical problem in a wide range of HSI applications. Feature descriptors for grayscale image matching are well studied, but few descriptors are elaborately designed for HSI matching. HSI descriptors, which should have made good use of the spectral feature, are essential in HSI matching tasks. Therefore, this paper presents a descriptor for HSI matching, called HOSG-SIFT, which ensembles spectral features with spatial features of objects. First, we obtain the grayscale image by dimensional reduction from HSI and apply it to extract keypoints and descriptors of spatial features. Second, the descriptors of spectral features are designed based on the histogram of the spectral gradient (HOSG), which effectively preserves the physical significance of the spectral profile. Third, we concatenate the spatial descriptors and spectral descriptors with the same weights into a new descriptor and apply it for HSI matching. Experimental results demonstrate that the proposed HOSG-SIFT performs superior against traditional feature descriptors.

scholarly journals OutlierNets: Highly Compact Deep Autoencoder Network Architectures for On-Device Acoustic Anomaly Detection

Sensors ◽  
2021 ◽  
Vol 21 (14) ◽  
pp. 4805
Author(s):  
Saad Abbasi ◽  
Mahmoud Famouri ◽  
Mohammad Javad Shafiee ◽  
Alexander Wong
Keyword(s):  
Machine Learning ◽  
Anomaly Detection ◽  
Detection Methods ◽  
Detection Accuracy ◽  
Network Architectures ◽  
Design Exploration ◽  
Convolutional Autoencoder ◽  
Acoustic Anomaly ◽  
Human Operators ◽  
Computational Resources

Human operators often diagnose industrial machinery via anomalous sounds. Given the new advances in the field of machine learning, automated acoustic anomaly detection can lead to reliable maintenance of machinery. However, deep learning-driven anomaly detection methods often require an extensive amount of computational resources prohibiting their deployment in factories. Here we explore a machine-driven design exploration strategy to create OutlierNets, a family of highly compact deep convolutional autoencoder network architectures featuring as few as 686 parameters, model sizes as small as 2.7 KB, and as low as 2.8 million FLOPs, with a detection accuracy matching or exceeding published architectures with as many as 4 million parameters. The architectures are deployed on an Intel Core i5 as well as a ARM Cortex A72 to assess performance on hardware that is likely to be used in industry. Experimental results on the model’s latency show that the OutlierNet architectures can achieve as much as 30x lower latency than published networks.

scholarly journals Using UAV-Based Hyperspectral Imagery to Detect Winter Wheat Fusarium Head Blight

2021 ◽  
Vol 13 (15) ◽  
pp. 3024
Author(s):  
Huiqin Ma ◽  
Wenjiang Huang ◽  
Yingying Dong ◽  
Linyi Liu ◽  
Anting Guo
Keyword(s):  
Winter Wheat ◽  
Fusarium Head Blight ◽  
Hyperspectral Imagery ◽  
Spectral Feature ◽  
Support Vector ◽  
Detection Accuracy ◽  
Feature Combination ◽  
Field Scale ◽  
Head Blight ◽  
Detection Model

Fusarium head blight (FHB) is a major winter wheat disease in China. The accurate and timely detection of wheat FHB is vital to scientific field management. By combining three types of spectral features, namely, spectral bands (SBs), vegetation indices (VIs), and wavelet features (WFs), in this study, we explore the potential of using hyperspectral imagery obtained from an unmanned aerial vehicle (UAV), to detect wheat FHB. First, during the wheat filling period, two UAV-based hyperspectral images were acquired. SBs, VIs, and WFs that were sensitive to wheat FHB were extracted and optimized from the two images. Subsequently, a field-scale wheat FHB detection model was formulated, based on the optimal spectral feature combination of SBs, VIs, and WFs (SBs + VIs + WFs), using a support vector machine. Two commonly used data normalization algorithms were utilized before the construction of the model. The single WFs, and the spectral feature combination of optimal SBs and VIs (SBs + VIs), were respectively used to formulate models for comparison and testing. The results showed that the detection model based on the normalized SBs + VIs + WFs, using min–max normalization algorithm, achieved the highest R2 of 0.88 and the lowest RMSE of 2.68% among the three models. Our results suggest that UAV-based hyperspectral imaging technology is promising for the field-scale detection of wheat FHB. Combining traditional SBs and VIs with WFs can improve the detection accuracy of wheat FHB effectively.

Sign in / Sign up

Export Citation Format

Share Document