scholarly journals Fine-Grained Classification of Hyperspectral Imagery Based on Deep Learning

2019 ◽  
Vol 11 (22) ◽  
pp. 2690 ◽  
Author(s):  
Yushi Chen ◽  
Lingbo Huang ◽  
Lin Zhu ◽  
Naoto Yokoya ◽  
Xiuping Jia
Keyword(s):  
Deep Learning ◽  
Spatial Information ◽  
Conditional Random Field ◽  
Hyperspectral Imagery ◽  
Principal Component ◽  
Processing Technique ◽  
Generative Adversarial Network ◽  
Data Set ◽  
Fine Grained

Hyperspectral remote sensing obtains abundant spectral and spatial information of the observed object simultaneously. It is an opportunity to classify hyperspectral imagery (HSI) with a fine-grained manner. In this study, the fine-grained classification of HSI, which contains a large number of classes, is investigated. On one hand, traditional classification methods cannot handle fine-grained classification of HSI well; on the other hand, deep learning methods have shown their powerfulness in fine-grained classification. So, in this paper, deep learning is explored for HSI supervised and semi-supervised fine-grained classification. For supervised HSI fine-grained classification, densely connected convolutional neural network (DenseNet) is explored for accurate classification. Moreover, DenseNet is combined with pre-processing technique (i.e., principal component analysis or auto-encoder) or post-processing technique (i.e., conditional random field) to further improve classification performance. For semi-supervised HSI fine-grained classification, a generative adversarial network (GAN), which includes a discriminative CNN and a generative CNN, is carefully designed. The GAN fully uses the labeled and unlabeled samples to improve classification accuracy. The proposed methods were tested on the Indian Pines data set, which contains 33,3951 samples with 52 classes. The experimental results show that the deep learning-based methods provide great improvements compared with other traditional methods, which demonstrate that deep models have huge potential for HSI fine-grained classification.

scholarly journals Crops Fine Classification in Airborne Hyperspectral Imagery Based on Multi-Feature Fusion and Deep Learning

2021 ◽  
Vol 13 (15) ◽  
pp. 2917
Author(s):  
Lifei Wei ◽  
Kun Wang ◽  
Qikai Lu ◽  
Yajing Liang ◽  
Haibo Li ◽  
...  
Keyword(s):  
Neural Network ◽  
Remote Sensing ◽  
Deep Learning ◽  
Random Field ◽  
Deep Neural Network ◽  
Spatial Information ◽  
Feature Fusion ◽  
Conditional Random Field ◽  
Hyperspectral Imagery ◽  
Fine Classification

Hyperspectral imagery has been widely used in precision agriculture due to its rich spectral characteristics. With the rapid development of remote sensing technology, the airborne hyperspectral imagery shows detailed spatial information and temporal flexibility, which open a new way to accurate agricultural monitoring. To extract crop types from the airborne hyperspectral images, we propose a fine classification method based on multi-feature fusion and deep learning. In this research, the morphological profiles, GLCM texture and endmember abundance features are leveraged to exploit the spatial information of the hyperspectral imagery. Then, the multiple spatial information is fused with the original spectral information to generate classification result by using the deep neural network with conditional random field (DNN+CRF) model. Specifically, the deep neural network (DNN) is a deep recognition model which can extract depth features and mine the potential information of data. As a discriminant model, conditional random field (CRF) considers both spatial and contextual information to reduce the misclassification noises while keeping the object boundaries. Moreover, three multiple feature fusion approaches, namely feature stacking, decision fusion and probability fusion, are taken into account. In the experiments, two airborne hyperspectral remote sensing datasets (Honghu dataset and Xiong’an dataset) are used. The experimental results show that the classification performance of the proposed method is satisfactory, where the salt and pepper noise is decreased, and the boundary of the ground object is preserved.

scholarly journals An Imbalanced Image Classification Method for the Cell Cycle Phase

Information ◽  
2021 ◽  
Vol 12 (6) ◽  
pp. 249
Author(s):  
Xin Jin ◽  
Yuanwen Zou ◽  
Zhongbing Huang
Keyword(s):  
Cell Cycle ◽  
Deep Learning ◽  
Image Classification ◽  
Classification Accuracy ◽  
Data Augmentation ◽  
Cycle Phase ◽  
Generative Adversarial Network ◽  
Adversarial Network ◽  
Cellular Life

The cell cycle is an important process in cellular life. In recent years, some image processing methods have been developed to determine the cell cycle stages of individual cells. However, in most of these methods, cells have to be segmented, and their features need to be extracted. During feature extraction, some important information may be lost, resulting in lower classification accuracy. Thus, we used a deep learning method to retain all cell features. In order to solve the problems surrounding insufficient numbers of original images and the imbalanced distribution of original images, we used the Wasserstein generative adversarial network-gradient penalty (WGAN-GP) for data augmentation. At the same time, a residual network (ResNet) was used for image classification. ResNet is one of the most used deep learning classification networks. The classification accuracy of cell cycle images was achieved more effectively with our method, reaching 83.88%. Compared with an accuracy of 79.40% in previous experiments, our accuracy increased by 4.48%. Another dataset was used to verify the effect of our model and, compared with the accuracy from previous results, our accuracy increased by 12.52%. The results showed that our new cell cycle image classification system based on WGAN-GP and ResNet is useful for the classification of imbalanced images. Moreover, our method could potentially solve the low classification accuracy in biomedical images caused by insufficient numbers of original images and the imbalanced distribution of original images.

Deep learning-driven velocity model building workflow

2019 ◽  
Vol 38 (11) ◽  
pp. 872a1-872a9 ◽  
Author(s):  
Mauricio Araya-Polo ◽  
Stuart Farris ◽  
Manuel Florez
Keyword(s):  
Deep Learning ◽  
Seismic Data ◽  
Model Building ◽  
Ground Truth ◽  
Velocity Model ◽  
Training Data ◽  
Quality Data ◽  
Generative Adversarial Network ◽  
Data Set ◽  
Velocity Models

Exploration seismic data are heavily manipulated before human interpreters are able to extract meaningful information regarding subsurface structures. This manipulation adds modeling and human biases and is limited by methodological shortcomings. Alternatively, using seismic data directly is becoming possible thanks to deep learning (DL) techniques. A DL-based workflow is introduced that uses analog velocity models and realistic raw seismic waveforms as input and produces subsurface velocity models as output. When insufficient data are used for training, DL algorithms tend to overfit or fail. Gathering large amounts of labeled and standardized seismic data sets is not straightforward. This shortage of quality data is addressed by building a generative adversarial network (GAN) to augment the original training data set, which is then used by DL-driven seismic tomography as input. The DL tomographic operator predicts velocity models with high statistical and structural accuracy after being trained with GAN-generated velocity models. Beyond the field of exploration geophysics, the use of machine learning in earth science is challenged by the lack of labeled data or properly interpreted ground truth, since we seldom know what truly exists beneath the earth's surface. The unsupervised approach (using GANs to generate labeled data)illustrates a way to mitigate this problem and opens geology, geophysics, and planetary sciences to more DL applications.

scholarly journals Image-based taxonomic classification of bulk biodiversity samples using deep learning and domain adaptation

2021 ◽  
Author(s):  
Tomochika Fujisawa ◽  
Victor Noguerales ◽  
Emmanouil Meramveliotakis ◽  
Anna Papadopoulou ◽  
Alfried P Vogler
Keyword(s):  
Deep Learning ◽  
High Throughput ◽  
Domain Adaptation ◽  
Network Models ◽  
Neural Network Models ◽  
Data Set ◽  
Model Training ◽  
Trained Neural Network ◽  
Domain Transfer

Complex bulk samples of invertebrates from biodiversity surveys present a great challenge for taxonomic identification, especially if obtained from unexplored ecosystems. High-throughput imaging combined with machine learning for rapid classification could overcome this bottleneck. Developing such procedures requires that taxonomic labels from an existing source data set are used for model training and prediction of an unknown target sample. Yet the feasibility of transfer learning for the classification of unknown samples remains to be tested. Here, we assess the efficiency of deep learning and domain transfer algorithms for family-level classification of below-ground bulk samples of Coleoptera from understudied forests of Cyprus. We trained neural network models with images from local surveys versus global databases of above-ground samples from tropical forests and evaluated how prediction accuracy was affected by: (a) the quality and resolution of images, (b) the size and complexity of the training set and (c) the transferability of identifications across very disparate source-target pairs that do not share any species or genera. Within-dataset classification accuracy reached 98% and depended on the number and quality of training images and on dataset complexity. The accuracy of between-datasets predictions was reduced to a maximum of 82% and depended greatly on the standardisation of the imaging procedure. When the source and target images were of similar quality and resolution, albeit from different faunas, the reduction of accuracy was minimal. Application of algorithms for domain adaptation significantly improved the prediction performance of models trained by non-standardised, low-quality images. Our findings demonstrate that existing databases can be used to train models and successfully classify images from unexplored biota, when the imaging conditions and classification algorithms are carefully considered. Also, our results provide guidelines for data acquisition and algorithmic development for high-throughput image-based biodiversity surveys.

scholarly journals CLASSIFICATION OF SATELLITE FUSED DATA FOR LAND USE MAPPING IN DEVELOPMENT PLAN

2011 ◽  
Vol 9 (2) ◽  
Author(s):  
Norzailawati Mohd Noor ◽  
Alias Abdullah ◽  
Mazlan Hashim
Keyword(s):  
Land Use ◽  
Principal Component ◽  
Kappa Statistic ◽  
Development Plan ◽  
Remotely Sensed Data ◽  
Data Set ◽  
Principal Component Transform ◽  
Fused Image ◽  
Fine Resolution

Land use mapping in development plan basically provides resources of information and important tool in decision making. In relation to this, fine resolution of recent satellite remotely sensed data have found wide applications in land use/land cover mapping. This study reports on work carried out for classification of fused image for land use mapping in detail scale for Local Plan. The LANDSATTM, SPOT Pan and IKONOS satellite were fused and examined using three data fusion techniques, namely Principal Component Transfonn (PCT), Wavelet Transform and Multiplicative fusing approach. The best fusion technique for three datasets was determined based on the assessment of class separabilities and visualizations evaluation of the selected subset of the fused datasets, respectively. Principal Component Transform has been found to be the best technique for fusing the three datasets, where the best fused data set was subjected to further classification for producing level of land use classes while level II and III pass on to nine classes of detail classification for local plan. The overall data classification accuracy of the best fused data set was 0.86 (kappa statistic). Final land use output from classified data was successfully generated in accordance to local plan land use mapping for development plan purposes.

scholarly journals A Frequency-Based Approach for the Detection and Classification of Structural Changes Using t-SNE †

Sensors ◽  
2019 ◽  
Vol 19 (23) ◽  
pp. 5097 ◽  
Author(s):  
David Agis ◽  
Francesc Pozo
Keyword(s):  
Structural Changes ◽  
Dimensional Space ◽  
Principal Component ◽  
Majority Voting ◽  
Data Set ◽  
Centroid Distance ◽  
Low Dimensional ◽  
Reduced Data

This work presents a structural health monitoring (SHM) approach for the detection and classification of structural changes. The proposed strategy is based on t-distributed stochastic neighbor embedding (t-SNE), a nonlinear procedure that is able to represent the local structure of high-dimensional data in a low-dimensional space. The steps of the detection and classification procedure are: (i) the data collected are scaled using mean-centered group scaling (MCGS); (ii) then principal component analysis (PCA) is applied to reduce the dimensionality of the data set; (iii) t-SNE is applied to represent the scaled and reduced data as points in a plane defining as many clusters as different structural states; and (iv) the current structure to be diagnosed will be associated with a cluster or structural state based on three strategies: (a) the smallest point-centroid distance; (b) majority voting; and (c) the sum of the inverse distances. The combination of PCA and t-SNE improves the quality of the clusters related to the structural states. The method is evaluated using experimental data from an aluminum plate with four piezoelectric transducers (PZTs). Results are illustrated in frequency domain, and they manifest the high classification accuracy and the strong performance of this method.

scholarly journals Distance Transform-Based Spectral-Spatial Feature Vector for Hyperspectral Image Classification with Stacked Autoencoder

2021 ◽  
Vol 13 (9) ◽  
pp. 1732
Author(s):  
Hadis Madani ◽  
Kenneth McIsaac
Keyword(s):  
Deep Learning ◽  
Spatial Information ◽  
Hyperspectral Image ◽  
Feature Vector ◽  
Remote Sensing Data ◽  
Distance Transform ◽  
Hyperspectral Image Classification ◽  
Spatial Feature ◽  
Learning Techniques

Pixel-wise classification of hyperspectral images (HSIs) from remote sensing data is a common approach for extracting information about scenes. In recent years, approaches based on deep learning techniques have gained wide applicability. An HSI dataset can be viewed either as a collection of images, each one captured at a different wavelength, or as a collection of spectra, each one associated with a specific point (pixel). Enhanced classification accuracy is enabled if the spectral and spatial information are combined in the input vector. This allows simultaneous classification according to spectral type but also according to geometric relationships. In this study, we proposed a novel spatial feature vector which improves accuracies in pixel-wise classification. Our proposed feature vector is based on the distance transform of the pixels with respect to the dominant edges in the input HSI. In other words, we allow the location of pixels within geometric subdivisions of the dataset to modify the contribution of each pixel to the spatial feature vector. Moreover, we used the extended multi attribute profile (EMAP) features to add more geometric features to the proposed spatial feature vector. We have performed experiments with three hyperspectral datasets. In addition to the Salinas and University of Pavia datasets, which are commonly used in HSI research, we include samples from our Surrey BC dataset. Our proposed method results compares favorably to traditional algorithms as well as to some recently published deep learning-based algorithms.

CLASSIFICATION OF COVID-19 SYMPTOM FOR CHATBOT USING BERT

2021 ◽  
Vol 10 (2) ◽  
pp. 1065-1069
Author(s):  
H. Park ◽  
G. Moon ◽  
K. Kim
Keyword(s):  
Social Media ◽  
Deep Learning ◽  
News Media ◽  
Data Set ◽  
Present Information ◽  
Disaster Situation

Coronavirus disease (COVID-19) is a significant disaster worldwide from December 2019 to the present. Information on the COVID-19 is grasped through news media or social media, and researchers are conducting various research. This is because we are trying to shorten the time to be aware of the COVID-19 disaster situation. In this paper, we build a chatbot so that it can be used in emergencies using the COVID-19 data set and investigate how the analysis is changing the situation with deep learning.

scholarly journals Land Cover Mapping with Higher Order Graph-Based Co-Occurrence Model

2018 ◽  
Vol 10 (11) ◽  
pp. 1713 ◽  
Author(s):  
Wenzhi Zhao ◽  
William Emery ◽  
Yanchen Bo ◽  
Jiage Chen
Keyword(s):  
Deep Learning ◽  
Land Cover ◽  
Spatial Information ◽  
Conditional Random Field ◽  
Contextual Information ◽  
Learning Algorithms ◽  
Classification Performance ◽  
Higher Order ◽  
Land Cover Mapping ◽  
Initial Classification

Deep learning has become a standard processing procedure in land cover mapping for remote sensing images. Instead of relying on hand-crafted features, deep learning algorithms, such as Convolutional Neural Networks (CNN) can automatically generate effective feature representations, in order to recognize objects with complex image patterns. However, the rich spatial information still remains unexploited, since most of the deep learning algorithms only focus on small image patches that overlook the contextual information at larger scales. To utilize these contextual information and improve the classification performance for high-resolution imagery, we propose a graph-based model in order to capture the contextual information over semantic segments of the image. First, we explore semantic segments which build on the top of deep features and obtain the initial classification result. Then, we further improve the initial classification results with a higher-order co-occurrence model by extending the existing conditional random field (HCO-CRF) algorithm. Compared to the pixel- and object-based CNN methods, the proposed model achieved better performance in terms of classification accuracy.

scholarly journals Synthetic image data augmentation for fibre layup inspection processes: Techniques to enhance the data set

2021 ◽  
Author(s):  
Sebastian Meister ◽  
Nantwin Möller ◽  
Jan Stüve ◽  
Roger M. Groves
Keyword(s):  
Deep Learning ◽  
Test Method ◽  
Process Efficiency ◽  
Synthetic Image ◽  
Generative Adversarial Network ◽  
Data Set ◽  
Manufacturing Defects ◽  
Fiber Placement ◽  
Adversarial Network ◽  
Geometrical Transformation

AbstractIn the aerospace industry, the Automated Fiber Placement process is an established method for producing composite parts. Nowadays the required visual inspection, subsequent to this process, typically takes up to 50% of the total manufacturing time and the inspection quality strongly depends on the inspector. A Deep Learning based classification of manufacturing defects is a possibility to improve the process efficiency and accuracy. However, these techniques require several hundreds or thousands of training data samples. Acquiring this huge amount of data is difficult and time consuming in a real world manufacturing process. Thus, an approach for augmenting a smaller number of defect images for the training of a neural network classifier is presented. Five traditional methods and eight deep learning approaches are theoretically assessed according to the literature. The selected conditional Deep Convolutional Generative Adversarial Network and Geometrical Transformation techniques are investigated in detail, with regard to the diversity and realism of the synthetic images. Between 22 and 166 laser line scan sensor images per defect class from six common fiber placement inspection cases are utilised for tests. The GAN-Train GAN-Test method was applied for the validation. The studies demonstrated that a conditional Deep Convolutional Generative Adversarial Network combined with a previous Geometrical Transformation is well suited to generate a large realistic data set from less than 50 actual input images. The presented network architecture and the associated training weights can serve as a basis for applying the demonstrated approach to other fibre layup inspection images.

Sign in / Sign up

Export Citation Format

Share Document