scholarly journals A Novel Deep Learning Method to Identify Single Tree Species in UAV-Based Hyperspectral Images

2020 ◽  
Vol 12 (8) ◽  
pp. 1294 ◽  
Author(s):  
Gabriela Takahashi Miyoshi ◽  
Mauro dos Santos Arruda ◽  
Lucas Prado Osco ◽  
José Marcato Junior ◽  
Diogo Nunes Gonçalves ◽  
...  
Keyword(s):  
Deep Learning ◽  
Tree Species ◽  
Principal Component ◽  
Hyperspectral Data ◽  
Hyperspectral Images ◽  
Semideciduous Forest ◽  
Individual Tree ◽  
Single Tree ◽  
Multi Stage ◽  
Forested Areas

Deep neural networks are currently the focus of many remote sensing approaches related to forest management. Although they return satisfactory results in most tasks, some challenges related to hyperspectral data remain, like the curse of data dimensionality. In forested areas, another common problem is the highly-dense distribution of trees. In this paper, we propose a novel deep learning approach for hyperspectral imagery to identify single-tree species in highly-dense areas. We evaluated images with 25 spectral bands ranging from 506 to 820 nm taken over a semideciduous forest of the Brazilian Atlantic biome. We included in our network’s architecture a band combination selection phase. This phase learns from multiple combinations between bands which contributed the most for the tree identification task. This is followed by a feature map extraction and a multi-stage model refinement of the confidence map to produce accurate results of a highly-dense target. Our method returned an f-measure, precision and recall values of 0.959, 0.973, and 0.945, respectively. The results were superior when compared with a principal component analysis (PCA) approach. Compared to other learning methods, ours estimate a combination of hyperspectral bands that most contribute to the mentioned task within the network’s architecture. With this, the proposed method achieved state-of-the-art performance for detecting and geolocating individual tree-species in UAV-based hyperspectral images in a complex forest.

scholarly journals Hyperspectral monitoring of fructose content in marzipan

2018 ◽  
Vol 14 (s1) ◽  
pp. 79-88
Author(s):  
Katalin Badak-Kerti ◽  
Szabina Németh ◽  
Andreas Zitek ◽  
Ferenc Firtha
Keyword(s):  
Principal Component Analysis ◽  
Spatial Distribution ◽  
Spectral Properties ◽  
Oil Content ◽  
Sugar Content ◽  
Principal Component ◽  
Reducing Sugar ◽  
Hyperspectral Data ◽  
Hyperspectral Images ◽  
Analysis Technique

In our research marzipan samples of different sugar to almond paste ratios (1:1, 2:1, 3:1) were stored at 17 °C. Reducing sugar content was measured by analytical method, texture analysis was done by penetrometry, electric characteristics were measured by conductometry and hyperspectral images were taken 6–8 times during the 16 days of storage. For statistical analyses (discriminant analysis, principal component analysis) SPSS program was used. According to our findings with the hyperspectral analysis technique, it is possible to identify how long the samples were stored (after production), and to which class (ratio of sugar to almond) the sample belonged. The main wavelengths which gave the best discrimination results among the days of storage were between 960 and 1100 nm. The type of the marzipan was easy to distinguish with the hyperspectral data; the biggest differences were observed at 1200 and 1400 nm, which are connected to the first overtone of C-H bound, therefore correlate with the oil content. The spatial distribution of penetrometric, electric and spectral properties were also characteristic to fructose content. The fructose content of marzipan is difficult to measure by usual optical ways (polarimetry, spectroscopy), but since fructose is hygroscopic, the spatial distribution of spectral properties can be characteristic.

scholarly journals Quality Metrics Evaluation of Hyperspectral Images

2014 ◽  
Vol XL-8 ◽  
pp. 1221-1226 ◽  
Author(s):  
A. K. Singh ◽  
H. V. Kumar ◽  
G. R. Kadambi ◽  
J. K. Kishore ◽  
J. Shuttleworth ◽  
...  
Keyword(s):  
Hyperspectral Image ◽  
Signal To Noise Ratio ◽  
Principal Component ◽  
Quality Parameters ◽  
Quality Metrics ◽  
Hyperspectral Data ◽  
Hyperspectral Images ◽  
Error Ratio ◽  
Classified Image

In this paper, the quality metrics evaluation on hyperspectral images has been presented using k-means clustering and segmentation. After classification the assessment of similarity between original image and classified image is achieved by measurements of image quality parameters. Experiments were carried out on four different types of hyperspectral images. Aerial and spaceborne hyperspectral images with different spectral and geometric resolutions were considered for quality metrics evaluation. Principal Component Analysis (PCA) has been applied to reduce the dimensionality of hyperspectral data. PCA was ultimately used for reducing the number of effective variables resulting in reduced complexity in processing. In case of ordinary images a human viewer plays an important role in quality evaluation. Hyperspectral data are generally processed by automatic algorithms and hence cannot be viewed directly by human viewers. Therefore evaluating quality of classified image becomes even more significant. An elaborate comparison is made between k-means clustering and segmentation for all the images by taking Peak Signal-to-Noise Ratio (PSNR), Mean Square Error (MSE), Maximum Squared Error, ratio of squared norms called L2RAT and Entropy. First four parameters are calculated by comparing the quality of original hyperspectral image and classified image. Entropy is a measure of uncertainty or randomness which is calculated for classified image. Proposed methodology can be used for assessing the performance of any hyperspectral image classification techniques.

scholarly journals Nondestructive Identification of Salmon Adulteration with Water Based on Hyperspectral Data

2018 ◽  
Vol 2018 ◽  
pp. 1-10 ◽  
Author(s):  
Tao Zhang ◽  
Biyao Wang ◽  
Pengtao Yan ◽  
Kunlun Wang ◽  
Xu Zhang ◽  
...  
Keyword(s):  
Near Infrared ◽  
Water Injection ◽  
Principal Component ◽  
Local Extremum ◽  
Hyperspectral Data ◽  
Identification Accuracy ◽  
Hyperspectral Images ◽  
Nondestructive Identification ◽  
Som Network ◽  
Weighting Coefficients

For the identification of salmon adulteration with water injection, a nondestructive identification method based on hyperspectral images was proposed. The hyperspectral images of salmon fillets in visible and near-infrared ranges (390–1050 nm) were obtained with a system. The original hyperspectral data were processed through the principal-component analysis (PCA). According to the image quality and PCA parameters, a second principal-component (PC2) image was selected as the feature image, and the wavelengths corresponding to the local extremum values of feature image weighting coefficients were extracted as feature wavelengths, which were 454.9, 512.3, and 569.1 nm. On this basis, the color combined with spectra at feature wavelengths, texture combined with spectra at feature wavelengths, and color-texture combined with spectra at feature wavelengths were independently set as the input, for the modeling of salmon adulteration identification based on the self-organizing feature map (SOM) network. The distances between neighboring neurons and feature weights of the models were analyzed to realize the visualization of identification results. The results showed that the SOM-based model, with texture-color combined with fusion features of spectra at feature wavelengths as the input, was evaluated to possess the best performance and identification accuracy is as high as 96.7%.

scholarly journals Mapping Tree Species Composition Using OHS-1 Hyperspectral Data and Deep Learning Algorithms in Changbai Mountains, Northeast China

Forests ◽  
2019 ◽  
Vol 10 (9) ◽  
pp. 818
Author(s):  
Yanbiao Xi ◽  
Chunying Ren ◽  
Zongming Wang ◽  
Shiqing Wei ◽  
Jialing Bai ◽  
...  
Keyword(s):  
Deep Learning ◽  
Tree Species ◽  
Classification Accuracy ◽  
Learning Algorithms ◽  
Spectral Characteristics ◽  
Great Influence ◽  
Hyperspectral Images ◽  
Changbai Mountains ◽  
Species Classification ◽  
Tree Species Classification

The accurate characterization of tree species distribution in forest areas can help significantly reduce uncertainties in the estimation of ecosystem parameters and forest resources. Deep learning algorithms have become a hot topic in recent years, but they have so far not been applied to tree species classification. In this study, one-dimensional convolutional neural network (Conv1D), a popular deep learning algorithm, was proposed to automatically identify tree species using OHS-1 hyperspectral images. Additionally, the random forest (RF) classifier was applied to compare to the algorithm of deep learning. Based on our experiments, we drew three main conclusions: First, the OHS-1 hyperspectral images used in this study have high spatial resolution (10 m), which reduces the influence of mixed pixel effect and greatly improves the classification accuracy. Second, limited by the amount of sample data, Conv1D-based classifier does not need too many layers to achieve high classification accuracy. In addition, the size of the convolution kernel has a great influence on the classification accuracy. Finally, the accuracy of Conv1D (85.04%) is higher than that of RF model (80.61%). Especially for broadleaf species with similar spectral characteristics, such as Manchurian walnut and aspen, the accuracy of Conv1D-based classifier is significantly higher than RF classifier (87.15% and 71.77%, respectively). Thus, the Conv1D-based deep learning framework combined with hyperspectral imagery can efficiently improve the accuracy of tree species classification and has great application prospects in the future.

scholarly journals Deep Learning Approaches for the Mapping of Tree Species Diversity in a Tropical Wetland Using Airborne LiDAR and High-Spatial-Resolution Remote Sensing Images

Forests ◽  
2019 ◽  
Vol 10 (11) ◽  
pp. 1047 ◽  
Author(s):  
Ying Sun ◽  
Jianfeng Huang ◽  
Zurui Ao ◽  
Dazhao Lao ◽  
Qinchuan Xin
Keyword(s):  
Remote Sensing ◽  
Deep Learning ◽  
Species Diversity ◽  
Spatial Resolution ◽  
Tree Species ◽  
High Spatial Resolution ◽  
Diversity Index ◽  
Tree Species Diversity ◽  
Individual Tree ◽  
Rgb Images

The monitoring of tree species diversity is important for forest or wetland ecosystem service maintenance or resource management. Remote sensing is an efficient alternative to traditional field work to map tree species diversity over large areas. Previous studies have used light detection and ranging (LiDAR) and imaging spectroscopy (hyperspectral or multispectral remote sensing) for species richness prediction. The recent development of very high spatial resolution (VHR) RGB images has enabled detailed characterization of canopies and forest structures. In this study, we developed a three-step workflow for mapping tree species diversity, the aim of which was to increase knowledge of tree species diversity assessment using deep learning in a tropical wetland (Haizhu Wetland) in South China based on VHR-RGB images and LiDAR points. Firstly, individual trees were detected based on a canopy height model (CHM, derived from LiDAR points) by the local-maxima-based method in the FUSION software (Version 3.70, Seattle, USA). Then, tree species at the individual tree level were identified via a patch-based image input method, which cropped the RGB images into small patches (the individually detected trees) based on the tree apexes detected. Three different deep learning methods (i.e., AlexNet, VGG16, and ResNet50) were modified to classify the tree species, as they can make good use of the spatial context information. Finally, four diversity indices, namely, the Margalef richness index, the Shannon–Wiener diversity index, the Simpson diversity index, and the Pielou evenness index, were calculated from the fixed subset with a size of 30 × 30 m for assessment. In the classification phase, VGG16 had the best performance, with an overall accuracy of 73.25% for 18 tree species. Based on the classification results, mapping of tree species diversity showed reasonable agreement with field survey data (R2Margalef = 0.4562, root-mean-square error RMSEMargalef = 0.5629; R2Shannon–Wiener = 0.7948, RMSEShannon–Wiener = 0.7202; R2Simpson = 0.7907, RMSESimpson = 0.1038; and R2Pielou = 0.5875, RMSEPielou = 0.3053). While challenges remain for individual tree detection and species classification, the deep-learning-based solution shows potential for mapping tree species diversity.

scholarly journals Individual Tree Crown Segmentation and Classification of 13 Tree Species Using Airborne Hyperspectral Data

2018 ◽  
Vol 10 (8) ◽  
pp. 1218 ◽  
Author(s):  
Julia Maschler ◽  
Clement Atzberger ◽  
Markus Immitzer
Keyword(s):  
Random Forest ◽  
Scots Pine ◽  
Tree Species ◽  
Near Infrared ◽  
Mean Shift ◽  
Hyperspectral Data ◽  
Tree Crown ◽  
Individual Tree ◽  
Tree Crowns

Knowledge of the distribution of tree species within a forest is key for multiple economic and ecological applications. This information is traditionally acquired through time-consuming and thereby expensive field work. Our study evaluates the suitability of a visible to near-infrared (VNIR) hyperspectral dataset with a spatial resolution of 0.4 m for the classification of 13 tree species (8 broadleaf, 5 coniferous) on an individual tree crown level in the UNESCO Biosphere Reserve ‘Wienerwald’, a temperate Austrian forest. The study also assesses the automation potential for the delineation of tree crowns using a mean shift segmentation algorithm in order to permit model application over large areas. Object-based Random Forest classification was carried out on variables that were derived from 699 manually delineated as well as automatically segmented reference trees. The models were trained separately for two strata: small and/or conifer stands and high broadleaf forests. The two strata were delineated beforehand using CHM-based tree height and NDVI. The predictor variables encompassed spectral reflectance, vegetation indices, textural metrics and principal components. After feature selection, the overall classification accuracy (OA) of the classification based on manual delineations of the 13 tree species was 91.7% (Cohen’s kappa (κ) = 0.909). The highest user’s and producer’s accuracies were most frequently obtained for Weymouth pine and Scots Pine, while European ash was most often associated with the lowest accuracies. The classification that was based on mean shift segmentation yielded similarly good results (OA = 89.4% κ = 0.883). Based on the automatically segmented trees, the Random Forest models were also applied to the whole study site (1050 ha). The resulting tree map of the study area confirmed a high abundance of European beech (58%) with smaller amounts of oak (6%) and Scots pine (5%). We conclude that highly accurate tree species classifications can be obtained from hyperspectral data covering the visible and near-infrared parts of the electromagnetic spectrum. Our results also indicate a high automation potential of the method, as the results from the automatically segmented tree crowns were similar to those that were obtained for the manually delineated tree crowns.

scholarly journals Tree Species Classification of the UNESCO Man and the Biosphere Karkonoski National Park (Poland) Using Artificial Neural Networks and APEX Hyperspectral Images

2018 ◽  
Vol 10 (7) ◽  
pp. 1111 ◽  
Author(s):  
Edwin Raczko ◽  
Bogdan Zagajewski
Keyword(s):  
Tree Species ◽  
National Park ◽  
Accuracy Assessment ◽  
Research Area ◽  
Hyperspectral Data ◽  
Hyperspectral Images ◽  
Species Classification ◽  
Tree Species Composition ◽  
Tree Species Classification ◽  
R Programming

Knowledge of tree species composition is obligatory in forest management. Accurate tree species maps allow for detailed analysis of a forest ecosystem and its interactions with the environment. The research presented here focused on developing methods of tree species identification using aerial hyperspectral data. The research area is located in Southwestern Poland and covers the Karkonoski National Park (KNP), which was significantly damaged by acid rain and pest infestation in the 1980s. High-resolution (3.35 m) Airborne Prism Experiment (APEX) hyperspectral images (288 spectral bands in the range of 413 to 2440 nm) were used as a basis for tree species classification. Beech (Fagus sylvatica), birch (Betula pendula), alder (Alnus incana), larch (Larix decidua), pine (Pinus sylvestris), and spruce (Picea abies) were classified. The classification algorithm used was feed-forward multilayered perceptron (MLP) with a single hidden layer. To simulate such a network, we used the R programming environment and the nnet package. To provide more accurate measurement of accuracy, iterative accuracy assessment was performed. The final tree species maps cover the whole area of KNP; a median overall accuracy (OA) of 87% was achieved, with median producer accuracy (PA) for all classes exceeding 68%. The best-classified classes were spruce, beech, and birch, with median producer accuracy of 93%, 88% and 83%, respectively. The pine class achieved the lowest median producer and user accuracies (68% and 75%, respectively). The results show great potential for the use of hyperspectral data as a tool for identifying tree species locations in diverse mountainous forest.

scholarly journals A three-dimensional principal component analysis approach for exploratory analysis of hyperspectral data: identification of ovarian cancer samples based on Raman microspectroscopy imaging of blood plasma

The Analyst ◽  
2019 ◽  
Vol 144 (7) ◽  
pp. 2312-2319 ◽  
Author(s):  
Camilo L. M. Morais ◽  
Pierre L. Martin-Hirsch ◽  
Francis L. Martin
Keyword(s):  
Ovarian Cancer ◽  
Principal Component Analysis ◽  
Blood Plasma ◽  
Three Dimensional ◽  
Principal Component ◽  
Component Analysis ◽  
Hyperspectral Data ◽  
Exploratory Analysis ◽  
Hyperspectral Images ◽  
Analysis Approach

Three-dimensional principal component analysis (3D-PCA) for exploratory analysis of hyperspectral images.

scholarly journals Urban Tree Species Classification Using a WorldView-2/3 and LiDAR Data Fusion Approach and Deep Learning

Sensors ◽  
2019 ◽  
Vol 19 (6) ◽  
pp. 1284 ◽  
Author(s):  
Sean Hartling ◽  
Vasit Sagan ◽  
Paheding Sidike ◽  
Maitiniyazi Maimaitijiang ◽  
Joshua Carron
Keyword(s):  
Remote Sensing ◽  
Deep Learning ◽  
Tree Species ◽  
Training Sample ◽  
Lidar Data ◽  
Species Classification ◽  
Individual Tree ◽  
Urban Tree ◽  
Tree Species Classification ◽  
Fusion Approach

Urban areas feature complex and heterogeneous land covers which create challenging issues for tree species classification. The increased availability of high spatial resolution multispectral satellite imagery and LiDAR datasets combined with the recent evolution of deep learning within remote sensing for object detection and scene classification, provide promising opportunities to map individual tree species with greater accuracy and resolution. However, there are knowledge gaps that are related to the contribution of Worldview-3 SWIR bands, very high resolution PAN band and LiDAR data in detailed tree species mapping. Additionally, contemporary deep learning methods are hampered by lack of training samples and difficulties of preparing training data. The objective of this study was to examine the potential of a novel deep learning method, Dense Convolutional Network (DenseNet), to identify dominant individual tree species in a complex urban environment within a fused image of WorldView-2 VNIR, Worldview-3 SWIR and LiDAR datasets. DenseNet results were compared against two popular machine classifiers in remote sensing image analysis, Random Forest (RF) and Support Vector Machine (SVM). Our results demonstrated that: (1) utilizing a data fusion approach beginning with VNIR and adding SWIR, LiDAR, and panchromatic (PAN) bands increased the overall accuracy of the DenseNet classifier from 75.9% to 76.8%, 81.1% and 82.6%, respectively. (2) DenseNet significantly outperformed RF and SVM for the classification of eight dominant tree species with an overall accuracy of 82.6%, compared to 51.8% and 52% for SVM and RF classifiers, respectively. (3) DenseNet maintained superior performance over RF and SVM classifiers under restricted training sample quantities which is a major limiting factor for deep learning techniques. Overall, the study reveals that DenseNet is more effective for urban tree species classification as it outperforms the popular RF and SVM techniques when working with highly complex image scenes regardless of training sample size.

Sign in / Sign up

Export Citation Format

Share Document