Remote Sensing Image Fusion Algorithm Based on Two-Stream Fusion Network and Residual Channel Attention Mechanism

A two-stream remote sensing image fusion network (RCAMTFNet) based on the residual channel attention mechanism is proposed by introducing the residual channel attention mechanism (RCAM) in this paper. In the RCAMTFNet, the spatial features of PAN and the spectral features of MS are extracted, respectively, by a two-channel feature extraction layer. Multiresidual connections allow the network to adapt to a deeper network structure without the degradation. The residual channel attention mechanism is introduced to learn the interdependence between channels, and then the correlation features among channels are adapted on the basis of the dependency. In this way, image spatial information and spectral information are extracted exclusively. What is more, pansharpening images are reconstructed across the board. Experiments are conducted on two satellite datasets, GaoFen-2 and WorldView-2. The experimental results show that the proposed algorithm is superior to the algorithms to some existing literature in the comparison of the values of reference evaluation indicators and nonreference evaluation indicators.

Regional Sampling of Forest Canopy Covers Using UAV Visible Stereoscopic Imagery for Assessment of Satellite-Based Products in Northeast China

Canopy cover is an important parameter affecting forest succession, carbon fluxes, and wildlife habitats. Several global maps with different spatial resolutions have been produced based on satellite images, but facing the deficiency of reliable references for accuracy assessments. The rapid development of unmanned aerial vehicle (UAV) equipped with consumer-grade camera enables the acquisition of high-resolution images at low cost, which provides the research community a promising tool to collect reference data. However, it is still a challenge to distinguish tree crowns and understory green vegetation based on the UAV-based true color images (RGB) due to the limited spectral information. In addition, the canopy height model (CHM) derived from photogrammetric point clouds has also been used to identify tree crowns but limited by the unavailability of understory terrain elevations. This study proposed a simple method to distinguish tree crowns and understories based on UAV visible images, which was referred to as BAMOS for convenience. The central idea of the BAMOS was the synergy of spectral information from digital orthophoto map (DOM) and structural information from digital surface model (DSM). Samples of canopy covers were produced by applying the BAMOS method on the UAV images collected at 77 sites with a size of about 1.0 km2 across Daxing’anling forested area in northeast of China. Results showed that canopy cover extracted by the BAMOS method was highly correlated to visually interpreted ones with correlation coefficient (r) of 0.96 and root mean square error (RMSE) of 5.7%. Then, the UAV-based canopy covers served as references for assessment of satellite-based maps, including MOD44B Version 6 Vegetation Continuous Fields (MODIS VCF), maps developed by the Global Land Cover Facility (GLCF) and by the Global Land Analysis and Discovery laboratory (GLAD). Results showed that both GLAD and GLCF canopy covers could capture the dominant spatial patterns, but GLAD canopy cover tended to miss scattered trees in highly heterogeneous areas, and GLCF failed to capture non-tree areas. Most important of all, obvious underestimations with RMSE about 20% were easily observed in all satellite-based maps, although the temporal inconsistency with references might have some contributions.

Target Classification of Similar Spatial Characteristics in Complex Urban Areas by Using Multispectral LiDAR

With the rapid modernization, many remote-sensing sensors were developed for classifying urban land and environmental monitoring. Multispectral LiDAR, which serves as a new technology, has exhibited potential in remote-sensing monitoring due to the synchronous acquisition of three-dimension point cloud and spectral information. This study confirmed the potential of multispectral LiDAR for complex urban land cover classification through three comparative methods. Firstly, the Optech Titan LiDAR point cloud was pre-processed and ground filtered. Then, three methods were analyzed: (1) Channel 1, based on Titan data to simulate the classification of a single-band LiDAR; (2) three-channel information and the digital surface model (DSM); and (3) three-channel information and DSM combined with the calculated three normalized difference vegetation indices (NDVIs) for urban land classification. A decision tree was subsequently used in classification based on the combination of intensity information, elevation information, and spectral information. The overall classification accuracies of the point cloud using the single-channel classification and the multispectral LiDAR were 64.66% and 93.82%, respectively. The results show that multispectral LiDAR has excellent potential for classifying land use in complex urban areas due to the availability of spectral information and that the addition of elevation information to the classification process could boost classification accuracy.

A Bidirectional Deep-Learning-Based Spectral Attention Mechanism for Hyperspectral Data Classification

Hyperspectral remote sensing presents a unique big data research paradigm through its rich information captured across hundreds of spectral bands, which embodies vital spatial and temporal information about the underlying land cover. Deep-learning-based hyperspectral data analysis methodologies have made significant advancements over the past few years. Despite their success, most deep learning frameworks for hyperspectral data classification tend to suffer in terms of computational and classification efficacy as the data size increases. This is largely due to their equal emphasis criteria on the rich spectral information present in the data, albeit all of the spectral information not being essential for hyperspectral data analysis. On the contrary, this redundant information present in the spectral bands can deter the performance of hyperspectral data analysis techniques. Therefore, in this work, we propose a novel bidirectional spectral attention mechanism, which is computationally efficient and capable of adaptive spectral information diversification through selective emphasis on spectral bands that comprise more information and suppress the ones with lesser information. The concept of 3D-convolutions in tandem with bidirectional long short-term memory (LSTM) is used in the proposed architecture as spectral attention mechanism. A feedforward neural network (FNN)-based supervised classification is then performed to validate the performance of our proposed approach. Experimental results reveal that the proposed hyperspectral data analysis model with spectral attention mechanism outperforms other spatial- and spectral-information-extraction-based hyperspectral data analysis techniques compared.

A comparison of spectral reconstruction methods applied to non-zero temperature NRQCD meson correlation functions

We present results from the fastsum collaboration’s programme to determine the spectrum of the bottomonium system as a function of temperature. Three different methods of extracting spectral information are discussed: a Maximum Likelihood approach using a Gaussian spectral function for the ground state, the Backus Gilbert method, and the Kernel Ridge Regression machine learning procedure. We employ the fastsum anisotropic lattices with 2+1 dynamical quark flavours, with temperatures ranging from 47 to 375 MeV.

AVALIAÇÃO DA ACURÁCIA DE ALGORITMOS DE CLASSIFICAÇÃO DE IMAGENS ORBITAIS NA BAÍA DA BABITONGA, NORDESTE DE SANTA CATARINA

O objetivo deste trabalho foi a avaliação da acurácia de algoritmos de classificação do uso e cobertura do solo, quando aplicados a uma imagem orbital de média resolução espacial. Para esse estudo foram utilizadas as bandas espectrais da faixa do visível e infravermelho próximo, do sensor Operational Land Imager – OLI na Baía da Babitonga/SC. Foram propostas nove classes de cobertura do solo, que serviram como controle para testar 11 algoritmos classificadores: Binary Encoding, Example Based Feature Extraction, IsoData, K-Means, Mahalanobis Distance, Maximum Likelihood, Minimum Distance, Neural Net, Parallelepiped, Spectral Angle Mapper e Spectral Information Divergence. O classificador Maximum Likelihood foi o que apresentou o melhor desempenho, obtendo um índice Kappa de 0,89 e acurácia global de 95,5%, sendo capaz de distinguir as nove classes de cobertura do solo propostas. Evaluation of the Accuracy of Orbital Image Classification Algorithms in Babitonga Bay, northeast of Santa Catarina A B S T R A C TThe objective of this work was to evaluate the classification algorithms accuracy of the soil use and cover when applied to a spatial mean orbital image. For this study we used the visible and near infrared spectral bands of the Operational Land Imager - OLI sensor in Babitonga Bay / SC. Nine classes of soil cover were proposed, which served as control to test 11 classifier algorithms: Binary Encoding, Example Based Feature Extraction, IsoData, K-Means, Mahalanobis Distance, Maximum Likelihood, Minimum Distance, Neural Net, Parallelepiped, Spectral Angle Mapper and Spectral Information Divergence. The Maximum Likelihood classifier presented the best performance, obtaining a Kappa index of 0.89 and a global accuracy of 95.5%, being able to distinguish the nine proposed classes of soil cover.Keywords: Algorithms Accuracy, Babitonga Bay, Orbital image, Remote sensing, Soil Use and Cover.

ODPA-CNN: One Dimensional Parallel Atrous Convolution Neural Network for Band-Selective Hyperspectral Image Classification

Recently, hyperspectral image (HSI) classification using deep learning has been actively studied using 2D and 3D convolution neural networks (CNN). However, they learn spatial information as well as spectral information. These methods can increase the accuracy of classification, but do not only focus on the spectral information, which is a big advantage of HSI. In addition, the 1D-CNN, which learns only pure spectral information, has limitations because it uses adjacent spectral information. In this paper, we propose a One Dimensional Parellel Atrous Convolution Neural Network (ODPA-CNN) that learns not only adjacent spectral information for HSI classification, but also spectral information from a certain distance. It extracts features in parallel to account for bands of varying distances. The proposed method excludes spatial information such as the shape of an object and performs HSI classification only with spectral information about the material of the object. Atrous convolution is not a convolution of adjacent spectral information, but a convolution between spectral information separated by a certain distance. We compare the proposed model with various datasets to the other models. We also test with the data we have taken ourselves. Experimental results show a higher performance than some 3D-CNN models and other 1D-CNN methods. In addition, using datasets to which random space is applied, the vulnerabilities of 3D-CNN are identified, and the proposed model is shown to be robust to datasets with little spatial information.

Investigation of the influence of optical nonlinearity on combining efficiency in ultrashort pulsed fiber laser coherent combining system

In this paper, the influence of optical nonlinearity on combining efficiency in ultrashort pulsed fiber laser coherent combining system is investigated theoretically and experimentally. In the theoretical work, a new theoretical algorithm for the coherent combining efficiency, which can be used to quantify the spectral coherence decay induced by optical nonlineary imbalance between the sub-beams, is presented. The spectral information of the sub-beam is obtained by numerically solving the nonlinear Schrödinger equation (NLSE) in this algorithm to ensure an accurate prediction. In the experimental work, the coherent combining of two all-fiber picosecond lasers is achieved, and the influence of imbalanced optical nonlinearity on the combining efficiency is studied, which agrees with the theoretical prediction. This paper reveals the physical mechanism for the influence of optical nonlinearity on the combining efficiency, which is valuable for the coherent combining of ultrashort pulsed fiber laser beams.

Can One Hear a Matrix? Recovering a Real Symmetric Matrix from Its Spectral Data

The spectrum of a real and symmetric $$N\times N$$ N × N matrix determines the matrix up to unitary equivalence. More spectral data is needed together with some sign indicators to remove the unitary ambiguities. In the first part of this work, we specify the spectral and sign information required for a unique reconstruction of general matrices. More specifically, the spectral information consists of the spectra of the N nested main minors of the original matrix of the sizes $$1,2,\ldots ,N$$ 1 , 2 , … , N . However, due to the complicated nature of the required sign data, improvements are needed in order to make the reconstruction procedure feasible. With this in mind, the second part is restricted to banded matrices where the amount of spectral data exceeds the number of the unknown matrix entries. It is shown that one can take advantage of this redundancy to guarantee unique reconstruction of generic matrices; in other words, this subset of matrices is open, dense and of full measure in the set of real, symmetric and banded matrices. It is shown that one can optimize the ratio between redundancy and genericity by using the freedom of choice of the spectral information input. We demonstrate our constructions in detail for pentadiagonal matrices.

Single Tree Classification Using Multi-Temporal ALS Data and CIR Imagery in Mixed Old-Growth Forest in Poland

Tree species classification is important for a variety of environmental applications, including biodiversity monitoring, wildfire risk assessment, ecosystem services assessment, and sustainable forest management. In this study we used a fusion of three remote sensing (RM) datasets including ALS (leaf-on and leaf-off) and colour-infrared (CIR) imagery (leaf-on), to classify different coniferous and deciduous tree species, including dead class, in a mixed temperate forest in Poland. We used intensity and structural variables from the ALS data and spectral information derived from aerial imagery for the classification procedure. Additionally, we tested the differences in classification accuracy of all the variants included in the data integration. The random forest classifier was used in the study. The highest accuracies were obtained for classification based on both point clouds and including image spectral information. The mean values for overall accuracy and kappa were 84.3% and 0.82, respectively. Analysis of the leaf-on and leaf-off alone is not sufficient to identify individual tree species due to their different discriminatory power. Leaf-on and leaf-off ALS point cloud features alone gave the lowest accuracies of 72% ≤ OA ≤ 74% and 0.67 ≤ κ ≤ 0.70. Classification based on both point clouds was found to give satisfactory and comparable results to classification based on combined information from all three sources (83% ≤ OA ≤ 84% and 0.81 ≤ κ ≤ 0.82). The classification accuracy varied between species. The classification results for coniferous trees were always better than for deciduous trees independent of the datasets. In the classification based on both point clouds (leaf-on and leaf-off), the intensity features seemed to be more important than the other groups of variables, especially the coefficient of variation, skewness, and percentiles. The NDVI was the most important CIR-based feature.