Weighted Group Sparsity-Constrained Tensor Factorization for Hyperspectral Unmixing

Recently, unmixing methods based on nonnegative tensor factorization have played an important role in the decomposition of hyperspectral mixed pixels. According to the spatial prior knowledge, there are many regularizations designed to improve the performance of unmixing algorithms, such as the total variation (TV) regularization. However, these methods mostly ignore the similar characteristics among different spectral bands. To solve this problem, this paper proposes a group sparse regularization that uses the weighted constraint of the L2,1 norm, which can not only explore the similar characteristics of the hyperspectral image in the spectral dimension, but also keep the data smooth characteristics in the spatial dimension. In summary, a non-negative tensor factorization framework based on weighted group sparsity constraint is proposed for hyperspectral images. In addition, an effective alternating direction method of multipliers (ADMM) algorithm is used to solve the algorithm proposed in this paper. Compared with the existing popular methods, experiments conducted on three real datasets fully demonstrate the effectiveness and advancement of the proposed method.

NESEA-Rice10: high-resolution annual paddy rice maps for Northeast and Southeast Asia from 2017 to 2019

An accurate paddy rice map is crucial for ensuring food security, particularly for Southeast and Northeast Asia. MODIS satellite data are useful for mapping paddy rice at continental scales but have a mixed-pixel problem caused by the coarse spatial resolution. To reduce the mixed pixels, we designed a rule-based method for mapping paddy rice by integrating time series Sentinel-1 and MODIS data. We demonstrated the method by generating annual paddy rice maps for Southeast and Northeast Asia in 2017–2019 (NESEA-Rice10). We compared the resultant paddy rice maps with available agricultural statistics at subnational levels and existing rice maps for some countries. The results demonstrated that the linear coefficient of determination (R2) between our paddy rice maps and agricultural statistics ranged from 0.80 to 0.97. The paddy rice planting areas in 2017 were spatially consistent with the existing maps in Vietnam (R2=0.93) and Northeast China (R2=0.99). The spatial distribution of the 2017–2019 composite paddy rice map was consistent with that of the rice map from the International Rice Research Institute. The paddy rice planting area may have been underestimated in the region in which the flooding signal was not strong. The dataset is useful for water resource management, rice growth, and yield monitoring. The full product is publicly available at https://doi.org/10.5281/zenodo.5645344 (Han et al., 2021a). Small examples can be found from the following DOI: https://doi.org/10.17632/cnc3tkbwcm.1 (Han et al., 2021b).

Human-in-the-Loop Segmentation of Earth Surface Imagery

Segmentation, or the classification of pixels (grid cells) in imagery, is ubiquitously applied in the natural sciences. Manual methods are often prohibitively time-consuming, especially those images consisting of small objects and/or significant spatial heterogeneity of colors or textures. Labeling complicated regions of transition that in Earth surface imagery are represented by collections of mixed-pixels, -textures, and -spectral signatures, can be especially error-prone because it is difficult to reliably unmix, identify and delineate consistently. However, the success of supervised machine learning (ML) approaches is entirely dependent on good label data. We describe a fast, semi-automated, method for interactive segmentation of N-dimensional (x,y,N) images into two-dimensional (x,y) label images. It uses human-in-the-loop ML to achieve consensus between the labeler and a model in an iterative workflow. The technique is reproducible; the sequence of decisions made by human labeler and ML algorithms can be encoded to file, so the entire process can be played back and new outputs generated with alternative decisions and/or algorithms. We illustrate the scientific potential of segmentation of imagery of diverse settings and image types using six case studies from river, estuarine, and open coast environments. These photographic and non-photographic imagery consist of 1- and 3-bands on regular and irregular grids ranging from centimeters to tens of meters. We demonstrate high levels of agreement in label images generated by several labelers on the same imagery, and make suggestions to achieve consensus and measure uncertainty, ideal for widespread application in training supervised ML for image segmentation.

Satellite-based investigation on the surface cooling effects of urban parks and their range – a case study for North Rhine-Westphalia, Germany

Green infrastructure (GI) has a cooling effect owing to shading and evapotranspiration and therefore has a climate regulating function within metropolitan areas. Urban parks are a type of GI that act as park cool islands (PCIs) and play a major role in mitigating the surface urban heat island. This study aims to (1) investigate the status quo of the surface cooling effect intensity of selected urban parks in North Rhine-Westphalia (NRW), including their cooling range, and to (2) propose a methodological approach for investigating the PCI intensity using remote sensing data considering the occurrence of mixed pixels. To achieve these tasks, land surface temperature values based on Landsat 8 images from three different days in 2018 and 2019 were observed. In addition, a method for the reduction of mixed pixels was developed. The results confirm a surface cooling effect of 1–5 K and thus the existence of a PCI. The impact of the surface cooling effect was found within a minimum range of 150 m. However, the process of identifying the cooling area was complicated by the high proportion of GI in cities in NRW, compared to other study areas. Further research on the influencing parameters of the surface cooling effect is needed.

Evolutionary Multiobjective Optimization with Endmember Priori Strategy for Large-Scale Hyperspectral Sparse Unmixing

Mixed pixels inevitably appear in the hyperspectral image due to the low resolution of the sensor and the mixing of ground objects. Sparse unmixing, as an emerging method to solve the problem of mixed pixels, has received extensive attention in recent years due to its robustness and high efficiency. In theory, sparse unmixing is essentially a multiobjective optimization problem. The sparse endmember term and the reconstruction error term can be regarded as two objectives to optimize simultaneously, and a series of nondominated solutions can be obtained as the final solution. However, the large-scale spectral library poses a challenge due to the high-dimensional number of spectra, it is difficult to accurately extract a few active endmembers and estimate their corresponding abundance from hundreds of spectral features. In order to solve this problem, we propose an evolutionary multiobjective hyperspectral sparse unmixing algorithm with endmember priori strategy (EMSU-EP) to solve the large-scale sparse unmixing problem. The single endmember in the spectral library is used to reconstruct the hyperspectral image, respectively, and the corresponding score of each endmember can be obtained. Then the endmember scores are used as a prior knowledge to guide the generation of the initial population and the new offspring. Finally, a series of nondominated solutions are obtained by the nondominated sorting and the crowding distances calculation. Experiments on two benchmark large-scale simulated data to demonstrate the effectiveness of the proposed algorithm.

AsiaRiceMap10m: high-resolution annual paddy rice maps for Southeast and Northeast Asia from 2017 to 2019

An accurate paddy rice map is crucial for food security, particularly for Southeast and Northeast Asia. The MODIS satellite data is useful for mapping paddy rice at continental scales but has a problem of mixed-pixel due to coarse spatial resolution. To reduce the mixed pixels, we designed a rule-based method for mapping paddy rice by integrating time-series Sentinel-1 and MODIS data. We demonstrated the method in generating annual paddy rice maps for Southeast and Northeast Asia in 2017–2019 (AsiaRiceMap10m). The resultant paddy rice maps were compared with available agricultural statistics at subnational levels and existing rice maps for some countries. The results show that the linear coefficient of determination (R2) between our paddy rice maps and agricultural statistics ranges from 0.80 to 0.97. The paddy rice planting areas in 2017 were spatially consistent with the existing maps in Vietnam (R2 = 0.93) and Northeast China (R2 = 0.99). The spatial distribution of the 2017–2019 composite paddy rice map is consistent with the rice map from the International Rice Research Institute. The paddy rice planting area may be underestimated in the region where the flooding signal is not strong. The dataset is useful for water resource management, rice growth, and yield monitoring. The full product is publicly available at https://doi.org/10.17632/j34b3jsvr9.1 (Han et al., 2021a). Find small examples here (https://doi.org/10.17632/cnc3tkbwcm.1) (Han et al., 2021b).

Structural assessment using terrestrial laser scanning point clouds

PurposeTerrestrial laser scanning (TLS) point clouds have been widely used in deformation measurement for structures. However, reliability and accuracy of resulting deformation estimation strongly depends on quality of each step of a workflow, which are not fully addressed. This study aims to give insight error of these steps, and results of the study would be guidelines for a practical community to either develop a new workflow or refine an existing one of deformation estimation based on TLS point clouds. Thus, the main contributions of the paper are investigating point cloud registration error affecting resulting deformation estimation, identifying an appropriate segmentation method used to extract data points of a deformed surface, investigating a methodology to determine an un-deformed or a reference surface for estimating deformation, and proposing a methodology to minimize the impact of outlier, noisy data and/or mixed pixels on deformation estimation.Design/methodology/approachIn practice, the quality of data point clouds and of surface extraction strongly impacts on resulting deformation estimation based on laser scanning point clouds, which can cause an incorrect decision on the state of the structure if uncertainty is available. In an effort to have more comprehensive insight into those impacts, this study addresses four issues: data errors due to data registration from multiple scanning stations (Issue 1), methods used to extract point clouds of structure surfaces (Issue 2), selection of the reference surface Sref to measure deformation (Issue 3), and available outlier and/or mixed pixels (Issue 4). This investigation demonstrates through estimating deformation of the bridge abutment, building and an oil storage tank.FindingsThe study shows that both random sample consensus (RANSAC) and region growing–based methods [a cell-based/voxel-based region growing (CRG/VRG)] can be extracted data points of surfaces, but RANSAC is only applicable for a primary primitive surface (e.g. a plane in this study) subjected to a small deformation (case study 2 and 3) and cannot eliminate mixed pixels. On another hand, CRG and VRG impose a suitable method applied for deformed, free-form surfaces. In addition, in practice, a reference surface of a structure is mostly not available. The use of a fitting plane based on a point cloud of a current surface would cause unrealistic and inaccurate deformation because outlier data points and data points of damaged areas affect an accuracy of the fitting plane. This study would recommend the use of a reference surface determined based on a design concept/specification. A smoothing method with a spatial interval can be effectively minimize, negative impact of outlier, noisy data and/or mixed pixels on deformation estimation.Research limitations/implicationsDue to difficulty in logistics, an independent measurement cannot be established to assess the deformation accuracy based on TLS data point cloud in the case studies of this research. However, common laser scanners using the time-of-flight or phase-shift principle provide point clouds with accuracy in the order of 1–6 mm, while the point clouds of triangulation scanners have sub-millimetre accuracy.Practical implicationsThis study aims to give insight error of these steps, and the results of the study would be guidelines for a practical community to either develop a new workflow or refine an existing one of deformation estimation based on TLS point clouds.Social implicationsThe results of this study would provide guidelines for a practical community to either develop a new workflow or refine an existing one of deformation estimation based on TLS point clouds. A low-cost method can be applied for deformation analysis of the structure.Originality/valueAlthough a large amount of the studies used laser scanning to measure structure deformation in the last two decades, the methods mainly applied were to measure change between two states (or epochs) of the structure surface and focused on quantifying deformation-based TLS point clouds. Those studies proved that a laser scanner could be an alternative unit to acquire spatial information for deformation monitoring. However, there are still challenges in establishing an appropriate procedure to collect a high quality of point clouds and develop methods to interpret the point clouds to obtain reliable and accurate deformation, when uncertainty, including data quality and reference information, is available. Therefore, this study demonstrates the impact of data quality in a term of point cloud registration error, selected methods for extracting point clouds of surfaces, identifying reference information, and available outlier, noisy data and/or mixed pixels on deformation estimation.

Discovering Vegetation Recovery and Landslide Activities in the Wenchuan Earthquake Area with Landsat Imagery

Post-seismic vegetation recovery is critical to local ecosystem recovery and slope stability, especially in the Wenchuan earthquake area where tens of thousands of landslides were triggered. This study executed a decadal monitoring of post-seismic landslide activities all over the region by investigating landslide vegetation recovery rate (VRR) with Landsat images and a (nearly) complete landslide inventory. Thirty thousand landslides that were larger than nine pixels were chosen for VRR analysis, to reduce the influence of mixed pixels and support detailed investigation within landslides. The study indicates that about 60% of landslide vegetation gets close to the pre-earthquake level in ten years and is expected to recover to the pre-earthquake level within 20 years. The vegetation recovery is significantly influenced by topographic factors, especially elevation and slope, while it is barely related to the distance to epicenter, fault ruptures, and rivers. This study checked and improved the knowledge of vegetation recovery and landslide stability in the area, based on a detailed investigation.

A Novel Change Detection Approach Based on Spectral Unmixing from Stacked Multitemporal Remote Sensing Images with a Variability of Endmembers

Due to the high temporal repetition rates, median/low spatial resolution remote sensing images are the main data source of change detection (CD). It is worth noting that they contain a large number of mixed pixels, which makes adequately capturing the details in the resulting thematic map challenging. The spectral unmixing (SU) method is a potential solution to this problem, as it decomposes mixed pixels into a set of fractions of the land covers. However, there are accumulated errors in the fractional difference images, which lead to a poor change detection results. Meanwhile, the spectra variation of the endmember and the heterogeneity of the land cover materials cannot be fully considered in the traditional framework. In order to solve this problem, a novel change detection approach with image stacking and dividing based on spectral unmixing while considering the variability of endmembers (CD_SDSUVE) was proposed in this paper. Firstly, the remote sensing images at different times were stacked into a unified framework. After that, several patch images were produced by dividing the stacked images so that the similar endmembers according to each land cover can be completely extracted and compared. Finally, the multiple endmember spectral mixture analysis (MESMA) is performed, and the abundant images were combined to produce the entire change detection thematic map. This proposed algorithm was implemented and compared to four relevant state-of-the-art methods on three experimental data, whereby the results confirmed that it effectively improved the accuracy. In the simulated data, the overall accuracy (OA) and Kappa coefficient values were 99.61% and 0.99. In the two real data, the maximum of OA were acquired with 93.26% and 80.85%, which gained 14.88% and 13.42% over the worst results at most. Meanwhile, the Kappa coefficient value was consistent with the OA.

BIDIRECTIONAL REFLECTANCE DISTRIBUTION FUNCTION (BRDF) OF MIXED PIXELS

Hyperspectral imaging is crucial for a variety of land-cover mapping and analyzing tasks. The available large number of reflected light measurements along a wide range of wavelengths allows for distinguishing between different materials under various conditions. Though, several effects bear an undesired variability within hyperspectral images and increase the complexity of interpreting such data. Two of the most significant effects in this regard are the BRDF and the spectral mixture. Due to the first, the acquisitions geometrical and viewing conditions influences the measured spectral signature of a surface to a large extent. On the other hand, because of the typical low spatial resolution of remotely sensed images, each pixel can contain more than one material. Despite much research addressing either the BRDF effect and ways to correct it or the spectral unmixing, too few works considered these two effects' mutual influence. In this work, we study the BRDF of mixed pixels and present preliminary insights of testing a strategy to correct its undesired impact on the data by incorporating the EMs fractions within an unmixing-based semi-empirical correction model. Experimental results using real laboratory data acquired under controlled conditions clearly show the significant improvement of the corrected reflectance results through the proposed model.