scholarly journals CAN SPOT-6/7 CNN SEMANTIC SEGMENTATION IMPROVE SENTINEL-2 BASED LAND COVER PRODUCTS? SENSOR ASSESSMENT AND FUSION

Author(s):  
O. Stocker ◽  
A. Le Bris

Abstract. Needs for fine-grained, accurate and up-to-date land cover (LC) data are important to answer both societal and scientific purposes. Several automatic products have already been proposed, but are mostly generated out of satellite sensors like Sentinel-2 (S2) or Landsat. Metric sensors, e.g. SPOT-6/7, have been less considered, while they enable (at least annual) acquisitions at country scale and can now be efficiently processed thanks to deep learning (DL) approaches. This study thus aimed at assessing whether such sensor can improve such land cover products. A custom simple yet effective U-net - Deconv-Net inspired DL architecture is developed and applied to SPOT-6/7 and S2 for different LC nomenclatures, aiming at comparing the relevance of their spatial/spectral configurations and investigating their complementarity. The proposed DL architecture is then extended to data fusion and applied to previous sensors. At the end, the proposed fusion framework is used to enrich an existing S2 based LC product, as it is generic enough to cope with fusion at distinct levels.

2021 ◽  
Vol 13 (13) ◽  
pp. 7044
Author(s):  
Dawei Wen ◽  
Song Ma ◽  
Anlu Zhang ◽  
Xinli Ke

Assessment of ecosystem services supply, demand, and budgets can help to achieve sustainable urban development. The Guangdong-Hong Kong-Macao Greater Bay Area, as one of the most developed megacities in China, sets up a goal of high-quality development while fostering ecosystem services. Therefore, assessing the ecosystem services in this study area is very important to guide further development. However, the spatial pattern of ecosystem services, especially at local scales, is not well understood. Using the available 2017 land cover product, Sentinel-1 SAR and Sentinel-2 optical images, a deep learning land cover mapping framework integrating deep change vector analysis and the ResUnet model was proposed. Based on the produced 10 m land cover map for the year 2020, recent spatial patterns of the ecosystem services at different scales (i.e., the GBA, 11 cities, urban–rural gradient, and pixel) were analyzed. The results showed that: (1) Forest was the primary land cover in Guangzhou, Huizhou, Shenzhen, Zhuhai, Jiangmen, Zhaoqing, and Hong Kong, and an impervious surface was the main land cover in the other four cities. (2) Although ecosystem services in the GBA were sufficient to meet their demand, there was undersupply for all the three general services in Macao and for the provision services in Zhongshan, Dongguan, Shenzhen, and Foshan. (3) Along the urban–rural gradient in the GBA, supply and demand capacity showed an increasing and decreasing trend, respectively. As for the city-level analysis, Huizhou and Zhuhai showed a fluctuation pattern while Jiangmen, Zhaoqing, and Hong Kong presented a decreasing pattern along the gradient. (4) Inclusion of neighborhood landscape led to increased demand scores in a small proportion of impervious areas and oversupply for a very large percent of bare land.


Author(s):  
Krishna Karra ◽  
Caitlin Kontgis ◽  
Zoe Statman-Weil ◽  
Joseph C. Mazzariello ◽  
Mark Mathis ◽  
...  

IEEE Access ◽  
2020 ◽  
Vol 8 ◽  
pp. 187864-187875
Author(s):  
Joel Parente De Oliveira ◽  
Marly Guimaraes Fernandes Costa ◽  
Cicero Ferreira Fernandes Costa Filho

2020 ◽  
Vol 13 (1) ◽  
pp. 78
Author(s):  
Oliver Sefrin ◽  
Felix M. Riese ◽  
Sina Keller

Land cover and its change are crucial for many environmental applications. This study focuses on the land cover classification and change detection with multitemporal and multispectral Sentinel-2 satellite data. To address the challenging land cover change detection task, we rely on two different deep learning architectures and selected pre-processing steps. For example, we define an excluded class and deal with temporal water shoreline changes in the pre-processing. We employ a fully convolutional neural network (FCN), and we combine the FCN with long short-term memory (LSTM) networks. The FCN can only handle monotemporal input data, while the FCN combined with LSTM can use sequential information (multitemporal). Besides, we provided fixed and variable sequences as training sequences for the combined FCN and LSTM approach. The former refers to using six defined satellite images, while the latter consists of image sequences from an extended training pool of ten images. Further, we propose measures for the robustness concerning the selection of Sentinel-2 image data as evaluation metrics. We can distinguish between actual land cover changes and misclassifications of the deep learning approaches with these metrics. According to the provided metrics, both multitemporal LSTM approaches outperform the monotemporal FCN approach, about 3 to 5 percentage points (p.p.). The LSTM approach trained on the variable sequences detects 3 p.p. more land cover changes than the LSTM approach trained on the fixed sequences. Besides, applying our selected pre-processing improves the water classification and avoids reducing the dataset effectively by 17.6%. The presented LSTM approaches can be modified to provide applicability for a variable number of image sequences since we published the code of the deep learning models. The Sentinel-2 data and the ground truth are also freely available.


2020 ◽  
Vol 59 (12) ◽  
pp. 2057-2073
Author(s):  
Yingkai Sha ◽  
David John Gagne II ◽  
Gregory West ◽  
Roland Stull

AbstractMany statistical downscaling methods require observational inputs and expert knowledge and thus cannot be generalized well across different regions. Convolutional neural networks (CNNs) are deep-learning models that have generalization abilities for various applications. In this research, we modify UNet, a semantic-segmentation CNN, and apply it to the downscaling of daily maximum/minimum 2-m temperature (TMAX/TMIN) over the western continental United States from 0.25° to 4-km grid spacings. We select high-resolution (HR) elevation, low-resolution (LR) elevation, and LR TMAX/TMIN as inputs; train UNet using Parameter–Elevation Regressions on Independent Slopes Model (PRISM) data over the south- and central-western United States from 2015 to 2018; and test it independently over both the training domains and the northwestern United States from 2018 to 2019. We found that the original UNet cannot generate enough fine-grained spatial details when transferred to the new northwestern U.S. domain. In response, we modified the original UNet by assigning an extra HR elevation output branch/loss function and training the modified UNet to reproduce both the supervised HR TMAX/TMIN and the unsupervised HR elevation. This improvement is named “UNet-Autoencoder (AE).” UNet-AE supports semisupervised model fine-tuning for unseen domains and showed better gridpoint-level performance with more than 10% mean absolute error (MAE) reduction relative to the original UNet. On the basis of its performance relative to the 4-km PRISM, UNet-AE is a good option to provide generalizable downscaling for regions that are underrepresented by observations.


Sign in / Sign up

Export Citation Format

Share Document