scholarly journals Understanding deep learning in land use classification based on Sentinel-2 time series

2020 ◽  
Vol 10 (1) ◽  
Author(s):  
Manuel Campos-Taberner ◽  
Francisco Javier García-Haro ◽  
Beatriz Martínez ◽  
Emma Izquierdo-Verdiguier ◽  
Clement Atzberger ◽  
...  
Keyword(s):  
Neural Network ◽  
Land Use ◽  
Time Series ◽  
Deep Learning ◽  
Agricultural Policy ◽  
Near Infrared ◽  
Land Use Classification ◽  
Policy Compliance ◽  
Economic Return ◽  
Sentinel 2

Abstract The use of deep learning (DL) approaches for the analysis of remote sensing (RS) data is rapidly increasing. DL techniques have provided excellent results in applications ranging from parameter estimation to image classification and anomaly detection. Although the vast majority of studies report precision indicators, there is a lack of studies dealing with the interpretability of the predictions. This shortcoming hampers a wider adoption of DL approaches by a wider users community, as model’s decisions are not accountable. In applications that involve the management of public budgets or policy compliance, a better interpretability of predictions is strictly required. This work aims to deepen the understanding of a recurrent neural network for land use classification based on Sentinel-2 time series in the context of the European Common Agricultural Policy (CAP). This permits to address the relevance of predictors in the classification process leading to an improved understanding of the behaviour of the network. The conducted analysis demonstrates that the red and near infrared Sentinel-2 bands convey the most useful information. With respect to the temporal information, the features derived from summer acquisitions were the most influential. These results contribute to the understanding of models used for decision making in the CAP to accomplish the European Green Deal (EGD) designed in order to counteract climate change, to protect biodiversity and ecosystems, and to ensure a fair economic return for farmers.

scholarly journals Sentinel-2 Based Temporal Detection of Agricultural Land Use Anomalies in Support of Common Agricultural Policy Monitoring

2018 ◽  
Vol 7 (10) ◽  
pp. 405 ◽  
Author(s):  
Urška Kanjir ◽  
Nataša Đurić ◽  
Tatjana Veljanovski
Keyword(s):  
Land Use ◽  
Time Series ◽  
Agricultural Policy ◽  
Common Agricultural Policy ◽  
Vegetation Index ◽  
Normalized Difference Vegetation Index ◽  
Agricultural Land ◽  
Agricultural Land Use ◽  
Land Use Control ◽  
Sentinel 2

The European Common Agricultural Policy (CAP) post-2020 timeframe reform will reshape the agriculture land use control procedures from a selected risk fields-based approach into an all-inclusive one. The reform fosters the use of Sentinel data with the objective of enabling greater transparency and comparability of CAP results in different Member States. In this paper, we investigate the analysis of a time series approach using Sentinel-2 images and the suitability of the BFAST (Breaks for Additive Season and Trend) Monitor method to detect changes that correspond to land use anomaly observations in the assessment of agricultural parcel management activities. We focus on identifying certain signs of ineligible (inconsistent) use in permanent meadows and crop fields in one growing season, and in particular those that can be associated with time-defined greenness (vegetation vigor). Depending on the requirements of the BFAST Monitor method and currently time-limited Sentinel-2 dataset for the reliable anomaly study, we introduce customized procedures to support and verify the BFAST Monitor anomaly detection results using the analysis of NDVI (Normalized Difference Vegetation Index) object-based temporal profiles and time-series standard deviation output, where geographical objects of interest are parcels of particular land use. The validation of land use candidate anomalies in view of land use ineligibilities was performed with the information on declared land annual use and field controls, as obtained in the framework of subsidy granting in Slovenia. The results confirm that the proposed combined approach proves efficient to deal with short time series and yields high accuracy rates in monitoring agricultural parcel greenness. As such it can already be introduced to help the process of agricultural land use control within certain CAP activities in the preparation and adaptation phase.

scholarly journals Towards a Multi-Temporal Deep Learning Approach for Mapping Urban Fabric Using Sentinel 2 Images

2020 ◽  
Vol 12 (3) ◽  
pp. 423 ◽  
Author(s):  
Lamiae El Mendili ◽  
Anne Puissant ◽  
Mehdi Chougrad ◽  
Imane Sebari
Keyword(s):  
Land Use ◽  
Deep Learning ◽  
Urban Land ◽  
Urban Land Use ◽  
Land Use Classification ◽  
Urban Fabric ◽  
Temporal Dimension ◽  
The Future ◽  
Multi Temporal ◽  
Sentinel 2

The major part of the population lives in urban areas, and this is expected to increase in the future. The main challenges faced by cities currently and towards the future are the rapid urbanization, the increase in urban temperature and the urban heat island. Mapping and monitoring urban fabric (UF) to analyze the environmental impact of these phenomena is more necessary than ever. This coupled with the increased availability of Earth observation data and their growing temporal capabilities leads us to consider using temporal features for improving land use classification, especially in urban environments where the spectral overlap between classes makes it challenging. Urban land use classification thus remains a central question in remote sensing. Although some research studies have successfully used multi-temporal images such as Landsat-8 or Sentinel-2 to improve land cover classification, urban land use mapping is rarely carried using the temporal dimension. This paper explores the use of Sentinel-2 data in a deep learning framework, by firstly assessing the temporal robustness of four popular fully convolutional neural networks (FCNs) trained over single-date images for the classification of the urban footprint, and secondly, by proposing a multi-temporal FCN. A performance comparison between the proposed framework and a regular FCN is also conducted. In this study, we consider four UF classes typical of many European Western cities. Results show that training the proposed multi-date model on Sentinel 2 multi-temporal data achieved the best results with a Kappa coefficient increase of 2.72% and 6.40%, respectively for continuous UF and industrial facilities. Although a more definitive conclusion requires further testing, first results are promising because they confirm that integrating the temporal dimension with a high spatial resolution into urban land use classification may be a valuable strategy to discriminate among several urban categories.

scholarly journals Mapping Seasonal Agricultural Land Use Types Using Deep Learning on Sentinel-2 Image Time Series

2021 ◽  
Vol 13 (2) ◽  
pp. 289
Author(s):  
Misganu Debella-Gilo ◽  
Arnt Kristian Gjertsen
Keyword(s):  
Land Use ◽  
Time Series ◽  
Deep Learning ◽  
Agricultural Land ◽  
Satellite Image ◽  
Agricultural Land Use ◽  
Monitoring Method ◽  
Multiple Observations ◽  
Land Use Types ◽  
Sentinel 2

The size and location of agricultural fields that are in active use and the type of use during the growing season are among the vital information that is needed for the careful planning and forecasting of agricultural production at national and regional scales. In areas where such data are not readily available, an independent seasonal monitoring method is needed. Remote sensing is a widely used tool to map land use types, although there are some limitations that can partly be circumvented by using, among others, multiple observations, careful feature selection and appropriate analysis methods. Here, we used Sentinel-2 satellite image time series (SITS) over the land area of Norway to map three agricultural land use classes: cereal crops, fodder crops (grass) and unused areas. The Multilayer Perceptron (MLP) and two variants of the Convolutional Neural Network (CNN), are implemented on SITS data of four different temporal resolutions. These enabled us to compare twelve model-dataset combinations to identify the model-dataset combination that results in the most accurate predictions. The CNN is implemented in the spectral and temporal dimensions instead of the conventional spatial dimension. Rather than using existing deep learning architectures, an autotuning procedure is implemented so that the model hyperparameters are empirically optimized during the training. The results obtained on held-out test data show that up to 94% overall accuracy and 90% Cohen’s Kappa can be obtained when the 2D CNN is applied on the SITS data with a temporal resolution of 7 days. This is closely followed by the 1D CNN on the same dataset. However, the latter performs better than the former in predicting data outside the training set. It is further observed that cereal is predicted with the highest accuracy, followed by grass. Predicting the unused areas has been found to be difficult as there is no distinct surface condition that is common for all unused areas.

scholarly journals Early Detection of Plant Viral Disease Using Hyperspectral Imaging and Deep Learning

Sensors ◽  
2021 ◽  
Vol 21 (3) ◽  
pp. 742
Author(s):  
Canh Nguyen ◽  
Vasit Sagan ◽  
Matthew Maimaitiyiming ◽  
Maitiniyazi Maimaitijiang ◽  
Sourav Bhadra ◽  
...  
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Early Detection ◽  
Convolutional Neural Network ◽  
Near Infrared ◽  
Hyperspectral Data ◽  
Viral Diseases ◽  
Support Vector ◽  
Spectral Features ◽  
Feature Spaces

Early detection of grapevine viral diseases is critical for early interventions in order to prevent the disease from spreading to the entire vineyard. Hyperspectral remote sensing can potentially detect and quantify viral diseases in a nondestructive manner. This study utilized hyperspectral imagery at the plant level to identify and classify grapevines inoculated with the newly discovered DNA virus grapevine vein-clearing virus (GVCV) at the early asymptomatic stages. An experiment was set up at a test site at South Farm Research Center, Columbia, MO, USA (38.92 N, −92.28 W), with two grapevine groups, namely healthy and GVCV-infected, while other conditions were controlled. Images of each vine were captured by a SPECIM IQ 400–1000 nm hyperspectral sensor (Oulu, Finland). Hyperspectral images were calibrated and preprocessed to retain only grapevine pixels. A statistical approach was employed to discriminate two reflectance spectra patterns between healthy and GVCV vines. Disease-centric vegetation indices (VIs) were established and explored in terms of their importance to the classification power. Pixel-wise (spectral features) classification was performed in parallel with image-wise (joint spatial–spectral features) classification within a framework involving deep learning architectures and traditional machine learning. The results showed that: (1) the discriminative wavelength regions included the 900–940 nm range in the near-infrared (NIR) region in vines 30 days after sowing (DAS) and the entire visual (VIS) region of 400–700 nm in vines 90 DAS; (2) the normalized pheophytization index (NPQI), fluorescence ratio index 1 (FRI1), plant senescence reflectance index (PSRI), anthocyanin index (AntGitelson), and water stress and canopy temperature (WSCT) measures were the most discriminative indices; (3) the support vector machine (SVM) was effective in VI-wise classification with smaller feature spaces, while the RF classifier performed better in pixel-wise and image-wise classification with larger feature spaces; and (4) the automated 3D convolutional neural network (3D-CNN) feature extractor provided promising results over the 2D convolutional neural network (2D-CNN) in learning features from hyperspectral data cubes with a limited number of samples.

scholarly journals Ensemble Empirical Mode Decomposition with Adaptive Noise with Convolution Based Gated Recurrent Neural Network: A New Deep Learning Model for South Asian High Intensity Forecasting

Symmetry ◽  
2021 ◽  
Vol 13 (6) ◽  
pp. 931
Author(s):  
Kecheng Peng ◽  
Xiaoqun Cao ◽  
Bainian Liu ◽  
Yanan Guo ◽  
Wenlong Tian
Keyword(s):  
Neural Network ◽  
Time Series ◽  
Deep Learning ◽  
South Asian ◽  
Recurrent Neural Network ◽  
Ensemble Empirical Mode Decomposition ◽  
South Asian High ◽  
Mode Decomposition ◽  
Adaptive Noise ◽  
Deep Learning Model

The intensity variation of the South Asian high (SAH) plays an important role in the formation and extinction of many kinds of mesoscale systems, including tropical cyclones, southwest vortices in the Asian summer monsoon (ASM) region, and the precipitation in the whole Asia Europe region, and the SAH has a vortex symmetrical structure; its dynamic field also has the symmetry form. Not enough previous studies focus on the variation of SAH daily intensity. The purpose of this study is to establish a day-to-day prediction model of the SAH intensity, which can accurately predict not only the interannual variation but also the day-to-day variation of the SAH. Focusing on the summer period when the SAH is the strongest, this paper selects the geopotential height data between 1948 and 2020 from NCEP to construct the SAH intensity datasets. Compared with the classical deep learning methods of various kinds of efficient time series prediction model, we ultimately combine the Ensemble Empirical Mode Decomposition with Adaptive Noise (CEEMDAN) method, which has the ability to deal with the nonlinear and unstable single system, with the Permutation Entropy (PE) method, which can extract the SAH intensity feature of IMF decomposed by CEEMDAN, and the Convolution-based Gated Recurrent Neural Network (ConvGRU) model is used to train, test, and predict the intensity of the SAH. The prediction results show that the combination of CEEMDAN and ConvGRU can have a higher accuracy and more stable prediction ability than the traditional deep learning model. After removing the redundant features in the time series, the prediction accuracy of the SAH intensity is higher than that of the classical model, which proves that the method has good applicability for the prediction of nonlinear systems in the atmosphere.

scholarly journals Spatial and temporal deep learning methods for deriving land-use following deforestation: A pan-tropical case study using Landsat time series

2021 ◽  
Vol 264 ◽  
pp. 112600
Author(s):  
Robert N. Masolele ◽  
Veronique De Sy ◽  
Martin Herold ◽  
Diego Marcos Gonzalez ◽  
Jan Verbesselt ◽  
...  
Keyword(s):  
Land Use ◽  
Time Series ◽  
Deep Learning ◽  
Learning Methods

scholarly journals Method for Mapping Rice Fields in Complex Landscape Areas Based on Pre-Trained Convolutional Neural Network from HJ-1 A/B Data

2018 ◽  
Vol 7 (11) ◽  
pp. 418 ◽  
Author(s):  
Tian Jiang ◽  
Xiangnan Liu ◽  
Ling Wu
Keyword(s):  
Neural Network ◽  
Remote Sensing ◽  
Time Series ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Vegetation Index ◽  
Southern China ◽  
Series Data ◽  
Support Vector ◽  
Complex Landscape

Accurate and timely information about rice planting areas is essential for crop yield estimation, global climate change and agricultural resource management. In this study, we present a novel pixel-level classification approach that uses convolutional neural network (CNN) model to extract the features of enhanced vegetation index (EVI) time series curve for classification. The goal is to explore the practicability of deep learning techniques for rice recognition in complex landscape regions, where rice is easily confused with the surroundings, by using mid-resolution remote sensing images. A transfer learning strategy is utilized to fine tune a pre-trained CNN model and obtain the temporal features of the EVI curve. Support vector machine (SVM), a traditional machine learning approach, is also implemented in the experiment. Finally, we evaluate the accuracy of the two models. Results show that our model performs better than SVM, with the overall accuracies being 93.60% and 91.05%, respectively. Therefore, this technique is appropriate for estimating rice planting areas in southern China on the basis of a pre-trained CNN model by using time series data. And more opportunity and potential can be found for crop classification by remote sensing and deep learning technique in the future study.

scholarly journals Feature Importance Analysis for Local Climate Zone Classification Using a Residual Convolutional Neural Network with Multi-Source Datasets

2018 ◽  
Vol 10 (10) ◽  
pp. 1572 ◽  
Author(s):  
Chunping Qiu ◽  
Michael Schmitt ◽  
Lichao Mou ◽  
Pedram Ghamisi ◽  
Xiao Zhu
Keyword(s):  
Neural Network ◽  
Land Use ◽  
Convolutional Neural Network ◽  
Large Scale ◽  
Landsat 8 ◽  
Climate Zone ◽  
Local Climate ◽  
Feature Importance ◽  
Local Climate Zone ◽  
Sentinel 2

Global Local Climate Zone (LCZ) maps, indicating urban structures and land use, are crucial for Urban Heat Island (UHI) studies and also as starting points to better understand the spatio-temporal dynamics of cities worldwide. However, reliable LCZ maps are not available on a global scale, hindering scientific progress across a range of disciplines that study the functionality of sustainable cities. As a first step towards large-scale LCZ mapping, this paper tries to provide guidance about data/feature choice. To this end, we evaluate the spectral reflectance and spectral indices of the globally available Sentinel-2 and Landsat-8 imagery, as well as the Global Urban Footprint (GUF) dataset, the OpenStreetMap layers buildings and land use and the Visible Infrared Imager Radiometer Suite (VIIRS)-based Nighttime Light (NTL) data, regarding their relevance for discriminating different Local Climate Zones (LCZs). Using a Residual convolutional neural Network (ResNet), a systematic analysis of feature importance is performed with a manually-labeled dataset containing nine cities located in Europe. Based on the investigation of the data and feature choice, we propose a framework to fully exploit the available datasets. The results show that GUF, OSM and NTL can contribute to the classification accuracy of some LCZs with relatively few samples, and it is suggested that Landsat-8 and Sentinel-2 spectral reflectances should be jointly used, for example in a majority voting manner, as proven by the improvement from the proposed framework, for large-scale LCZ mapping.

scholarly journals Deep learning para la clasificación de usos de suelo agrícola con Sentinel-2

2020 ◽  
pp. 35
Author(s):  
M. Campos-Taberner ◽  
F.J. García-Haro ◽  
B. Martínez ◽  
M.A. Gilabert
Keyword(s):  
Remote Sensing ◽  
Deep Learning ◽  
Near Infrared ◽  
Spatial Information ◽  
Learning Algorithm ◽  
Support Vector ◽  
Sensing Applications ◽  
Learning Techniques ◽  
Remote Sensing Applications ◽  
Sentinel 2

<p class="p1">The use of deep learning techniques for remote sensing applications has recently increased. These algorithms have proven to be successful in estimation of parameters and classification of images. However, little effort has been made to make them understandable, leading to their implementation as “black boxes”. This work aims to evaluate the performance and clarify the operation of a deep learning algorithm, based on a bi-directional recurrent network of long short-term memory (2-BiLSTM). The land use classification in the Valencian Community based on Sentinel-2 image time series in the framework of the common agricultural policy (CAP) is used as an example. It is verified that the accuracy of the deep learning techniques is superior (98.6 % overall success) to that other algorithms such as decision trees (DT), k-nearest neighbors (k-NN), neural networks (NN), support vector machines (SVM) and random forests (RF). The performance of the classifier has been studied as a function of time and of the predictors used. It is concluded that, in the study area, the most relevant information used by the network in the classification are the images corresponding to summer and the spectral and spatial information derived from the red and near infrared bands. These results open the door to new studies in the field of the explainable deep learning in remote sensing applications.</p>

Sign in / Sign up

Export Citation Format

Share Document