A Semi-Supervised Crop-Type Classification Based on Sentinel-2 NDVI Satellite Image Time Series And Phenological Parameters

Author(s):  
Yady Tatiana Solano-Correa ◽  
Francesca Bovolo ◽  
Lorenzo Bruzzone
2020 ◽  
Vol 86 (7) ◽  
pp. 431-441 ◽  
Author(s):  
Sébastien Giordano ◽  
Simon Bailly ◽  
Loic Landrieu ◽  
Nesrine Chehata

Leveraging the recent availability of accurate, frequent, and multimodal (radar and optical) Sentinel-1 and -2 acquisitions, this paper investigates the automation of land parcel identi- fication system (LPIS ) crop type classification. Our approach allows for the automatic integration of temporal knowledge, i.e., crop rotations using existing parcel-based land cover databases and multi-modal Sentinel-1 and -2 time series. The temporal evolution of crop types was modeled with a linear- chain conditional random field, trained with time series of multi-modal (radar and optical) satellite acquisitions and associated LPIS. Our model was tested on two study areas in France (≥ 1250 km2) which show different crop types, various parcel sizes, and agricultural practices: . the Seine et Marne and the Alpes de Haute-Provence classified accordingly to a fine national 25-class nomenclature. We first trained a Random Forest classifier without temporal structure to achieve 89.0% overall accuracy in Seine et Marne (10 classes) and 73% in Alpes de Haute-Provence (14 classes). We then demonstrated experimentally that taking into account the temporal structure of crop rotation with our model resulted in an increase of 3% to +5% in accuracy. This increase was especially important (+12%) for classes which were poorly classified without using the temporal structure. A stark posi- tive impact was also demonstrated on permanent crops, while it was fairly limited or even detrimental for annual crops.


Author(s):  
D. Cerra ◽  
J. Bieniarz ◽  
R. Müller ◽  
P. Reinartz

In this paper we propose a cloud removal algorithm for scenes within a Sentinel-2 satellite image time series based on synthetisation of the affected areas via sparse reconstruction. For this purpose, a clouds and clouds shadow mask must be given. With respect to previous works, the process has an increased automation degree. Several dictionaries, on the basis of which the data are reconstructed, are selected randomly from cloud-free areas around the cloud, and for each pixel the dictionary yielding the smallest reconstruction error in non-corrupted images is chosen for the restoration. The values below a cloudy area are therefore estimated by observing the spectral evolution in time of the non-corrupted pixels around it. The proposed restoration algorithm is fast and efficient, requires minimal supervision and yield results with low overall radiometric and spectral distortions.


Author(s):  
C. Tuna ◽  
F. Merciol ◽  
S. Lefèvre

Abstract. Monitoring observable processes in Satellite Image Time Series (SITS) is one of the crucial way to understand dynamics of our planet that is facing unexpected behaviors due to climate change. In this paper, we propose a novel method to assess the evolution of objects (and especially their surface) through time. To do so, we first build a space-time tree representation of image time series. The so-called space-time tree is a hierarchical representation of an image sequences into a nested set of nodes characterizing the observed regions at multiple spatial and temporal scales. Then, we measure for each node the spatial area occupied at each time sample, and we focus on its evolution through time. We thus define the spatio-temporal stability of each node. We use this attribute to identify and measure changing areas in a remotely-sensed scene. We illustrate the purpose of our method with some experiments in a coastal environment using Sentinel-2 images, and in a flood occurred area with Sentinel-1 images.


2020 ◽  
Vol 8 (S1) ◽  
pp. S26-S42 ◽  
Author(s):  
Roberto Interdonato ◽  
Raffaele Gaetano ◽  
Danny Lo Seen ◽  
Mathieu Roche ◽  
Giuseppe Scarpa

AbstractNowadays, modern Earth Observation systems continuously generate huge amounts of data. A notable example is the Sentinel-2 Earth Observation mission, developed by the European Space Agency as part of the Copernicus Programme, which supplies images from the whole planet at high spatial resolution (up to 10 m) with unprecedented revisit time (every 5 days at the equator). In this data-rich scenario, the remote sensing community is showing a growing interest toward modern supervised machine learning techniques (e.g., deep learning) to perform information extraction, often underestimating the need for reference data that this framework implies. Conversely, few attention is being devoted to the use of network analysis techniques, which can provide a set of powerful tools for unsupervised information discovery, subject to the definition of a suitable strategy to build a network-like representation of image data. The aim of this work is to provide clues on how Satellite Image Time Series can be profitably represented using complex network models, by proposing a methodology to build a multilayer network from such data. This is the first work to explore the possibility to exploit this model in the remote sensing domain. An example of community detection over the provided network in a real-case scenario for the mapping of complex land use systems is also presented, to assess the potential of this approach.


2021 ◽  
Vol 13 (2) ◽  
pp. 289
Author(s):  
Misganu Debella-Gilo ◽  
Arnt Kristian Gjertsen

The size and location of agricultural fields that are in active use and the type of use during the growing season are among the vital information that is needed for the careful planning and forecasting of agricultural production at national and regional scales. In areas where such data are not readily available, an independent seasonal monitoring method is needed. Remote sensing is a widely used tool to map land use types, although there are some limitations that can partly be circumvented by using, among others, multiple observations, careful feature selection and appropriate analysis methods. Here, we used Sentinel-2 satellite image time series (SITS) over the land area of Norway to map three agricultural land use classes: cereal crops, fodder crops (grass) and unused areas. The Multilayer Perceptron (MLP) and two variants of the Convolutional Neural Network (CNN), are implemented on SITS data of four different temporal resolutions. These enabled us to compare twelve model-dataset combinations to identify the model-dataset combination that results in the most accurate predictions. The CNN is implemented in the spectral and temporal dimensions instead of the conventional spatial dimension. Rather than using existing deep learning architectures, an autotuning procedure is implemented so that the model hyperparameters are empirically optimized during the training. The results obtained on held-out test data show that up to 94% overall accuracy and 90% Cohen’s Kappa can be obtained when the 2D CNN is applied on the SITS data with a temporal resolution of 7 days. This is closely followed by the 1D CNN on the same dataset. However, the latter performs better than the former in predicting data outside the training set. It is further observed that cereal is predicted with the highest accuracy, followed by grass. Predicting the unused areas has been found to be difficult as there is no distinct surface condition that is common for all unused areas.


2021 ◽  
Vol 13 (22) ◽  
pp. 4668
Author(s):  
Stella Ofori-Ampofo ◽  
Charlotte Pelletier ◽  
Stefan Lang

Crop maps are key inputs for crop inventory production and yield estimation and can inform the implementation of effective farm management practices. Producing these maps at detailed scales requires exhaustive field surveys that can be laborious, time-consuming, and expensive to replicate. With a growing archive of remote sensing data, there are enormous opportunities to exploit dense satellite image time series (SITS), temporal sequences of images over the same area. Generally, crop type mapping relies on single-sensor inputs and is solved with the help of traditional learning algorithms such as random forests or support vector machines. Nowadays, deep learning techniques have brought significant improvements by leveraging information in both spatial and temporal dimensions, which are relevant in crop studies. The concurrent availability of Sentinel-1 (synthetic aperture radar) and Sentinel-2 (optical) data offers a great opportunity to utilize them jointly; however, optimizing their synergy has been understudied with deep learning techniques. In this work, we analyze and compare three fusion strategies (input, layer, and decision levels) to identify the best strategy that optimizes optical-radar classification performance. They are applied to a recent architecture, notably, the pixel-set encoder–temporal attention encoder (PSE-TAE) developed specifically for object-based classification of SITS and based on self-attention mechanisms. Experiments are carried out in Brittany, in the northwest of France, with Sentinel-1 and Sentinel-2 time series. Input and layer-level fusion competitively achieved the best overall F-score surpassing decision-level fusion by 2%. On a per-class basis, decision-level fusion increased the accuracy of dominant classes, whereas layer-level fusion improves up to 13% for minority classes. Against single-sensor baseline, multi-sensor fusion strategies identified crop types more accurately: for example, input-level outperformed Sentinel-2 and Sentinel-1 by 3% and 9% in F-score, respectively. We have also conducted experiments that showed the importance of fusion for early time series classification and under high cloud cover condition.


Author(s):  
M. Rußwurm ◽  
C. Pelletier ◽  
M. Zollner ◽  
S. Lefèvre ◽  
M. Körner

Abstract. We present BreizhCrops, a novel benchmark dataset for the supervised classification of field crops from satellite time series. We aggregated label data and Sentinel-2 top-of-atmosphere as well as bottom-of-atmosphere time series in the region of Brittany (Breizh in local language), north-east France. We compare seven recently proposed deep neural networks along with a Random Forest baseline. The dataset, model (re-)implementations and pre-trained model weights are available at the associated GitHub repository (https://github.com/dl4sits/breizhcrops) that has been designed with applicability for practitioners in mind. We plan to maintain the repository with additional data and welcome contributions of novel methods to build a state-of-the-art benchmark on methods for crop type mapping.


Sign in / Sign up

Export Citation Format

Share Document