scholarly journals NEIGHBOUR-BASED DOMAIN ADAPTATION FOR INVESTIGATION OF TRANSFERABLE ABILITY OF PREVIOUSLY LABELED DATA FOR LAND-COVER CLASSIFICATION OF AERIAL IMAGES

Author(s):  
R. Zhu ◽  
L. Yan

Abstract. Existing land-cover classification methods are usually based on adequate labelled data. But annotating enough training samples is hard and time-consuming. Therefore, we need to investigate how existing labelled data can help to increase land-cover classification. Source labelled data are proposed to be selected by calculating the target center of reliable target pseudo-labelled data for each class in this paper. Then we augment the training dataset with reliable target pesudo-labeled data and selected source labelled data to improve the quality and quantity of training dataset. We also investigate the amount of source labelled data that should be selected and the number of limited target labelled data that can produce good transfer learning performance. The UC Merced dataset is employed as the target dataset to evaluate the proposed approach while the NWPU-RESISC45 dataset is considered as the source labelled data. The experimental results show that selected source labelled data and reliable target pesudo-labeled data may improve the land-cover classification performance if selected source labelled data and reliable target pesudo-labeled data are augmented with the limited target labelled data respectively.

2019 ◽  
Vol 11 (10) ◽  
pp. 1153 ◽  
Author(s):  
Mesay Belete Bejiga ◽  
Farid Melgani ◽  
Pietro Beraldini

Learning classification models require sufficiently labeled training samples, however, collecting labeled samples for every new problem is time-consuming and costly. An alternative approach is to transfer knowledge from one problem to another, which is called transfer learning. Domain adaptation (DA) is a type of transfer learning that aims to find a new latent space where the domain discrepancy between the source and the target domain is negligible. In this work, we propose an unsupervised DA technique called domain adversarial neural networks (DANNs), composed of a feature extractor, a class predictor, and domain classifier blocks, for large-scale land cover classification. Contrary to the traditional methods that perform representation and classifier learning in separate stages, DANNs combine them into a single stage, thereby learning a new representation of the input data that is both domain-invariant and discriminative. Once trained, the classifier of a DANN can be used to predict both source and target domain labels. Additionally, we also modify the domain classifier of a DANN to evaluate its suitability for multi-target domain adaptation problems. Experimental results obtained for both single and multiple target DA problems show that the proposed method provides a performance gain of up to 40%.


Author(s):  
D. Wittich

Abstract. Fully convolutional neural networks (FCN) are successfully used for the automated pixel-wise classification of aerial images and possibly additional data. However, they require many labelled training samples to perform well. One approach addressing this issue is semi-supervised domain adaptation (SSDA). Here, labelled training samples from a source domain and unlabelled samples from a target domain are used jointly to obtain a target domain classifier, without requiring any labelled samples from the target domain. In this paper, a two-step approach for SSDA is proposed. The first step corresponds to a supervised training on the source domain, making use of strong data augmentation to increase the initial performance on the target domain. Secondly, the model is adapted by entropy minimization using a novel weighting strategy. The approach is evaluated on the basis of five domains, corresponding to five cities. Several training variants and adaptation scenarios are tested, indicating that proper data augmentation can already improve the initial target domain performance significantly resulting in an average overall accuracy of 77.5%. The weighted entropy minimization improves the overall accuracy on the target domains in 19 out of 20 scenarios on average by 1.8%. In all experiments a novel FCN architecture is used that yields results comparable to those of the best-performing models on the ISPRS labelling challenge while having an order of magnitude fewer parameters than commonly used FCNs.


Author(s):  
C. Yang ◽  
F. Rottensteiner ◽  
C. Heipke

<p><strong>Abstract.</strong> Land use and land cover are two important variables in remote sensing. Commonly, the information of land use is stored in geospatial databases. In order to update such databases, we present a new approach to determine the land cover and to classify land use objects using convolutional neural networks (CNN). High-resolution aerial images and derived data such as digital surface models serve as input. An encoder-decoder based CNN is used for land cover classification. We found a composite including the infrared band and height data to outperform RGB images in land cover classification. We also propose a CNN-based methodology for the prediction of land use label from the geospatial databases, where we use masks representing object shape, the RGB images and the pixel-wise class scores of land cover as input. For this task, we developed a two-branch network where the first branch considers the whole area of an image, while the second branch focuses on a smaller relevant area. We evaluated our methods using two sites and achieved an overall accuracy of up to 89.6% and 81.7% for land cover and land use, respectively. We also tested our methods for land cover classification using the Vaihingen dataset of the ISPRS 2D semantic labelling challenge and achieved an overall accuracy of 90.7%.</p>


Author(s):  
Katmoko Ari Sambodo ◽  
Novie Indriasari

Land cover classification is  one  of  the  extensive  used  applications in  the  field  of remote sensing. Recently, Synthetic Aperture Radar (SAR) data has become an increasing popular data source because  its  capability  to  penetrate  through  clouds,  haze,  and  smoke.  This  study  showed  on  an alternative  method  for  land  cover  classification  of  ALOS-PALSAR  data  using  Support  Vector Machine (SVM) classifier. SVM discriminates two classes by fitting an optimal separating hyperplane to the training data in a multidimensional feature space, by using only the closest training samples. In order  to  minimize  the  presence  of  outliers  in  the  training  samples  and  to  increase  inter-class separabilities,  prior  to  classification,  a  training  sample  selection  and  evaluation  technique  by identifying its position in a horizontal vertical–vertical horizontal polarization (HV-HH) feature space was applied. The effectiveness of our method was demonstrated using ALOS PALSAR data (25 m mosaic, dual polarization) acquired in Jambi and South Sumatra, Indonesia. There were nine different classes  discriminated:  forest,  rubber  plantation,  mangrove  &  shrubs  with  trees,  oilpalm  &  coconut, shrubs,  cropland,  bare  soil,  settlement,  and  water.  Overall  accuracy  of  87.79%  was  obtained,  with producer’s accuracies for forest, rubber plantation, mangrove & shrubs with trees, cropland, and water class were greater than 92%.


Author(s):  
C. Yang ◽  
F. Rottensteiner ◽  
C. Heipke

Abstract. Pixel-based land cover classification of aerial images is a standard task in remote sensing, whose goal is to identify the physical material of the earth’s surface. Recently, most of the well-performing methods rely on encoder-decoder structure based convolutional neural networks (CNN). In the encoder part, many successive convolution and pooling operations are applied to obtain features at a lower spatial resolution, and in the decoder part these features are up-sampled gradually and layer by layer, in order to make predictions in the original spatial resolution. However, the loss of spatial resolution caused by pooling affects the final classification performance negatively, which is compensated by skip-connections between corresponding features in the encoder and the decoder. The most popular ways to combine features are element-wise addition of feature maps and 1x1 convolution. In this work, we investigate skip-connections. We argue that not every skip-connections are equally important. Therefore, we conducted experiments designed to find out which skip-connections are important. Moreover, we propose a new cosine similarity loss function to utilize the relationship of the features of the pixels belonging to the same category inside one mini-batch, i.e. these features should be close in feature space. Our experiments show that the new cosine similarity loss does help the classification. We evaluated our methods using the Vaihingen and Potsdam dataset of the ISPRS 2D semantic labelling challenge and achieved an overall accuracy of 91.1% for both test sites.


Sign in / Sign up

Export Citation Format

Share Document