scholarly journals WTS: A Weakly towards Strongly Supervised Learning Framework for Remote Sensing Land Cover Classification Using Segmentation Models

2021 ◽  
Vol 13 (3) ◽  
pp. 394
Author(s):  
Wei Zhang ◽  
Ping Tang ◽  
Thomas Corpetti ◽  
Lijun Zhao
Keyword(s):  
Remote Sensing ◽  
Land Cover ◽  
Supervised Learning ◽  
Region Growing ◽  
Semantic Segmentation ◽  
Land Cover Classification ◽  
Training Set ◽  
Seeded Region Growing ◽  
Class Labels ◽  
Segmentation Models

Land cover classification is one of the most fundamental tasks in the field of remote sensing. In recent years, fully supervised fully convolutional network (FCN)-based semantic segmentation models have achieved state-of-the-art performance in the semantic segmentation task. However, creating pixel-level annotations is prohibitively expensive and laborious, especially when dealing with remote sensing images. Weakly supervised learning methods from weakly labeled annotations can overcome this difficulty to some extent and achieve impressive segmentation results, but results are limited in accuracy. Inspired by point supervision and the traditional segmentation method of seeded region growing (SRG) algorithm, a weakly towards strongly (WTS) supervised learning framework is proposed in this study for remote sensing land cover classification to handle the absence of well-labeled and abundant pixel-level annotations when using segmentation models. In this framework, only several points with true class labels are required as the training set, which are much less expensive to acquire compared with pixel-level annotations through field survey or visual interpretation using high-resolution images. Firstly, they are used to train a Support Vector Machine (SVM) classifier. Once fully trained, the SVM is used to generate the initial seeded pixel-level training set, in which only the pixels with high confidence are assigned with class labels whereas others are unlabeled. They are used to weakly train the segmentation model. Then, the seeded region growing module and fully connected Conditional Random Fields (CRFs) are used to iteratively update the seeded pixel-level training set for progressively increasing pixel-level supervision of the segmentation model. Sentinel-2 remote sensing images are used to validate the proposed framework, and SVM is selected for comparison. In addition, FROM-GLC10 global land cover map is used as training reference to directly train the segmentation model. Experimental results show that the proposed framework outperforms other methods and can be highly recommended for land cover classification tasks when the pixel-level labeled datasets are insufficient by using segmentation models.

scholarly journals SEMI-SUPERVISED SEMANTIC SEGMENTATION NETWORK VIA LEARNING CONSISTENCY FOR REMOTE SENSING LAND-COVER CLASSIFICATION

2020 ◽  
Vol V-2-2020 ◽  
pp. 609-615
Author(s):  
B. Zhang ◽  
Y. Zhang ◽  
Y. Li ◽  
Y. Wan ◽  
F. Wen
Keyword(s):  
Neural Network ◽  
Remote Sensing ◽  
Neural Networks ◽  
Land Cover ◽  
Deep Neural Networks ◽  
Semantic Segmentation ◽  
Land Cover Classification ◽  
Unlabeled Data ◽  
Weighted Sum ◽  
Affine Transform

Abstract. Current popular deep neural networks for semantic segmentation are almost supervised and highly rely on a large amount of labeled data. However, obtaining a large amount of pixel-level labeled data is time-consuming and laborious. In remote sensing area, this problem is more urgent. To alleviate this problem, we propose a novel semantic segmentation neural network (S4Net) based on semi-supervised learning by using unlabeled data. Our model can learn from unlabeled data by consistency regularization, which enforces the consistency of output under different random transforms and perturbations, such as random affine transform. Thus, the network is trained by the weighted sum of a supervised loss from labeled data and a consistency regularization loss from unlabeled data. The experiments we conducted on DeepGlobe land cover classification challenge dataset verified that our network can make use of unlabeled data to obtain precise results of semantic segmentation and achieve competitive performance when compared to other methods.

scholarly journals Dual Attention Feature Fusion and Adaptive Context for Accurate Segmentation of Very High-Resolution Remote Sensing Images

2021 ◽  
Vol 13 (18) ◽  
pp. 3715
Author(s):  
Hao Shi ◽  
Jiahe Fan ◽  
Yupei Wang ◽  
Liang Chen
Keyword(s):  
Remote Sensing ◽  
High Resolution ◽  
Land Cover ◽  
Feature Fusion ◽  
Semantic Segmentation ◽  
Land Cover Classification ◽  
Contextual Cues ◽  
Remote Sensing Images ◽  
Object Boundary ◽  
Convolutional Network

Land cover classification of high-resolution remote sensing images aims to obtain pixel-level land cover understanding, which is often modeled as semantic segmentation of remote sensing images. In recent years, convolutional network (CNN)-based land cover classification methods have achieved great advancement. However, previous methods fail to generate fine segmentation results, especially for the object boundary pixels. In order to obtain boundary-preserving predictions, we first propose to incorporate spatially adapting contextual cues. In this way, objects with similar appearance can be effectively distinguished with the extracted global contextual cues, which are very helpful to identify pixels near object boundaries. On this basis, low-level spatial details and high-level semantic cues are effectively fused with the help of our proposed dual attention mechanism. Concretely, when fusing multi-level features, we utilize the dual attention feature fusion module based on both spatial and channel attention mechanisms to relieve the influence of the large gap, and further improve the segmentation accuracy of pixels near object boundaries. Extensive experiments were carried out on the ISPRS 2D Semantic Labeling Vaihingen data and GaoFen-2 data to demonstrate the effectiveness of our proposed method. Our method achieves better performance compared with other state-of-the-art methods.

scholarly journals LAND COVER CLASSIFICATION USING HIGH RESOLUTION SATELLITE IMAGE BASED ON DEEP LEARNING

2020 ◽  
Vol XLII-3/W10 ◽  
pp. 685-690
Author(s):  
M. Zhu ◽  
B. Wu ◽  
Y. N. He ◽  
Y. Q. He
Keyword(s):  
Remote Sensing ◽  
Deep Learning ◽  
High Resolution ◽  
Land Cover ◽  
Satellite Image ◽  
Remote Sensing Data ◽  
Semantic Segmentation ◽  
Land Cover Classification ◽  
Main Task ◽  
High Resolution Satellite Image

Abstract. In the coming era of big data, the high resolution satellite image plays an important role in providing a rich source of information for a variety of applications. Land cover classification is a major field of remote sensing application. The main task of land cover classification is to divide the pixels or regions in remote sensing imagery into several categories according to application requirements. Recently, machine interpretation methods including artificial neural network and decision tree are developing rapidly with certain fruits achieved. Compared with traditional methods, deep learning is completely data-driven, which can automatically find the best ways to extract land cover features through high resolution satellite image. This study presents a detailed investigation of convolutional neural networks for the classification of complex land cover classes using high resolution satellite image. The main contributions of this paper are as follows: (1) Aiming at the uneven spatial distribution of surface coverage, we study the training errors caused by this uneven distribution. An improved SMOTE algorithm is designed for automatic processing the task of sample augmentation. Through experimental verification, the improver algorithm can increase 2–5% classification accuracy by the same network structure. (2) The main representations of the network are also shared between the edge loss reinforced structures and semantic segmentation, which means that the CNN simultaneously achieves semantic segmentation by edge detection. (3) We use Beijing-2 satellite (BJ-2) remote sensing data for training and evaluation with Integrated Model, and the total accuracy reaches 89.6%.

scholarly journals DFFAN: Dual Function Feature Aggregation Network for Semantic Segmentation of Land Cover

2021 ◽  
Vol 10 (3) ◽  
pp. 125
Author(s):  
Junqing Huang ◽  
Liguo Weng ◽  
Bingyu Chen ◽  
Min Xia
Keyword(s):  
Remote Sensing ◽  
Land Cover ◽  
Spatial Information ◽  
Feature Fusion ◽  
Semantic Segmentation ◽  
Dual Function ◽  
Context Information ◽  
Remote Sensing Images ◽  
Feature Aggregation ◽  
Image Context

Analyzing land cover using remote sensing images has broad prospects, the precise segmentation of land cover is the key to the application of this technology. Nowadays, the Convolution Neural Network (CNN) is widely used in many image semantic segmentation tasks. However, existing CNN models often exhibit poor generalization ability and low segmentation accuracy when dealing with land cover segmentation tasks. To solve this problem, this paper proposes Dual Function Feature Aggregation Network (DFFAN). This method combines image context information, gathers image spatial information, and extracts and fuses features. DFFAN uses residual neural networks as backbone to obtain different dimensional feature information of remote sensing images through multiple downsamplings. This work designs Affinity Matrix Module (AMM) to obtain the context of each feature map and proposes Boundary Feature Fusion Module (BFF) to fuse the context information and spatial information of an image to determine the location distribution of each image’s category. Compared with existing methods, the proposed method is significantly improved in accuracy. Its mean intersection over union (MIoU) on the LandCover dataset reaches 84.81%.

Sign in / Sign up

Export Citation Format

Share Document