Registration of High Resolution Sar and Optical Satellite Imagery Using Fully Convolutional Networks

2019 ◽  
Author(s):  
Stefan Hoffmann ◽  
Clemens-Alexander Brust ◽  
Maha Shadaydeh ◽  
Joachim Denzler
Keyword(s):  
High Resolution ◽  
Satellite Imagery ◽  
Convolutional Networks ◽  
Fully Convolutional Networks

scholarly journals Attention-Based Context Aware Network for Semantic Comprehension of Aerial Scenery

Sensors ◽  
2021 ◽  
Vol 21 (6) ◽  
pp. 1983
Author(s):  
Weipeng Shi ◽  
Wenhu Qin ◽  
Zhonghua Yun ◽  
Peng Ping ◽  
Kaiyang Wu ◽  
...  
Keyword(s):  
High Resolution ◽  
Semantic Segmentation ◽  
Aerial Images ◽  
Aerial Image ◽  
Convolutional Network ◽  
Convolutional Networks ◽  
Fully Convolutional Networks ◽  
Semantic Labeling ◽  
Autonomous Cars ◽  
High Resolution Images

It is essential for researchers to have a proper interpretation of remote sensing images (RSIs) and precise semantic labeling of their component parts. Although FCN (Fully Convolutional Networks)-like deep convolutional network architectures have been widely applied in the perception of autonomous cars, there are still two challenges in the semantic segmentation of RSIs. The first is to identify details in high-resolution images with complex scenes and to solve the class-mismatch issues; the second is to capture the edge of objects finely without being confused by the surroundings. HRNET has the characteristics of maintaining high-resolution representation by fusing feature information with parallel multi-resolution convolution branches. We adopt HRNET as a backbone and propose to incorporate the Class-Oriented Region Attention Module (CRAM) and Class-Oriented Context Fusion Module (CCFM) to analyze the relationships between classes and patch regions and between classes and local or global pixels, respectively. Thus, the perception capability of the model for the detailed part in the aerial image can be enhanced. We leverage these modules to develop an end-to-end semantic segmentation model for aerial images and validate it on the ISPRS Potsdam and Vaihingen datasets. The experimental results show that our model improves the baseline accuracy and outperforms some commonly used CNN architectures.

scholarly journals Earthquake-Damaged Buildings Detection in Very High-Resolution Remote Sensing Images Based on Object Context and Boundary Enhanced Loss

2021 ◽  
Vol 13 (16) ◽  
pp. 3119
Author(s):  
Chao Wang ◽  
Xing Qiu ◽  
Hai Huan ◽  
Shuai Wang ◽  
Yan Zhang ◽  
...  
Keyword(s):  
Remote Sensing ◽  
High Resolution ◽  
Feature Representation ◽  
Detection Accuracy ◽  
Remote Sensing Images ◽  
Convolutional Networks ◽  
Fully Convolutional Networks ◽  
Benchmark Datasets ◽  
High Level ◽  
Very High

Fully convolutional networks (FCN) such as UNet and DeepLabv3+ are highly competitive when being applied in the detection of earthquake-damaged buildings in very high-resolution (VHR) remote sensing images. However, existing methods show some drawbacks, including incomplete extraction of different sizes of buildings and inaccurate boundary prediction. It is attributed to a deficiency in the global context-aware and inaccurate correlation mining in the spatial context as well as failure to consider the relative positional relationship between pixels and boundaries. Hence, a detection method for earthquake-damaged buildings based on the object contextual representations (OCR) and boundary enhanced loss (BE loss) was proposed. At first, the OCR module was separately embedded into high-level feature extractions of the two networks DeepLabv3+ and UNet in order to enhance the feature representation; in addition, a novel loss function, that is, BE loss, was designed according to the distance between the pixels and boundaries to force the networks to pay more attention to the learning of the boundary pixels. Finally, two improved networks (including OB-DeepLabv3+ and OB-UNet) were established according to the two strategies. To verify the performance of the proposed method, two benchmark datasets (including YSH and HTI) for detecting earthquake-damaged buildings were constructed according to the post-earthquake images in China and Haiti in 2010, respectively. The experimental results show that both the embedment of the OCR module and application of BE loss contribute to significantly increasing the detection accuracy of earthquake-damaged buildings and the two proposed networks are feasible and effective.

scholarly journals THE LAND COVER CLASSIFICATION USING A FEATURE PYRAMID NETWORKS ARCHITECTURE FROM SATELLITE IMAGERY

2020 ◽  
Vol XLIII-B3-2020 ◽  
pp. 241-246
Author(s):  
Q. Zhang ◽  
Y. Zhang ◽  
P. Yang ◽  
Y. Meng ◽  
S. Zhuo ◽  
...  
Keyword(s):  
Land Cover ◽  
Transfer Learning ◽  
Satellite Imagery ◽  
Loss Function ◽  
Land Cover Classification ◽  
Deep Convolutional Neural Networks ◽  
Convolutional Networks ◽  
Fully Convolutional Networks ◽  
Sensing Applications ◽  
Feature Pyramid

Abstract. Extracting land cover information from satellite imagery is of great importance for the task of automated monitoring in various remote sensing applications. Deep convolutional neural networks make this task more feasible, but they are limited by the small dataset of annotated images. In this paper, we present a fully convolutional networks architecture, FPN-VGG, that combines Feature Pyramid Networks and VGG. In order to accomplish the task of land cover classification, we create a land cover dataset of pixel-wise annotated images, and employ a transfer learning step and the variant dice loss function to promote the performance of FPN-VGG. The results indicate that FPN-VGG shows more competence for land cover classification comparing with other state-of-the-art fully convolutional networks. The transfer learning and dice loss function are beneficial to improve the performance of on the small and unbalanced dataset. Our best model on the dataset gets an overall accuracy of 82.9%, an average F1 score of 66.0% and an average IoU of 52.7%.

Using deep learning to transfer knowledge between satellite datasets for automated agricultural land discrimination in Afghanistan

2020 ◽  
Author(s):  
Alex Hamer ◽  
Daniel Simms ◽  
Toby Waine
Keyword(s):  
Deep Learning ◽  
Satellite Imagery ◽  
Vegetation Index ◽  
Agricultural Land ◽  
Spectral Characteristics ◽  
Classification Performance ◽  
Convolutional Networks ◽  
Fully Convolutional Networks ◽  
Normalised Difference Vegetation Index ◽  
Drugs And Crime

<p>Accurate mapping of agricultural area is essential for Afghanistan’s annual opium poppy monitoring programme. Access to labelled data remains the main barrier for utilising deep learning from satellite imagery to automate the process of land cover classification. In this study, we aim to transfer knowledge from historical labelled data of agricultural land, from work on poppy cultivation estimates undertaken between 2007 and 2010, to classify imagery from a range of sensors using deep learning. Fully Convolutional Networks (FCNs) have been used to learn the complex features of agriculture in southern Afghanistan using their inherent spatial and spectral characteristics from satellite imagery. FCNs are trained and validated using labelled Disaster Monitoring Constellation (DMC) data (32 m) to transfer knowledge of agricultural land to classify other imagery, such as Landsat (30 m). The dependency on spatial and spectral characteristics are explored using intensity, Normalised Difference Vegetation Index (NDVI), top of atmosphere reflectance and tasselled cap transformation. The underlying spatial features associated with agriculture are found to play a significant role in agriculture discrimination. High classification performance has been achieved with over 92% overall accuracy and 0.58 intersection over union. The ability to transfer knowledge from historical datasets to new satellite sensors is an exciting prospect for future automated agricultural land discrimination in the United Nations Office on Drugs and Crime annual opium survey.</p>

Sign in / Sign up

Export Citation Format

Share Document