scholarly journals Global River Monitoring Using Semantic Fusion Networks

Water ◽  
2020 ◽  
Vol 12 (8) ◽  
pp. 2258 ◽  
Author(s):  
Zhihao Wei ◽  
Kebin Jia ◽  
Xiaowei Jia ◽  
Ankush Khandelwal ◽  
Vipin Kumar
Keyword(s):  
Remote Sensing ◽  
Semantic Information ◽  
Data Augmentation ◽  
Semantic Distance ◽  
Global Scale ◽  
Water Area ◽  
Semantic Features ◽  
Fusion Method ◽  
Segmentation Method ◽  
River Monitoring

Global river monitoring is an important mission within the remote sensing society. One of the main challenges faced by this mission is generating an accurate water mask from remote sensing images (RSI) of rivers (RSIR), especially on a global scale with various river features. Aiming at better water area classification using semantic information, this paper presents a segmentation method for global river monitoring based on semantic clustering and semantic fusion. Firstly, an encoder–decoder network (AEN)-based architecture is proposed to obtain the semantic features from RSIR. Secondly, a clustering-based semantic fusion method is proposed to divide semantic features of RSIR into groups and train convolutional neural networks (CNN) models corresponding to each group using data augmentation and semi-supervised learning. Thirdly, a semantic distance-based segmentation fusion method is proposed for fusing the CNN models result into final segmentation mask. We built a global river dataset that contains multiple river segments from each continent of the world based on Sentinel-2 satellite imagery. The result shows that the F1-score of the proposed segmentation method is 93.32%, which outperforms several state-of-the-art algorithms, and demonstrates that grouping semantic information helps better segment the RSIR in global scale.

scholarly journals Instance Segmentation Method of User Interface Component of Games

2020 ◽  
Vol 10 (18) ◽  
pp. 6502
Author(s):  
Shinjin Kang ◽  
Jong-in Choi
Keyword(s):  
Deep Learning ◽  
Semantic Information ◽  
Data Augmentation ◽  
Image Data ◽  
Learning Networks ◽  
Segmentation Method ◽  
Learning Network ◽  
Additional Input ◽  
Deep Learning Network ◽  
Instance Segmentation

On the game screen, the UI interface provides key information for game play. A vision deep learning network exploits pure pixel information in the screen. Apart from this, if we separately extract the information provided by the UI interface and use it as an additional input value, we can enhance the learning efficiency of deep learning networks. To this end, by effectively segmenting UI interface components such as buttons, image icons, and gauge bars on the game screen, we should be able to separately analyze only the relevant images. In this paper, we propose a methodology that segments UI components in a game by using synthetic game images created on a game engine. We developed a tool that approximately detected the UI areas of an image in games on the game screen and generated a large amount of synthetic labeling data through this. By training this data on a Pix2Pix, we applied UI segmentation. The network trained in this way can segment the UI areas of the target game regardless of the position of the corresponding UI components. Our methodology can help analyze the game screen without applying data augmentation to the game screen. It can also help vision researchers who should extract semantic information from game image data.

scholarly journals A Disparity Refinement Algorithm for Satellite Remote Sensing Images Based on Mean-Shift Plane Segmentation

2021 ◽  
Vol 13 (10) ◽  
pp. 1903
Author(s):  
Zhihui Li ◽  
Jiaxin Liu ◽  
Yang Yang ◽  
Jing Zhang
Keyword(s):  
Remote Sensing ◽  
Satellite Remote Sensing ◽  
Stereo Matching ◽  
Mean Shift ◽  
Segmentation Method ◽  
Remote Sensing Images ◽  
Edge Matching ◽  
Refinement Method ◽  
Initial Segmentation ◽  
Refinement Algorithm

Objects in satellite remote sensing image sequences often have large deformations, and the stereo matching of this kind of image is so difficult that the matching rate generally drops. A disparity refinement method is needed to correct and fill the disparity. A method for disparity refinement based on the results of plane segmentation is proposed in this paper. The plane segmentation algorithm includes two steps: Initial segmentation based on mean-shift and alpha-expansion-based energy minimization. According to the results of plane segmentation and fitting, the disparity is refined by filling missed matching regions and removing outliers. The experimental results showed that the proposed plane segmentation method could not only accurately fit the plane in the presence of noise but also approximate the surface by plane combination. After the proposed plane segmentation method was applied to the disparity refinement of remote sensing images, many missed matches were filled, and the elevation errors were reduced. This proved that the proposed algorithm was effective. For difficult evaluations resulting from significant variations in remote sensing images of different satellites, the edge matching rate and the edge matching map are proposed as new stereo matching evaluation and analysis tools. Experiment results showed that they were easy to use, intuitive, and effective.

scholarly journals Remote Sensing Methods for the Biophysical Characterization of Protected Areas Globally: Challenges and Opportunities

2021 ◽  
Vol 10 (6) ◽  
pp. 384
Author(s):  
Javier Martínez-López ◽  
Bastian Bertzky ◽  
Simon Willcock ◽  
Marine Robuchon ◽  
María Almagro ◽  
...  
Keyword(s):  
Remote Sensing ◽  
Protected Areas ◽  
Large Scale ◽  
Anthropogenic Activities ◽  
Global Scale ◽  
Area Network ◽  
Biophysical Characterization ◽  
Challenges And Opportunities ◽  
Scale Characterization

Protected areas (PAs) are a key strategy to reverse global biodiversity declines, but they are under increasing pressure from anthropogenic activities and concomitant effects. Thus, the heterogeneous landscapes within PAs, containing a number of different habitats and ecosystem types, are in various degrees of disturbance. Characterizing habitats and ecosystems within the global protected area network requires large-scale monitoring over long time scales. This study reviews methods for the biophysical characterization of terrestrial PAs at a global scale by means of remote sensing (RS) and provides further recommendations. To this end, we first discuss the importance of taking into account the structural and functional attributes, as well as integrating a broad spectrum of variables, to account for the different ecosystem and habitat types within PAs, considering examples at local and regional scales. We then discuss potential variables, challenges and limitations of existing global environmental stratifications, as well as the biophysical characterization of PAs, and finally offer some recommendations. Computational and interoperability issues are also discussed, as well as the potential of cloud-based platforms linked to earth observations to support large-scale characterization of PAs. Using RS to characterize PAs globally is a crucial approach to help ensure sustainable development, but it requires further work before such studies are able to inform large-scale conservation actions. This study proposes 14 recommendations in order to improve existing initiatives to biophysically characterize PAs at a global scale.

Cascaded panoptic segmentation method for high resolution remote sensing image

2021 ◽  
pp. 107515
Author(s):  
Xia Hua ◽  
Xinqing Wang ◽  
Ting Rui ◽  
Faming Shao ◽  
Dong Wang
Keyword(s):  
Remote Sensing ◽  
High Resolution ◽  
Remote Sensing Image ◽  
Segmentation Method

scholarly journals An Efficient Module for Instance Segmentation Based on Multi-Level Features and Attention Mechanisms

2021 ◽  
Vol 11 (3) ◽  
pp. 968
Author(s):  
Yingchun Sun ◽  
Wang Gao ◽  
Shuguo Pan ◽  
Tao Zhao ◽  
Yahui Peng
Keyword(s):  
Feature Extraction ◽  
Spatial Structure ◽  
Semantic Feature ◽  
Semantic Features ◽  
Segmentation Method ◽  
Spatial Dimensions ◽  
Feature Pyramid ◽  
Multi Level ◽  
High Level ◽  
Instance Segmentation

Recently, multi-level feature networks have been extensively used in instance segmentation. However, because not all features are beneficial to instance segmentation tasks, the performance of networks cannot be adequately improved by synthesizing multi-level convolutional features indiscriminately. In order to solve the problem, an attention-based feature pyramid module (AFPM) is proposed, which integrates the attention mechanism on the basis of a multi-level feature pyramid network to efficiently and pertinently extract the high-level semantic features and low-level spatial structure features; for instance, segmentation. Firstly, we adopt a convolutional block attention module (CBAM) into feature extraction, and sequentially generate attention maps which focus on instance-related features along the channel and spatial dimensions. Secondly, we build inter-dimensional dependencies through a convolutional triplet attention module (CTAM) in lateral attention connections, which is used to propagate a helpful semantic feature map and filter redundant informative features irrelevant to instance objects. Finally, we construct branches for feature enhancement to strengthen detailed information to boost the entire feature hierarchy of the network. The experimental results on the Cityscapes dataset manifest that the proposed module outperforms other excellent methods under different evaluation metrics and effectively upgrades the performance of the instance segmentation method.

SOURCES OF GLOBAL SCALE SOIL MOISTURE MONITORING DATA BY SATELLITE BASED REMOTE SENSING OF EARTH’S SURFACE

2021 ◽  
Vol 100 (1) ◽  
pp. 36-41
Author(s):  
A.A. Volchek ◽  
◽  
D.O. Petrov ◽  
Keyword(s):  
Remote Sensing ◽  
Soil Moisture ◽  
Global Scale ◽  
Research Papers ◽  
Equivalent Thickness ◽  
Satellite Gravimetry ◽  
Volumetric Soil Moisture ◽  
Characteristic Features ◽  
Agricultural Regions ◽  
Land Water

A review of modern tools of global monitoring of soil moisture by means of remote sensing of the Earth’s surface is presented. The characteristic features of the use of orbital radiometers and radars of C, X and L microwave bands for estimating the volumetric soil moisture at a depth of 5 cm and the root layer of vegetation are considered. A review of the capabilities of satellite gravimetry to assess the land water equivalent thickness is made. A number of sources have been proposed for obtaining estimates of soil water content from satellite based radiometric devices and orbital gravimetric systems. Based on the analysis of scientific research papers, the complexity of monitoring the level of fire danger indices in forests is shown, and the prospects of assessing soil moisture in agricultural regions using microwave orbital instruments are demonstrated, and the adequacy of calculating the moisture content in soil at a depth of up to one meter using satellite gravimetry is described.

Research of Remote Sensing Image Segmentation Based on Mean Shift and Region Merging

2011 ◽  
Vol 90-93 ◽  
pp. 2836-2839 ◽  
Author(s):  
Jian Cui ◽  
Dong Ling Ma ◽  
Ming Yang Yu ◽  
Ying Zhou
Keyword(s):  
Remote Sensing ◽  
Image Segmentation ◽  
Large Scale ◽  
Mean Shift ◽  
Image Features ◽  
Small Scale ◽  
Region Merging ◽  
Segmentation Method ◽  
Shift Method ◽  
Scale Parameters

In order to extract ground information more accurately, it is important to find an image segmentation method to make the segmented features match the ground objects. We proposed an image segmentation method based on mean shift and region merging. With this method, we first segmented the image by using mean shift method and small-scale parameters. According to the region merging homogeneity rule, image features were merged and large-scale image layers were generated. What’s more, Multi-level image object layers were created through scaling method. The test of segmenting remote sensing images showed that the method was effective and feasible, which laid a foundation for object-oriented information extraction.

Sign in / Sign up

Export Citation Format

Share Document