scholarly journals Building Multi-Feature Fusion Refined Network for Building Extraction from High-Resolution Remote Sensing Images

2021 ◽  
Vol 13 (14) ◽  
pp. 2794
Author(s):  
Shuhao Ran ◽  
Xianjun Gao ◽  
Yuanwei Yang ◽  
Shaohua Li ◽  
Guangbin Zhang ◽  
...  
Keyword(s):  
Feature Fusion ◽  
Small Scale ◽  
Automatic Extraction ◽  
Learning Approaches ◽  
Building Extraction ◽  
Visual Interpretation ◽  
Learning Capacity ◽  
Convolutional Networks ◽  
Fully Convolutional Networks ◽  
Great Progress

Deep learning approaches have been widely used in building automatic extraction tasks and have made great progress in recent years. However, the missing detection and wrong detection causing by spectrum confusion is still a great challenge. The existing fully convolutional networks (FCNs) cannot effectively distinguish whether the feature differences are from one building or the building and its adjacent non-building objects. In order to overcome the limitations, a building multi-feature fusion refined network (BMFR-Net) was presented in this paper to extract buildings accurately and completely. BMFR-Net is based on an encoding and decoding structure, mainly consisting of two parts: the continuous atrous convolution pyramid (CACP) module and the multiscale output fusion constraint (MOFC) structure. The CACP module is positioned at the end of the contracting path and it effectively minimizes the loss of effective information in multiscale feature extraction and fusion by using parallel continuous small-scale atrous convolution. To improve the ability to aggregate semantic information from the context, the MOFC structure performs predictive output at each stage of the expanding path and integrates the results into the network. Furthermore, the multilevel joint weighted loss function effectively updates parameters well away from the output layer, enhancing the learning capacity of the network for low-level abstract features. The experimental results demonstrate that the proposed BMFR-Net outperforms the other five state-of-the-art approaches in both visual interpretation and quantitative evaluation.

Fast Airplane Detection Based on Multi-Layer Feature Fusion of Fully Convolutional Networks

2018 ◽  
Vol 38 (3) ◽  
pp. 0315003 ◽  
Author(s):  
辛鹏 Xin Peng ◽  
许悦雷 Xu Yuelei ◽  
唐红 Tang Hong ◽  
马时平 Ma Shiping ◽  
李帅 Li Shuai ◽  
...  
Keyword(s):  
Feature Fusion ◽  
Convolutional Networks ◽  
Fully Convolutional Networks

scholarly journals A Combined Fully Convolutional Networks and Deformable Model for Automatic Left Ventricle Segmentation Based on 3D Echocardiography

2018 ◽  
Vol 2018 ◽  
pp. 1-16 ◽  
Author(s):  
Suyu Dong ◽  
Gongning Luo ◽  
Kuanquan Wang ◽  
Shaodong Cao ◽  
Qince Li ◽  
...  
Keyword(s):  
Left Ventricle ◽  
Feature Fusion ◽  
Three Dimensional ◽  
Geometrical Model ◽  
Deformable Model ◽  
Lv Function ◽  
Practical Applications ◽  
Convolutional Networks ◽  
Fully Convolutional Networks ◽  
Three Dimensional Echocardiography

Segmentation of the left ventricle (LV) from three-dimensional echocardiography (3DE) plays a key role in the clinical diagnosis of the LV function. In this work, we proposed a new automatic method for the segmentation of LV, based on the fully convolutional networks (FCN) and deformable model. This method implemented a coarse-to-fine framework. Firstly, a new deep fusion network based on feature fusion and transfer learning, combining the residual modules, was proposed to achieve coarse segmentation of LV on 3DE. Secondly, we proposed a method of geometrical model initialization for a deformable model based on the results of coarse segmentation. Thirdly, the deformable model was implemented to further optimize the segmentation results with a regularization item to avoid the leakage between left atria and left ventricle to achieve the goal of fine segmentation of LV. Numerical experiments have demonstrated that the proposed method outperforms the state-of-the-art methods on the challenging CETUS benchmark in the segmentation accuracy and has a potential for practical applications.

scholarly journals Learn to Extract Building Outline from Misaligned Annotation through Nearest Feature Selector

2020 ◽  
Vol 12 (17) ◽  
pp. 2722
Author(s):  
Yuxuan Wang ◽  
Guangming Wu ◽  
Yimin Guo ◽  
Yifei Huang ◽  
Ryosuke Shibasaki
Keyword(s):  
Large Scale ◽  
Rapid Development ◽  
Semantic Segmentation ◽  
Loss Functions ◽  
Aerial Image ◽  
Building Extraction ◽  
Convolutional Networks ◽  
Fully Convolutional Networks ◽  
Feature Selector ◽  
Segmentation Task

For efficient building outline extraction, many algorithms, including unsupervised or supervised, have been proposed over the past decades. In recent years, due to the rapid development of the convolutional neural networks, especially fully convolutional networks, building extraction is treated as a semantic segmentation task that deals with the extremely biased positive pixels. The state-of-the-art methods, either through direct or indirect approaches, are mainly focused on better network design. The shifts and rotations, which are coarsely presented in manually created annotations, have long been ignored. Due to the limited number of positive samples, the misalignment will significantly reduce the correctness of pixel-to-pixel loss that might lead to a gradient explosion. To overcome this, we propose a nearest feature selector (NFS) to dynamically re-align the prediction and slightly misaligned annotations. The NFS can be seamlessly appended to existing loss functions and prevent misleading by the errors or misalignment of annotations. Experiments on a large scale aerial image dataset with centered buildings and corresponding building outlines indicate that the additional NFS brings higher performance when compared to existing naive loss functions. In the classic L1 loss, the addition of NFS gains increments of 8.8% of f1-score, 8.9% of kappa coefficient, and 9.8% of Jaccard index, respectively.

scholarly journals Automatic Deep Learning Semantic Segmentation of Ultrasound Thyroid Cineclips using Recurrent Fully Convolutional Networks

IEEE Access ◽  
2020 ◽  
pp. 1-1
Author(s):  
Jeremy M. Webb ◽  
Duane D. Meixner ◽  
Shaheeda A. Adusei ◽  
Eric C. Polley ◽  
Mostafa Fatemi ◽  
...  
Keyword(s):  
Deep Learning ◽  
Semantic Segmentation ◽  
Convolutional Networks ◽  
Fully Convolutional Networks

scholarly journals Boundary Loss-Based 2.5D Fully Convolutional Neural Networks Approach for Segmentation: A Case Study of the Liver and Tumor on Computed Tomography

Algorithms ◽  
2021 ◽  
Vol 14 (5) ◽  
pp. 144
Author(s):  
Yuexing Han ◽  
Xiaolong Li ◽  
Bing Wang ◽  
Lu Wang
Keyword(s):  
Image Segmentation ◽  
Spatial Information ◽  
Medical Images ◽  
Tumor Segmentation ◽  
Convolutional Networks ◽  
Learning Framework ◽  
Fully Convolutional Networks ◽  
Segmentation Accuracy ◽  
Boundary Information

Image segmentation plays an important role in the field of image processing, helping to understand images and recognize objects. However, most existing methods are often unable to effectively explore the spatial information in 3D image segmentation, and they neglect the information from the contours and boundaries of the observed objects. In addition, shape boundaries can help to locate the positions of the observed objects, but most of the existing loss functions neglect the information from the boundaries. To overcome these shortcomings, this paper presents a new cascaded 2.5D fully convolutional networks (FCNs) learning framework to segment 3D medical images. A new boundary loss that incorporates distance, area, and boundary information is also proposed for the cascaded FCNs to learning more boundary and contour features from the 3D medical images. Moreover, an effective post-processing method is developed to further improve the segmentation accuracy. We verified the proposed method on LITS and 3DIRCADb datasets that include the liver and tumors. The experimental results show that the performance of the proposed method is better than existing methods with a Dice Per Case score of 74.5% for tumor segmentation, indicating the effectiveness of the proposed method.

Sign in / Sign up

Export Citation Format

Share Document