scholarly journals A Hierarchical Feature Extraction Network for Fast Scene Segmentation

Sensors ◽  
2021 ◽  
Vol 21 (22) ◽  
pp. 7730
Author(s):  
◽  
Keyword(s):  
Feature Extraction ◽  
Spatial Information ◽  
Contextual Information ◽  
Semantic Segmentation ◽  
Superior Performance ◽  
Scene Segmentation ◽  
Research Topics ◽  
Time Performance ◽  
Segmentation Accuracy ◽  
Active Research

Semantic segmentation is one of the most active research topics in computer vision with the goal to assign dense semantic labels for all pixels in a given image. In this paper, we introduce HFEN (Hierarchical Feature Extraction Network), a lightweight network to reach a balance between inference speed and segmentation accuracy. Our architecture is based on an encoder-decoder framework. The input images are down-sampled through an efficient encoder to extract multi-layer features. Then the extracted features are fused via a decoder, where the global contextual information and spatial information are aggregated for final segmentations with real-time performance. Extensive experiments have been conducted on two standard benchmarks, Cityscapes and Camvid, where our network achieved superior performance on NVIDIA 2080Ti.

scholarly journals HRCNet: High-Resolution Context Extraction Network for Semantic Segmentation of Remote Sensing Images

2020 ◽  
Vol 13 (1) ◽  
pp. 71
Author(s):  
Zhiyong Xu ◽  
Weicun Zhang ◽  
Tianxiang Zhang ◽  
Jiangyun Li
Keyword(s):  
Remote Sensing ◽  
Feature Extraction ◽  
High Resolution ◽  
Spatial Information ◽  
Semantic Segmentation ◽  
Context Information ◽  
Remote Sensing Images ◽  
Global Context ◽  
Boundary Information ◽  
Extraction Stage

Semantic segmentation is a significant method in remote sensing image (RSIs) processing and has been widely used in various applications. Conventional convolutional neural network (CNN)-based semantic segmentation methods are likely to lose the spatial information in the feature extraction stage and usually pay little attention to global context information. Moreover, the imbalance of category scale and uncertain boundary information meanwhile exists in RSIs, which also brings a challenging problem to the semantic segmentation task. To overcome these problems, a high-resolution context extraction network (HRCNet) based on a high-resolution network (HRNet) is proposed in this paper. In this approach, the HRNet structure is adopted to keep the spatial information. Moreover, the light-weight dual attention (LDA) module is designed to obtain global context information in the feature extraction stage and the feature enhancement feature pyramid (FEFP) structure is promoted and employed to fuse the contextual information of different scales. In addition, to achieve the boundary information, we design the boundary aware (BA) module combined with the boundary aware loss (BAloss) function. The experimental results evaluated on Potsdam and Vaihingen datasets show that the proposed approach can significantly improve the boundary and segmentation performance up to 92.0% and 92.3% on overall accuracy scores, respectively. As a consequence, it is envisaged that the proposed HRCNet model will be an advantage in remote sensing images segmentation.

scholarly journals Water Areas Segmentation from Remote Sensing Images Using a Separable Residual SegNet Network

2020 ◽  
Vol 9 (4) ◽  
pp. 256 ◽  
Author(s):  
Liguo Weng ◽  
Yiming Xu ◽  
Min Xia ◽  
Yonghong Zhang ◽  
Jia Liu ◽  
...  
Keyword(s):  
Remote Sensing ◽  
Feature Extraction ◽  
Spatial Information ◽  
Global Climate ◽  
Semantic Segmentation ◽  
Water Area ◽  
Remote Sensing Images ◽  
The One ◽  
High Level ◽  
Almost All

Changes on lakes and rivers are of great significance for the study of global climate change. Accurate segmentation of lakes and rivers is critical to the study of their changes. However, traditional water area segmentation methods almost all share the following deficiencies: high computational requirements, poor generalization performance, and low extraction accuracy. In recent years, semantic segmentation algorithms based on deep learning have been emerging. Addressing problems associated to a very large number of parameters, low accuracy, and network degradation during training process, this paper proposes a separable residual SegNet (SR-SegNet) to perform the water area segmentation using remote sensing images. On the one hand, without compromising the ability of feature extraction, the problem of network degradation is alleviated by adding modified residual blocks into the encoder, the number of parameters is limited by introducing depthwise separable convolutions, and the ability of feature extraction is improved by using dilated convolutions to expand the receptive field. On the other hand, SR-SegNet removes the convolution layers with relatively more convolution kernels in the encoding stage, and uses the cascading method to fuse the low-level and high-level features of the image. As a result, the whole network can obtain more spatial information. Experimental results show that the proposed method exhibits significant improvements over several traditional methods, including FCN, DeconvNet, and SegNet.

scholarly journals UnetDVH-Linear: Linear Feature Segmentation by Dilated Convolution with Vertical and Horizontal Kernels

Sensors ◽  
2020 ◽  
Vol 20 (20) ◽  
pp. 5759 ◽  
Author(s):  
Jiacai Liao ◽  
Libo Cao ◽  
Wei Li ◽  
Xiaole Luo ◽  
Xiexing Feng
Keyword(s):  
Feature Extraction ◽  
Contextual Information ◽  
Semantic Segmentation ◽  
Complete Information ◽  
Lane Detection ◽  
Aerial Images ◽  
Linear Feature ◽  
Dilated Convolution ◽  
Linear Feature Extraction ◽  
The Neural Network

Linear feature extraction is crucial for special objects in semantic segmentation networks, such as slot marking and lanes. The objects with linear characteristics have global contextual information dependency. It is very difficult to capture the complete information of these objects in semantic segmentation tasks. To improve the linear feature extraction ability of the semantic segmentation network, we propose introducing the dilated convolution with vertical and horizontal kernels (DVH) into the task of feature extraction in semantic segmentation networks. Meanwhile, we figure out the outcome if we put the different vertical and horizontal kernels on different places in the semantic segmentation networks. Our networks are trained on the basis of the SS dataset, the TuSimple lane dataset and the Massachusetts Roads dataset. These datasets consist of slot marking, lanes, and road images. The research results show that our method improves the accuracy of the slot marking segmentation of the SS dataset by 2%. Compared with other state-of-the-art methods, our UnetDVH-Linear (v1) obtains better accuracy on the TuSimple Benchmark Lane Detection Challenge with a value of 97.53%. To prove the generalization of our models, road segmentation experiments were performed on aerial images. Without data argumentation, the segmentation accuracy of our model on the Massachusetts roads dataset is 95.3%. Moreover, our models perform better than other models when training with the same loss function and experimental settings. The experiment result shows that the dilated convolution with vertical and horizontal kernels will enhance the neural network on linear feature extraction.

scholarly journals Feature-Enhanced Occlusion Perception Object Detection for Smart Cities

2021 ◽  
Vol 2021 ◽  
pp. 1-14
Author(s):  
Jie Xu ◽  
Hanyuan Wang ◽  
Mingzhu Xu ◽  
Fan Yang ◽  
Yifei Zhou ◽  
...  
Keyword(s):  
Object Detection ◽  
Traffic Control ◽  
Spatial Information ◽  
Smart Cities ◽  
Contextual Information ◽  
Feature Representation ◽  
Superior Performance ◽  
Feature Maps ◽  
Pascal Voc ◽  
Occluded Objects

Object detection is used widely in smart cities including safety monitoring, traffic control, and car driving. However, in the smart city scenario, many objects will have occlusion problems. Moreover, most popular object detectors are often sensitive to various real-world occlusions. This paper proposes a feature-enhanced occlusion perception object detector by simultaneously detecting occluded objects and fully utilizing spatial information. To generate hard examples with occlusions, a mask generator localizes and masks discriminated regions with weakly supervised methods. To obtain enriched feature representation, we design a multiscale representation fusion module to combine hierarchical feature maps. Moreover, this method exploits contextual information by heaping up representations from different regions in feature maps. The model is trained end-to-end learning by minimizing the multitask loss. Our model obtains superior performance compared to previous object detectors, 77.4% mAP and 74.3% mAP on PASCAL VOC 2007 and PASCAL VOC 2012, respectively. It also achieves 24.6% mAP on MS COCO. Experiments demonstrate that the proposed method is useful to improve the effectiveness of object detection, making it highly suitable for smart cities application that need to discover key objects with occlusions.

scholarly journals AN OPTIMIZED FEATURE EXTRACTION TECHNIQUE FOR CONTENT BASED IMAGE RETRIEVAL

2013 ◽  
pp. 11-16
Author(s):  
SAVITHA SIVAN ◽  
THUSNAVIS BELLA MARY. I
Keyword(s):  
Feature Extraction ◽  
Image Retrieval ◽  
Feature Fusion ◽  
Texture Features ◽  
Research Area ◽  
Superior Performance ◽  
Content Based Image Retrieval ◽  
Multimedia Technologies ◽  
Active Research ◽  
Occurrence Matrix

Content-based image retrieval (CBIR) is an active research area with the development of multimedia technologies and has become a source of exact and fast retrieval. The aim of CBIR is to search and retrieve images from a large database and find out the best match for the given query. Accuracy and efficiency for high dimensional datasets with enormous number of samples is a challenging arena. In this paper, Content Based Image Retrieval using various features such as color, shape, texture is made and a comparison is made among them. The performance of the retrieval system is evaluated depending upon the features extracted from an image. The performance was evaluated using precision and recall rates. Haralick texture features were analyzed at 0 o, 45 o, 90 o, 180 o using gray level co-occurrence matrix. Color feature extraction was done using color moments. Structured features and multiple feature fusion are two main technologies to ensure the retrieval accuracy in the system. GIST is considered as one of the main structured features. It was experimentally observed that combination of these techniques yielded superior performance than individual features. The results for the most efficient combination of techniques have also been presented and optimized for each class of query.

scholarly journals PPANet: Point-Wise Pyramid Attention Network for Semantic Segmentation

2021 ◽  
Vol 2021 ◽  
pp. 1-16
Author(s):  
Mohammed A. M. Elhassan ◽  
YuXuan Chen ◽  
Yunyi Chen ◽  
Chenxi Huang ◽  
Jane Yang ◽  
...  
Keyword(s):  
Contextual Information ◽  
Semantic Segmentation ◽  
Autonomous Driving ◽  
Middle Part ◽  
Driver Assistance ◽  
Driver Assistance Systems ◽  
Attention Network ◽  
Feature Representations ◽  
Segmentation Accuracy ◽  
Road Segmentation

In recent years, convolutional neural networks (CNNs) have been at the centre of the advances and progress of advanced driver assistance systems and autonomous driving. This paper presents a point-wise pyramid attention network, namely, PPANet, which employs an encoder-decoder approach for semantic segmentation. Specifically, the encoder adopts a novel squeeze nonbottleneck module as a base module to extract feature representations, where squeeze and expansion are utilized to obtain high segmentation accuracy. An upsampling module is designed to work as a decoder; its purpose is to recover the lost pixel-wise representations from the encoding part. The middle part consists of two parts point-wise pyramid attention (PPA) module and an attention-like module connected in parallel. The PPA module is proposed to utilize contextual information effectively. Furthermore, we developed a combined loss function from dice loss and binary cross-entropy to improve accuracy and get faster training convergence in KITTI road segmentation. The paper conducted the training and testing experiments on KITTI road segmentation and Camvid datasets, and the evaluation results show that the proposed method proved its effectiveness in road semantic segmentation.

scholarly journals SUPERVISED MANIFOLD-LEARNING ALGORITHM FOR POLSAR FEATURE EXTRACTION AND LULC CLASSIFICATION

2020 ◽  
Vol XLIII-B3-2020 ◽  
pp. 345-350
Author(s):  
W. Wang ◽  
Z. Tian ◽  
B. Tian ◽  
J. Zhang
Keyword(s):  
Feature Extraction ◽  
Manifold Learning ◽  
Spatial Information ◽  
Feature Space ◽  
Speckle Noise ◽  
Superior Performance ◽  
Svm Classifier ◽  
Tensor Algebra ◽  
Data Set ◽  
Low Dimensional

Abstract. In this paper, a supervised manifold-learning method is proposed for PolSAR feature extraction and classification. Based on the tensor algebra, the proposed method characterizes each pixel with a local neighbourhood centered at it, thereby combining the spatial and polarimetric information within the image. The inherent spatial information is beneficial to alleviate the influence of speckle noise and improve the stability of the extracted features. In addition, the label information of training samples is utilized in feature extraction, therefore the discriminability of different classes can be well preserved. The tensor discriminative locality alignment (TDLA) method is applied to find the multilinear transformation from the original feature space to the low-dimensional feature space. Based on the extracted features in the low-dimensional space, the SVM classifier is applied to achieve the final classification result. A real PolSAR data set acquired over San Francisco is adopted for performance evaluation. The experimental results show that the proposed method can not only improve the classification accuracy, but also alleviate the influence of speckle noise. In addition, the spatial details can be well preserved, demonstrating the superior performance of the proposed method.

scholarly journals Semantic Segmentation of HeLa Cells: An Objective Comparison between one Traditional Algorithm and Three Deep-Learning Architectures

2020 ◽  
Author(s):  
Cefa Karabağ ◽  
Martin L. Jones ◽  
Christopher J. Peddie ◽  
Anne E. Weston ◽  
Lucy M. Collinson ◽  
...  
Keyword(s):  
Image Processing ◽  
Deep Learning ◽  
Ground Truth ◽  
Semantic Segmentation ◽  
Superior Performance ◽  
Processing Algorithm ◽  
Image Processing Algorithm ◽  
Segmentation Accuracy ◽  
Traditional Algorithm ◽  
Learning Architectures

AbstractIn this work, images of a HeLa cancer cell were semantically segmented with one traditional image-processing algorithm and three deep learning architectures: VGG16, ResNet18 and Inception-ResNet-v2. Three hundred slices, each 2000 × 2000 pixels, of a HeLa Cell were acquired with Serial Block Face Scanning Electron Microscopy. The deep learning architectures were pre-trained with ImageNet and then fine-tuned with transfer learning. The image-processing algorithm followed a pipeline of several traditional steps like edge detection, dilation and morphological operators. The algorithms were compared by measuring pixel-based segmentation accuracy and Jaccard index against a labelled ground truth. The results indicated a superior performance of the traditional algorithm (Accuracy = 99%, Jaccard = 93%) over the deep learning architectures: VGG16 (93%, 90%), ResNet18 (94%, 88%), Inception-ResNet-v2 (94%, 89%).

scholarly journals Multi-Supervised Encoder-Decoder for Image Forgery Localization

Electronics ◽  
2021 ◽  
Vol 10 (18) ◽  
pp. 2255
Author(s):  
Chunfang Yu ◽  
Jizhe Zhou ◽  
Qin Li
Keyword(s):  
Spatial Information ◽  
State Of The Art ◽  
Contextual Information ◽  
Semantic Segmentation ◽  
Cross Entropy ◽  
Image Manipulation ◽  
Training Process ◽  
Multi Scale ◽  
Challenging Tasks ◽  
Detection And Localization

Image manipulation localization is one of the most challenging tasks because it pays more attention to tampering artifacts than to image content, which suggests that richer features need to be learned. Unlike many existing solutions, we employ a semantic segmentation network, named Multi-Supervised Encoder–Decoder (MSED), for the detection and localization of forgery images with arbitrary sizes and multiple types of manipulations without extra pre-training. In the basic encoder–decoder framework, the former encodes multi-scale contextual information by atrous convolution at multiple rates, while the latter captures sharper object boundaries by applying upsampling to gradually recover the spatial information. The additional multi-supervised module is designed to guide the training process by multiply adopting pixel-wise Binary Cross-Entropy (BCE) loss after the encoder and each upsampling. Experiments on four standard image manipulation datasets demonstrate that our MSED network achieves state-of-the-art performance compared to alternative baselines.

Protein Structural Class Prediction Based on Distance-related Statistical Features from Graphical Representation of Predicted Secondary Structure

2019 ◽  
Vol 16 (4) ◽  
pp. 317-324
Author(s):  
Liang Kong ◽  
Lichao Zhang ◽  
Xiaodong Han ◽  
Jinfeng Lv
Keyword(s):  
Feature Extraction ◽  
Secondary Structure ◽  
Protein Sequence ◽  
Function Analysis ◽  
Superior Performance ◽  
Support Vector ◽  
Chaos Game Representation ◽  
Class Prediction ◽  
Structural Class ◽  
Protein Structural Class

Protein structural class prediction is beneficial to protein structure and function analysis. Exploring good feature representation is a key step for this prediction task. Prior works have demonstrated the effectiveness of the secondary structure based feature extraction methods especially for lowsimilarity protein sequences. However, the prediction accuracies still remain limited. To explore the potential of secondary structure information, a novel feature extraction method based on a generalized chaos game representation of predicted secondary structure is proposed. Each protein sequence is converted into a 20-dimensional distance-related statistical feature vector to characterize the distribution of secondary structure elements and segments. The feature vectors are then fed into a support vector machine classifier to predict the protein structural class. Our experiments on three widely used lowsimilarity benchmark datasets (25PDB, 1189 and 640) show that the proposed method achieves superior performance to the state-of-the-art methods. It is anticipated that our method could be extended to other graphical representations of protein sequence and be helpful in future protein research.

Sign in / Sign up

Export Citation Format

Share Document