scholarly journals Salient Object Detection with Semantic Priors

2017 ◽  
Author(s):  
Tam V. Nguyen ◽  
Luoqi Liu
Keyword(s):  
Object Detection ◽  
State Of The Art ◽  
Semantic Segmentation ◽  
Saliency Map ◽  
Salient Object Detection ◽  
Salient Object ◽  
Artificial Intelligence Research ◽  
Semantic Map ◽  
Regional Features ◽  
Computational Sciences

Salient object detection has increasingly become a popular topic in cognitive and computational sciences, including computer vision and artificial intelligence research. In this paper, we propose integrating semantic priors into the salient object detection process. Our algorithm consists of three basic steps. Firstly, the explicit saliency map is obtained based on the semantic segmentation refined by the explicit saliency priors learned from the data. Next, the implicit saliency map is computed based on a trained model which maps the implicit saliency priors embedded into regional features with the saliency values. Finally, the explicit semantic map and the implicit map are adaptively fused to form a pixel-accurate saliency map which uniformly covers the objects of interest. We further evaluate the proposed framework on two challenging datasets, namely, ECSSD and HKUIS. The extensive experimental results demonstrate that our method outperforms other state-of-the-art methods.

scholarly journals Revise-Net: Exploiting Reverse Attention Mechanism for Salient Object Detection

2021 ◽  
Vol 13 (23) ◽  
pp. 4941
Author(s):  
Rukhshanda Hussain ◽  
Yash Karbhari ◽  
Muhammad Fazal Ijaz ◽  
Marcin Woźniak ◽  
Pawan Kumar Singh ◽  
...  
Keyword(s):  
Object Detection ◽  
State Of The Art ◽  
Similarity Index ◽  
Saliency Map ◽  
Salient Object Detection ◽  
Semantic Features ◽  
Salient Object ◽  
Fully Convolutional Neural Networks ◽  
Boundary Estimation ◽  
Prediction Module

Recently, deep learning-based methods, especially utilizing fully convolutional neural networks, have shown extraordinary performance in salient object detection. Despite its success, the clean boundary detection of the saliency objects is still a challenging task. Most of the contemporary methods focus on exclusive edge detection modules in order to avoid noisy boundaries. In this work, we propose leveraging on the extraction of finer semantic features from multiple encoding layers and attentively re-utilize it in the generation of the final segmentation result. The proposed Revise-Net model is divided into three parts: (a) the prediction module, (b) a residual enhancement module, and (c) reverse attention modules. Firstly, we generate the coarse saliency map through the prediction modules, which are fine-tuned in the enhancement module. Finally, multiple reverse attention modules at varying scales are cascaded between the two networks to guide the prediction module by employing the intermediate segmentation maps generated at each downsampling level of the REM. Our method efficiently classifies the boundary pixels using a combination of binary cross-entropy, similarity index, and intersection over union losses at the pixel, patch, and map levels, thereby effectively segmenting the saliency objects in an image. In comparison with several state-of-the-art frameworks, our proposed Revise-Net model outperforms them with a significant margin on three publicly available datasets, DUTS-TE, ECSSD, and HKU-IS, both on regional and boundary estimation measures.

scholarly journals Global Context-Aware Progressive Aggregation Network for Salient Object Detection

2020 ◽  
Vol 34 (07) ◽  
pp. 10599-10606 ◽  
Author(s):  
Zuyao Chen ◽  
Qianqian Xu ◽  
Runmin Cong ◽  
Qingming Huang
Keyword(s):  
Object Detection ◽  
Critical Role ◽  
Saliency Map ◽  
Salient Object Detection ◽  
Semantic Features ◽  
Context Aware ◽  
Salient Object ◽  
Deep Convolutional Neural Networks ◽  
Global Context ◽  
High Level

Deep convolutional neural networks have achieved competitive performance in salient object detection, in which how to learn effective and comprehensive features plays a critical role. Most of the previous works mainly adopted multiple-level feature integration yet ignored the gap between different features. Besides, there also exists a dilution process of high-level features as they passed on the top-down pathway. To remedy these issues, we propose a novel network named GCPANet to effectively integrate low-level appearance features, high-level semantic features, and global context features through some progressive context-aware Feature Interweaved Aggregation (FIA) modules and generate the saliency map in a supervised way. Moreover, a Head Attention (HA) module is used to reduce information redundancy and enhance the top layers features by leveraging the spatial and channel-wise attention, and the Self Refinement (SR) module is utilized to further refine and heighten the input features. Furthermore, we design the Global Context Flow (GCF) module to generate the global context information at different stages, which aims to learn the relationship among different salient regions and alleviate the dilution effect of high-level features. Experimental results on six benchmark datasets demonstrate that the proposed approach outperforms the state-of-the-art methods both quantitatively and qualitatively.

scholarly journals Salient Object Detection Based on Background Feature Clustering

2017 ◽  
Vol 2017 ◽  
pp. 1-9 ◽  
Author(s):  
Kan Huang ◽  
Yong Zhang ◽  
Bo Lv ◽  
Yongbiao Shi
Keyword(s):  
Object Detection ◽  
Clustering Algorithm ◽  
Geodesic Distance ◽  
Saliency Map ◽  
Salient Object Detection ◽  
Salient Object ◽  
Edge Preserving ◽  
Feature Clustering ◽  
Background Distribution ◽  
Extensive Evaluation

Automatic estimation of salient object without any prior knowledge tends to greatly enhance many computer vision tasks. This paper proposes a novel bottom-up based framework for salient object detection by first modeling background and then separating salient objects from background. We model the background distribution based on feature clustering algorithm, which allows for fully exploiting statistical and structural information of the background. Then a coarse saliency map is generated according to the background distribution. To be more discriminative, the coarse saliency map is enhanced by a two-step refinement which is composed of edge-preserving element-level filtering and upsampling based on geodesic distance. We provide an extensive evaluation and show that our proposed method performs favorably against other outstanding methods on two most commonly used datasets. Most importantly, the proposed approach is demonstrated to be more effective in highlighting the salient object uniformly and robust to background noise.

scholarly journals Hybrid Local and Global Deep-Learning Architecture for Salient-Object Detection

2020 ◽  
Vol 10 (23) ◽  
pp. 8754
Author(s):  
Wajeeha Sultan ◽  
Nadeem Anjum ◽  
Mark Stansfield ◽  
Naeem Ramzan
Keyword(s):  
Deep Learning ◽  
Object Detection ◽  
State Of The Art ◽  
Salient Object Detection ◽  
Salient Object ◽  
Global Level ◽  
Low Contrast ◽  
Qualitative And Quantitative ◽  
Exact Boundary ◽  
Quantitative Analyses

Salient-object detection is a fundamental and the most challenging problem in computer vision. This paper focuses on the detection of salient objects, especially in low-contrast images. To this end, a hybrid deep-learning architecture is proposed where features are extracted on both the local and global level. These features are then integrated to extract the exact boundary of the object of interest in an image. Experimentation was performed on five standard datasets, and results were compared with state-of-the-art approaches. Both qualitative and quantitative analyses showed the robustness of the proposed architecture.

scholarly journals Progressive Feature Polishing Network for Salient Object Detection

2020 ◽  
Vol 34 (07) ◽  
pp. 12128-12135 ◽  
Author(s):  
Bo Wang ◽  
Quan Chen ◽  
Min Zhou ◽  
Zhiqiang Zhang ◽  
Xiaogang Jin ◽  
...  
Keyword(s):  
Object Detection ◽  
State Of The Art ◽  
Hierarchical Structures ◽  
Salient Object Detection ◽  
Salient Object ◽  
Post Processing ◽  
Feature Maps ◽  
Multiple Feature ◽  
Benchmark Datasets ◽  
Multi Level

Feature matters for salient object detection. Existing methods mainly focus on designing a sophisticated structure to incorporate multi-level features and filter out cluttered features. We present Progressive Feature Polishing Network (PFPN), a simple yet effective framework to progressively polish the multi-level features to be more accurate and representative. By employing multiple Feature Polishing Modules (FPMs) in a recurrent manner, our approach is able to detect salient objects with fine details without any post-processing. A FPM parallelly updates the features of each level by directly incorporating all higher level context information. Moreover, it can keep the dimensions and hierarchical structures of the feature maps, which makes it flexible to be integrated with any CNN-based models. Empirical experiments show that our results are monotonically getting better with increasing number of FPMs. Without bells and whistles, PFPN outperforms the state-of-the-art methods significantly on five benchmark datasets under various evaluation metrics. Our code is available at: https://github.com/chenquan-cq/PFPN.

scholarly journals Salient Object Detection Combining a Self-Attention Module and a Feature Pyramid Network

Electronics ◽  
2020 ◽  
Vol 9 (10) ◽  
pp. 1702
Author(s):  
Guangyu Ren ◽  
Tianhong Dai ◽  
Panagiotis Barmpoutis ◽  
Tania Stathaki
Keyword(s):  
Object Detection ◽  
Receptive Fields ◽  
Semantic Segmentation ◽  
Salient Object Detection ◽  
Object Localization ◽  
Salient Object ◽  
Convolutional Networks ◽  
Multi Scale ◽  
Fully Convolutional Networks ◽  
High Level

Salient object detection has achieved great improvements by using the Fully Convolutional Networks (FCNs). However, the FCN-based U-shape architecture may cause dilution problems in the high-level semantic information during the up-sample operations in the top-down pathway. Thus, it can weaken the ability of salient object localization and produce degraded boundaries. To this end, in order to overcome this limitation, we propose a novel pyramid self-attention module (PSAM) and the adoption of an independent feature-complementing strategy. In PSAM, self-attention layers are equipped after multi-scale pyramid features to capture richer high-level features and bring larger receptive fields to the model. In addition, a channel-wise attention module is also employed to reduce the redundant features of the FPN and provide refined results. Experimental analysis demonstrates that the proposed PSAM effectively contributes to the whole model so that it outperforms state-of-the-art results over five challenging datasets. Finally, quantitative results show that PSAM generates accurate predictions and integral salient maps, which can provide further help to other computer vision tasks, such as object detection and semantic segmentation.

scholarly journals Multiscale Deep Network with Centerness-Aware Loss for Salient Object Detection

2022 ◽  
Vol 2022 ◽  
pp. 1-14
Author(s):  
Liangliang Duan
Keyword(s):  
Object Detection ◽  
Network Architecture ◽  
State Of The Art ◽  
Saliency Detection ◽  
Salient Object Detection ◽  
Cross Entropy ◽  
Salient Object ◽  
Prediction Module ◽  
Saliency Prediction ◽  
Salient Regions

Deep encoder-decoder networks have been adopted for saliency detection and achieved state-of-the-art performance. However, most existing saliency models usually fail to detect very small salient objects. In this paper, we propose a multitask architecture, M2Net, and a novel centerness-aware loss for salient object detection. The proposed M2Net aims to solve saliency prediction and centerness prediction simultaneously. Specifically, the network architecture is composed of a bottom-up encoder module, top-down decoder module, and centerness prediction module. In addition, different from binary cross entropy, the proposed centerness-aware loss can guide the proposed M2Net to uniformly highlight the entire salient regions with well-defined object boundaries. Experimental results on five benchmark saliency datasets demonstrate that M2Net outperforms state-of-the-art methods on different evaluation metrics.

scholarly journals Saliency Detection in Weak Light Images via Optimal Feature Selection-Guided Seed Propagation

2021 ◽  
Vol 2021 ◽  
pp. 1-17
Author(s):  
Nan Mu ◽  
Hongyu Wang ◽  
Yu Zhang ◽  
Hongyu Han ◽  
Jun Yang
Keyword(s):  
Feature Selection ◽  
Object Detection ◽  
Saliency Map ◽  
Salient Object Detection ◽  
Propagation Model ◽  
Salient Object ◽  
Optimal Feature Selection ◽  
Weak Light ◽  
Seed Propagation ◽  
Optimal Feature

Salient object detection has a wide range of applications in computer vision tasks. Although tremendous progress has been made in recent decades, the weak light image still poses formidable challenges to current saliency models due to its low illumination and low signal-to-noise ratio properties. Traditional hand-crafted features inevitably encounter great difficulties in handling images with weak light backgrounds, while most of the high-level features are unfavorable to highlight visually salient objects in weak light images. In allusion to these problems, an optimal feature selection-guided saliency seed propagation model is proposed for salient object detection in weak light images. The main idea of this paper is to hierarchically refine the saliency map by learning the optimal saliency seeds in weak light images recursively. Particularly, multiscale superpixel segmentation and entropy-based optimal feature selection are first introduced to suppress the background interference. The initial saliency map is then obtained by the calculation of global contrast and spatial relationship. Moreover, local fitness and global fitness are used to optimize the prediction saliency map. Extensive experiments on six datasets show that our saliency model outperforms 20 state-of-the-art models in terms of popular evaluation criteria.

Sign in / Sign up

Export Citation Format

Share Document