scholarly journals On Combining DeepSnake and Global Saliency for Detection of Orchard Apples

2021 ◽  
Vol 11 (14) ◽  
pp. 6269
Author(s):  
Wang Jing ◽  
Wang Leqi ◽  
Han Yanling ◽  
Zhang Yun ◽  
Zhou Ruyan
Keyword(s):  
Saliency Detection ◽  
Color Difference ◽  
Saliency Map ◽  
Apple Fruit ◽  
Initial Contour ◽  
Detection Accuracy ◽  
Natural Environments ◽  
Fast Detection ◽  
Single Target ◽  
Training Samples

For the fast detection and recognition of apple fruit targets, based on the real-time DeepSnake deep learning instance segmentation model, this paper provided an algorithm basis for the practical application and promotion of apple picking robots. Since the initial detection results have an important impact on the subsequent edge prediction, this paper proposed an automatic detection method for apple fruit targets in natural environments based on saliency detection and traditional color difference methods. Combined with the original image, the histogram backprojection algorithm was used to further optimize the salient image results. A dynamic adaptive overlapping target separation algorithm was proposed to locate the single target fruit and further to determine the initial contour for DeepSnake, in view of the possible overlapping fruit regions in the saliency map. Finally, the target fruit was labeled based on the segmentation results of the examples. In the experiment, 300 training datasets were used to train the DeepSnake model, and the self-built dataset containing 1036 pictures of apples in various situations under natural environment was tested. The detection accuracy of target fruits under non-overlapping shaded fruits, overlapping fruits, shaded branches and leaves, and poor illumination conditions were 99.12%, 94.78%, 90.71%, and 94.46% respectively. The comprehensive detection accuracy was 95.66%, and the average processing time was 0.42 s in 1036 test images, which showed that the proposed algorithm can effectively separate the overlapping fruits through a not-very-large training samples and realize the rapid and accurate detection of apple targets.

scholarly journals Motion Saliency Detection for Surveillance Systems Using Streaming Dynamic Mode Decomposition

Symmetry ◽  
2020 ◽  
Vol 12 (9) ◽  
pp. 1397
Author(s):  
Thien-Thu Ngo ◽  
VanDung Nguyen ◽  
Xuan-Qui Pham ◽  
Md-Alamgir Hossain ◽  
Eui-Nam Huh
Keyword(s):  
Saliency Detection ◽  
Saliency Map ◽  
Dynamic Mode Decomposition ◽  
Dynamic Mode ◽  
Detection Accuracy ◽  
Surveillance Systems ◽  
Reconstruction Process ◽  
Intelligent Surveillance ◽  
Mode Decomposition ◽  
Motion Saliency

Intelligent surveillance systems enable secured visibility features in the smart city era. One of the major models for pre-processing in intelligent surveillance systems is known as saliency detection, which provides facilities for multiple tasks such as object detection, object segmentation, video coding, image re-targeting, image-quality assessment, and image compression. Traditional models focus on improving detection accuracy at the cost of high complexity. However, these models are computationally expensive for real-world systems. To cope with this issue, we propose a fast-motion saliency method for surveillance systems under various background conditions. Our method is derived from streaming dynamic mode decomposition (s-DMD), which is a powerful tool in data science. First, DMD computes a set of modes in a streaming manner to derive spatial–temporal features, and a raw saliency map is generated from the sparse reconstruction process. Second, the final saliency map is refined using a difference-of-Gaussians filter in the frequency domain. The effectiveness of the proposed method is validated on a standard benchmark dataset. The experimental results show that the proposed method achieves competitive accuracy with lower complexity than state-of-the-art methods, which satisfies requirements in real-time applications.

Saliency Optimization and Integration Via Iterative Bootstrap Learning

2018 ◽  
Vol 32 (09) ◽  
pp. 1859016
Author(s):  
Liming Li ◽  
Xiaodong Chai ◽  
Shuguang Zhao ◽  
Shubin Zheng ◽  
Shengchao Su
Keyword(s):  
Multiple Scales ◽  
Saliency Detection ◽  
Saliency Map ◽  
Input Image ◽  
Training Data ◽  
Data Sets ◽  
Saliency Maps ◽  
Training Samples ◽  
Public Data

This paper proposes an effective method to elevate the performance of saliency detection via iterative bootstrap learning, which consists of two tasks including saliency optimization and saliency integration. Specifically, first, multiscale segmentation and feature extraction are performed on the input image successively. Second, prior saliency maps are generated using existing saliency models, which are used to generate the initial saliency map. Third, prior maps are fed into the saliency regressor together, where training samples are collected from the prior maps at multiple scales and the random forest regressor is learned from such training data. An integration of the initial saliency map and the output of saliency regressor is deployed to generate the coarse saliency map. Finally, in order to improve the quality of saliency map further, both initial and coarse saliency maps are fed into the saliency regressor together, and then the output of the saliency regressor, the initial saliency map as well as the coarse saliency map are integrated into the final saliency map. Experimental results on three public data sets demonstrate that the proposed method consistently achieves the best performance and significant improvement can be obtained when applying our method to existing saliency models.

Saliency Detection Based on Multi-Scale Superpixel and Dictionary Learning

2014 ◽  
Vol 701-702 ◽  
pp. 348-351
Author(s):  
Gang Hou ◽  
He Xin Yan ◽  
Fan Zhang ◽  
Hui Rong Hou ◽  
Ming Zhang
Keyword(s):  
Dictionary Learning ◽  
Saliency Detection ◽  
Visual Saliency ◽  
Scale Space ◽  
Detection Algorithm ◽  
Saliency Map ◽  
Reconstruction Error ◽  
Multi Scale ◽  
Training Samples ◽  
Scale Spaces

In recent years, saliency detection has been gaining increasing attention since it could significantly boost many content-based multimedia applications. In this paper, we propose a visual saliency detection algorithm based on multi-scale superpixel and dictionary learning . Firstly, in each scale space, we extract the boundaries as the training samples to learn a dictionary through sparse coding and dictionary learning methods. Then, according to reconstruction error of each superpixel, the saliency map is generated for each scale of superpixel. Finally, some saliency maps from different scale spaces are fused together to generate the final saliency map. The experimental results show that the proposed algorithm can highlight the salient regions uniformly and performs better compared with the other five methods.

Road Detection Based on Edge Feature with GAC Model in Aerial Image

2021 ◽  
Author(s):  
Linying Zhou ◽  
Zhou Zhou ◽  
Hang Ning
Keyword(s):  
Transformation Method ◽  
Aerial Images ◽  
Aerial Image ◽  
Initial Contour ◽  
Detection Accuracy ◽  
Road Detection ◽  
Canny Operator ◽  
The Road ◽  
Gradient Magnitude ◽  
Edge Feature

Road detection from aerial images still is a challenging task since it is heavily influenced by spectral reflectance, shadows and occlusions. In order to increase the road detection accuracy, a proposed method for road detection by GAC model with edge feature extraction and segmentation is studied in this paper. First, edge feature can be extracted using the proposed gradient magnitude with Canny operator. Then, a reconstructed gradient map is applied in watershed transformation method, which is segmented for the next initial contour. Last, with the combination of edge feature and initial contour, the boundary stopping function is applied in the GAC model. The road boundary result can be accomplished finally. Experimental results show, by comparing with other methods in [Formula: see text]-measure system, that the proposed method can achieve satisfying results.

A real time detection method for abnormal strapping of steel coil based on CCD active imaging

2021 ◽  
Author(s):  
Chuan Ye ◽  
Liming Zhao ◽  
Qiyan Wang ◽  
Bo Pan ◽  
Youchun Xie ◽  
...  
Keyword(s):  
Maximum Entropy ◽  
Detection Method ◽  
Saliency Detection ◽  
Automatic Segmentation ◽  
Engineering Application ◽  
Detection Accuracy ◽  
Steel Coil ◽  
Detection Model ◽  
Laser Stripe ◽  
Active Imaging

Abstract In order to accurately detect the abnormal looseness of strapping in the process of steel coil hoisting, an accurate detection method of strapping abnormality based on CCD structured light active imaging is proposed. Firstly, a maximum entropy laser stripe automatic segmentation model integrating multi-scale saliency features is constructed. With the help of saliency detection model, the purpose is to reduce the interference of the environment to the laser stripe and highlight the distinguishability between the stripe and the background. Then, the maximum entropy is used to segment the fused saliency features and accurately extract the stripe contour. Finally, the stripe normal field is obtained by calculating the stripe gradient vector, the stripe center line is extracted based on the stripe distribution normal direction, and the abnormal strapping is recognized online according to the stripe center. Experiments show that the proposed method is effective in terms of detection accuracy and time efficiency, and has certain engineering application value.

scholarly journals Ship Detection in Panchromatic Optical Remote Sensing Images Based on Visual Saliency and Multi-Dimensional Feature Description

2020 ◽  
Vol 12 (1) ◽  
pp. 152 ◽  
Author(s):  
Ting Nie ◽  
Xiyu Han ◽  
Bin He ◽  
Xiansheng Li ◽  
Hongxing Liu ◽  
...  
Keyword(s):  
Remote Sensing ◽  
Fourier Transform ◽  
Detection Method ◽  
Saliency Detection ◽  
Visual Saliency ◽  
Saliency Map ◽  
False Alarms ◽  
Optical Remote Sensing ◽  
Remote Sensing Images ◽  
Ship Detection

Ship detection in panchromatic optical remote sensing images is faced with two major challenges, locating candidate regions from complex backgrounds quickly and describing ships effectively to reduce false alarms. Here, a practical method was proposed to solve these issues. Firstly, we constructed a novel visual saliency detection method based on a hyper-complex Fourier transform of a quaternion to locate regions of interest (ROIs), which can improve the accuracy of the subsequent discrimination process for panchromatic images, compared with the phase spectrum quaternary Fourier transform (PQFT) method. In addition, the Gaussian filtering of different scales was performed on the transformed result to synthesize the best saliency map. An adaptive method based on GrabCut was then used for binary segmentation to extract candidate positions. With respect to the discrimination stage, a rotation-invariant modified local binary pattern (LBP) description was achieved by combining shape, texture, and moment invariant features to describe the ship targets more powerfully. Finally, the false alarms were eliminated through SVM training. The experimental results on panchromatic optical remote sensing images demonstrated that the presented saliency model under various indicators is superior, and the proposed ship detection method is accurate and fast with high robustness, based on detailed comparisons to existing efforts.

scholarly journals Saliency Detection by Multilevel Deep Pyramid Model

2018 ◽  
Vol 2018 ◽  
pp. 1-11 ◽  
Author(s):  
Hai Wang ◽  
Lei Dai ◽  
Yingfeng Cai ◽  
Long Chen ◽  
Yong Zhang
Keyword(s):  
Background Noise ◽  
State Of The Art ◽  
Saliency Detection ◽  
Saliency Map ◽  
Multiple Features ◽  
Low Level ◽  
Pyramid Model ◽  
High Level ◽  
Different Levels ◽  
Better Than

Traditional salient object detection models are divided into several classes based on low-level features and contrast between pixels. In this paper, we propose a model based on a multilevel deep pyramid (MLDP), which involves fusing multiple features on different levels. Firstly, the MLDP uses the original image as the input for a VGG16 model to extract high-level features and form an initial saliency map. Next, the MLDP further extracts high-level features to form a saliency map based on a deep pyramid. Then, the MLDP obtains the salient map fused with superpixels by extracting low-level features. After that, the MLDP applies background noise filtering to the saliency map fused with superpixels in order to filter out the interference of background noise and form a saliency map based on the foreground. Lastly, the MLDP combines the saliency map fused with the superpixels with the saliency map based on the foreground, which results in the final saliency map. The MLDP is not limited to low-level features while it fuses multiple features and achieves good results when extracting salient targets. As can be seen in our experiment section, the MLDP is better than the other 7 state-of-the-art models across three different public saliency datasets. Therefore, the MLDP has superiority and wide applicability in extraction of salient targets.

scholarly journals A Single Target Grasp Detection Network Based on Convolutional Neural Network

2021 ◽  
Vol 2021 ◽  
pp. 1-12
Author(s):  
Longzhi Zhang ◽  
Dongmei Wu
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Transfer Learning ◽  
High Accuracy ◽  
Experimental Results ◽  
Detection Accuracy ◽  
Single Object ◽  
Single Target ◽  
High Detection ◽  
Good Detection

Grasp detection based on convolutional neural network has gained some achievements. However, overfitting of multilayer convolutional neural network still exists and leads to poor detection precision. To acquire high detection accuracy, a single target grasp detection network that generalizes the fitting of angle and position, based on the convolution neural network, is put forward here. The proposed network regards the image as input and grasping parameters including angle and position as output, with the detection manner of end-to-end. Particularly, preprocessing dataset is to achieve the full coverage to input of model and transfer learning is to avoid overfitting of network. Importantly, a series of experimental results indicate that, for single object grasping, our network has good detection results and high accuracy, which proves that the proposed network has strong generalization in direction and category.

scholarly journals SALIENCY-GUIDED CHANGE DETECTION OF REMOTELY SENSED IMAGES USING RANDOM FOREST

2018 ◽  
Vol XLII-3 ◽  
pp. 341-348
Author(s):  
W. Feng ◽  
H. Sui ◽  
X. Chen
Keyword(s):  
Random Forest ◽  
Change Detection ◽  
Learning Algorithm ◽  
Saliency Detection ◽  
Principal Component ◽  
Visual Saliency ◽  
Saliency Map ◽  
Difference Image ◽  
Fcm Clustering ◽  
Optimal Segmentation

Studies based on object-based image analysis (OBIA) representing the paradigm shift in change detection (CD) have achieved remarkable progress in the last decade. Their aim has been developing more intelligent interpretation analysis methods in the future. The prediction effect and performance stability of random forest (RF), as a new kind of machine learning algorithm, are better than many single predictors and integrated forecasting method. In this paper, we present a novel CD approach for high-resolution remote sensing images, which incorporates visual saliency and RF. First, highly homogeneous and compact image super-pixels are generated using super-pixel segmentation, and the optimal segmentation result is obtained through image superimposition and principal component analysis (PCA). Second, saliency detection is used to guide the search of interest regions in the initial difference image obtained via the improved robust change vector analysis (RCVA) algorithm. The salient regions within the difference image that correspond to the binarized saliency map are extracted, and the regions are subject to the fuzzy <i>c</i>-means (FCM) clustering to obtain the pixel-level pre-classification result, which can be used as a prerequisite for superpixel-based analysis. Third, on the basis of the optimal segmentation and pixel-level pre-classification results, different super-pixel change possibilities are calculated. Furthermore, the changed and unchanged super-pixels that serve as the training samples are automatically selected. The spectral features and Gabor features of each super-pixel are extracted. Finally, superpixel-based CD is implemented by applying RF based on these samples. Experimental results on Ziyuan 3 (ZY3) multi-spectral images show that the proposed method outperforms the compared methods in the accuracy of CD, and also confirm the feasibility and effectiveness of the proposed approach.

scholarly journals A Deep Multiscale Fusion Method via Low-Rank Sparse Decomposition for Object Saliency Detection Based on Urban Data in Optical Remote Sensing Images

2020 ◽  
Vol 2020 ◽  
pp. 1-14
Author(s):  
Cheng Zhang ◽  
Dan He
Keyword(s):  
Neural Network ◽  
Remote Sensing ◽  
Saliency Detection ◽  
Saliency Map ◽  
Low Rank ◽  
Optical Remote Sensing ◽  
Fusion Method ◽  
Remote Sensing Images ◽  
Sparse Decomposition ◽  
Depth Feature

The urban data provides a wealth of information that can support the life and work for people. In this work, we research the object saliency detection in optical remote sensing images, which is conducive to the interpretation of urban scenes. Saliency detection selects the regions with important information in the remote sensing images, which severely imitates the human visual system. It plays a powerful role in other image processing. It has successfully made great achievements in change detection, object tracking, temperature reversal, and other tasks. The traditional method has some disadvantages such as poor robustness and high computational complexity. Therefore, this paper proposes a deep multiscale fusion method via low-rank sparse decomposition for object saliency detection in optical remote sensing images. First, we execute multiscale segmentation for remote sensing images. Then, we calculate the saliency value, and the proposal region is generated. The superpixel blocks of the remaining proposal regions of the segmentation map are input into the convolutional neural network. By extracting the depth feature, the saliency value is calculated and the proposal regions are updated. The feature transformation matrix is obtained based on the gradient descent method, and the high-level semantic prior knowledge is obtained by using the convolutional neural network. The process is iterated continuously to obtain the saliency map at each scale. The low-rank sparse decomposition of the transformed matrix is carried out by robust principal component analysis. Finally, the weight cellular automata method is utilized to fuse the multiscale saliency graphs and the saliency map calculated according to the sparse noise obtained by decomposition. Meanwhile, the object priors knowledge can filter most of the background information, reduce unnecessary depth feature extraction, and meaningfully improve the saliency detection rate. The experiment results show that the proposed method can effectively improve the detection effect compared to other deep learning methods.

Sign in / Sign up

Export Citation Format

Share Document