Multi-scale visual attention for attribute disambiguation in zero-shot learning

Author(s):  
Long Tian ◽  
Bo Chen ◽  
Jie Ren ◽  
Hao Zhang ◽  
Zhenhua Wu ◽  
...  
Keyword(s):  
2017 ◽  
Vol 25 (9) ◽  
pp. 2461-2468
Author(s):  
丁 鹏 DING Peng ◽  
张 叶 ZHANG Ye ◽  
贾 平 JIA Ping ◽  
常旭岭 CHANG Xu-ling

2018 ◽  
Vol 30 (2) ◽  
pp. 210-221 ◽  
Author(s):  
Shengqi Guan ◽  
Wensen Li ◽  
Jie Wang ◽  
Ming Lei

Purpose The purpose of this paper is to develop a new objective evaluation method of fabric pilling using data-driven visual attention model. Design/methodology/approach First, the multi-scale filtering images are formed by Gaussian pyramid decomposition. Second, center-surround differences algorithm is used between multi-scale filtering images to build saliency map. On this basis, the pilling information is segmented from saliency map by the segmentation threshold. Finally, the pilling is objectively evaluated by extracting pilling feature. Experimental result shows that compared with the traditional detection methods, the proposed objective evaluation method has strong anti-interference ability, and correct classification rate (CCR) is 96 percent. Findings Fabric pilling saliency can be effectively improved by data-driven visual attention model, which will lead to stronger anti-interference ability and higher correct classification rate. Originality/value To void uneven illumination, noise, and texture interference, the proposed method can enhance the saliency of small targets in saliency map using a bottom-up visual attention model. Through the threshold segmentation according to pilling feature, the pilling information is effectively from the fabric texture. Pilling feature about pilling area density is extracted to pilling grade evaluation.


Author(s):  
Ping Jiang ◽  
Tao Gao

In this paper, an improved paper defects detection method based on visual attention mechanism computation model is presented. First, multi-scale feature maps are extracted by linear filtering. Second, the comparative maps are obtained by carrying out center-surround difference operator. Third, the saliency map is obtained by combining conspicuity maps, which is gained by combining the multi-scale comparative maps. Last, the seed point of watershed segmentation is determined by competition among salient points in the saliency map and the defect regions are segmented from the background. Experimental results show the efficiency of the approach for paper defects detection.


Author(s):  
Ping Jiang ◽  
Tao Gao

In this paper, an improved paper defects detection method based on visual attention mechanism computation model is presented. First, multi-scale feature maps are extracted by linear filtering. Second, the comparative maps are obtained by carrying out center-surround difference operator. Third, the saliency map is obtained by combining conspicuity maps, which is gained by combining the multi-scale comparative maps. Last, the seed point of watershed segmentation is determined by competition among salient points in the saliency map and the defect regions are segmented from the background. Experimental results show the efficiency of the approach for paper defects detection.


2021 ◽  
Vol 7 ◽  
pp. e639
Author(s):  
Chunlei Li ◽  
Huanyu Li ◽  
Zhoufeng Liu ◽  
Bicao Li ◽  
Yun Huang

Seed purity directly affects the quality of seed breeding and subsequent processing products. Seed sorting based on machine vision provides an effective solution to this problem. The deep learning technology, particularly convolutional neural networks (CNNs), have exhibited impressive performance in image recognition and classification, and have been proven applicable in seed sorting. However the huge computational complexity and massive storage requirements make it a great challenge to deploy them in real-time applications, especially on devices with limited resources. In this study, a rapid and highly efficient lightweight CNN based on visual attention, namely SeedSortNet, is proposed for seed sorting. First, a dual-branch lightweight feature extraction module Shield-block is elaborately designed by performing identity mapping, spatial transformation at higher dimensions and different receptive field modeling, and thus it can alleviate information loss and effectively characterize the multi-scale feature while utilizing fewer parameters and lower computational complexity. In the down-sampling layer, the traditional MaxPool is replaced as MaxBlurPool to improve the shift-invariant of the network. Also, an extremely lightweight sub-feature space attention module (SFSAM) is presented to selectively emphasize fine-grained features and suppress the interference of complex backgrounds. Experimental results show that SeedSortNet achieves the accuracy rates of 97.33% and 99.56% on the maize seed dataset and sunflower seed dataset, respectively, and outperforms the mainstream lightweight networks (MobileNetv2, ShuffleNetv2, etc.) at similar computational costs, with only 0.400M parameters (vs. 4.06M, 5.40M).


Sign in / Sign up

Export Citation Format

Share Document