Discrepant Multiple Instance Learning for Weakly Supervised Object Detection

2021 ◽  
pp. 108233
Author(s):  
Wei Gao ◽  
Fang Wan ◽  
Jun Yue ◽  
Songcen Xu ◽  
Qixiang Ye
Author(s):  
Wanqing Zhao ◽  
Ziyu Guan ◽  
Hangzai Luo ◽  
Jinye Peng ◽  
Jianping Fan

Multi-keyword query is widely supported in text search engines. However, an analogue in image retrieval systems, multi-object query, is rarely studied. Meanwhile, traditional object-based image retrieval methods often involve multiple steps separately and need expensive location labeling for detecting objects. In this work, we propose a weakly-supervised Deep Multiple Instance Hashing (DMIH) framework for object-based image retrieval. DMIH integrates object detection and hashing learning on the basis of a popular CNN model to build the end-to-end relation between a raw image and the binary hashing codes of multiple objects in it. Specifically, we cast the object detection of each object class as a binary multiple instance learning problem where instances are object proposals extracted from multi-scale convolutional feature maps. For hashing training, we sample image pairs to learn their semantic relationships in terms of hash codes of the most probable proposals for owned labels as guided by object predictors. The two objectives benefit each other in learning. DMIH outperforms state-of-the-arts on public benchmarks for object-based image retrieval and achieves promising results for multi-object queries.


2020 ◽  
Vol 34 (07) ◽  
pp. 11482-11489
Author(s):  
Chenhao Lin ◽  
Siwen Wang ◽  
Dongqi Xu ◽  
Yu Lu ◽  
Wayne Zhang

Weakly supervised object detection (WSOD) using only image-level annotations has attracted growing attention over the past few years. Existing approaches using multiple instance learning easily fall into local optima, because such mechanism tends to learn from the most discriminative object in an image for each category. Therefore, these methods suffer from missing object instances which degrade the performance of WSOD. To address this problem, this paper introduces an end-to-end object instance mining (OIM) framework for weakly supervised object detection. OIM attempts to detect all possible object instances existing in each image by introducing information propagation on the spatial and appearance graphs, without any additional annotations. During the iterative learning process, the less discriminative object instances from the same class can be gradually detected and utilized for training. In addition, we design an object instance reweighted loss to learn larger portion of each object instance to further improve the performance. The experimental results on two publicly available databases, VOC 2007 and 2012, demonstrate the efficacy of proposed approach.


Author(s):  
Ruyi Ji ◽  
Zeyu Liu ◽  
Libo Zhang ◽  
Jianwei Liu ◽  
Xin Zuo ◽  
...  

Weakly supervised object detection (WSOD), aiming to detect objects with only image-level annotations, has become one of the research hotspots over the past few years. Recently, much effort has been devoted to WSOD for the simple yet effective architecture and remarkable improvements have been achieved. Existing approaches using multiple-instance learning usually pay more attention to the proposals individually, ignoring relation information between proposals. Besides, to obtain pseudo-ground-truth boxes for WSOD, MIL-based methods tend to select the region with the highest confidence score and regard those with small overlap as background category, which leads to mislabeled instances. As a result, these methods suffer from mislabeling instances and lacking relations between proposals, degrading the performance of WSOD. To tackle these issues, this article introduces a multi-peak graph-based model for WSOD. Specifically, we use the instance graph to model the relations between proposals, which reinforces multiple-instance learning process. In addition, a multi-peak discovery strategy is designed to avert mislabeling instances. The proposed model is trained by stochastic gradients decent optimizer using back-propagation in an end-to-end manner. Extensive quantitative and qualitative evaluations on two publicly challenging benchmarks, PASCAL VOC 2007 and PASCAL VOC 2012, demonstrate the superiority and effectiveness of the proposed approach.


2021 ◽  
Author(s):  
Danpei Zhao ◽  
Zhichao Yuan ◽  
Zhenwei Shi ◽  
Fengying Xie

Author(s):  
Jeany Son ◽  
Daniel Kim ◽  
Solae Lee ◽  
Suha Kwak ◽  
Minsu Cho ◽  
...  

2021 ◽  
pp. 104314
Author(s):  
Ze Chen ◽  
Zhihang Fu ◽  
Jianqiang Huang ◽  
Mingyuan Tao ◽  
Rongxin Jiang ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document