Mining High-Level User Concepts with Multiple Instance Learning and Relevance Feedback for Content-Based Image Retrieval

Author(s):  
Xin Huang ◽  
Shu-Ching Chen ◽  
Mei-Ling Shyu ◽  
Chengcui Zhang
2021 ◽  
Author(s):  
Kambiz Jarrah

The overall objective of this thesis is to present a methodology for guiding adaptations of an RBF-based relevance feedback network, embedded in automatic content-based image retrieval (CBIR) systems, through the principle of unsupervised hierarchical clustering. The main focus of this thesis is two-fold: introducing a new member of Self-Organizing Tree Map (SOTM) family, the Directed self-organizing tree map (DSOTM) that not only provides a partial supervision on cluster generation by forcing divisions away from the query class, but also presents an objective verdict on resemblance of the input pattern as its tree structure grows; and using a base-10 Genetic Algorithm (GA) approach to accurately determine the contribution of individual feature vectors for a successful retrieval in a so-called "feature weight detection process." The DSOTM is quite attractive in CBIR since it aims to reduce both user workload and subjectivity. Repetitive user interaction steps are replaced by a DSOTM module, which adaptively guides relevance feedback, to bridge the gap between low-level image descriptors and high-level semantics. To further reduce this gap and achieve an enhanced performance for the automatic CBIR system under study, a GA-based approach was proposed in conjunction with the DSOTM. The resulting framework is referred to as GA-based CBIR (GA-CBIR) and aims to import human subjectivity by automatically adjusting the search process to what the system evolves "to believe" is significant content within the query. In this engine, traditional GA operators work closely with the DSOTM to better attune the apparent discriminative characteristics observed in an image by a human user.


2013 ◽  
Vol 448-453 ◽  
pp. 3616-3620
Author(s):  
Yu Bing Dong ◽  
Ming Jing Li ◽  
Bai Chuan Li

Content-Based Image Retrieval (CBIR) system existed a gap between high-level concepts and low-level features. As an effective solution, the Relevance Feedback (RF) technique has been used on many CBIR systems to improve the retrieval precision. In order to further improve convergence speed and retrieval accuracy, a novel relevance feedback method was proposed. According to feedback from user, image feature was weighted and adjusted in the novel method.


Author(s):  
Giang Truong Ngo ◽  
Tao Quoc Ngo ◽  
Dung Duc Nguyen

<pre>In content-based image retrieval, relevant feedback is studied extensively <br />to narrow the gap between low-level image feature and high-level semantic <br />concept. In general, relevance feedback aims to improve the retrieval <br />performance by learning with user's <span>judgements</span> on the retrieval results. <br />Despite widespread interest, but feedback related technologies are often <br />faced with a few limitations. One of the most obvious limitations is often <br />requiring the user to repeat a number of steps before obtaining the <br />improved search results. This makes the process inefficient and tedious <br />search for the online applications. In this paper, a effective feedback <br />related scheme for content-based image retrieval is proposed. First, a <br />decision boundary is learned via Support Vector Machine to filter the <br />images in the database. Then, a ranking function for selecting the most <br />informative samples will be calculated by defining a novel criterion that <br />considers both the scores of Support Vector Machine function and similarity<br />metric between the "ideal query" and the images in the database. The <br />experimental results on standard <span>datasets</span> have showed the effectiveness <br />of the proposed method.</pre>


Author(s):  
Giang Truong Ngo ◽  
Tao Quoc Ngo ◽  
Dung Duc Nguyen

<pre>In content-based image retrieval, relevant feedback is studied extensively <br />to narrow the gap between low-level image feature and high-level semantic <br />concept. In general, relevance feedback aims to improve the retrieval <br />performance by learning with user's <span>judgements</span> on the retrieval results. <br />Despite widespread interest, but feedback related technologies are often <br />faced with a few limitations. One of the most obvious limitations is often <br />requiring the user to repeat a number of steps before obtaining the <br />improved search results. This makes the process inefficient and tedious <br />search for the online applications. In this paper, a effective feedback <br />related scheme for content-based image retrieval is proposed. First, a <br />decision boundary is learned via Support Vector Machine to filter the <br />images in the database. Then, a ranking function for selecting the most <br />informative samples will be calculated by defining a novel criterion that <br />considers both the scores of Support Vector Machine function and similarity<br />metric between the "ideal query" and the images in the database. The <br />experimental results on standard <span>datasets</span> have showed the effectiveness <br />of the proposed method.</pre>


2021 ◽  
Author(s):  
Kambiz Jarrah

The overall objective of this thesis is to present a methodology for guiding adaptations of an RBF-based relevance feedback network, embedded in automatic content-based image retrieval (CBIR) systems, through the principle of unsupervised hierarchical clustering. The main focus of this thesis is two-fold: introducing a new member of Self-Organizing Tree Map (SOTM) family, the Directed self-organizing tree map (DSOTM) that not only provides a partial supervision on cluster generation by forcing divisions away from the query class, but also presents an objective verdict on resemblance of the input pattern as its tree structure grows; and using a base-10 Genetic Algorithm (GA) approach to accurately determine the contribution of individual feature vectors for a successful retrieval in a so-called "feature weight detection process." The DSOTM is quite attractive in CBIR since it aims to reduce both user workload and subjectivity. Repetitive user interaction steps are replaced by a DSOTM module, which adaptively guides relevance feedback, to bridge the gap between low-level image descriptors and high-level semantics. To further reduce this gap and achieve an enhanced performance for the automatic CBIR system under study, a GA-based approach was proposed in conjunction with the DSOTM. The resulting framework is referred to as GA-based CBIR (GA-CBIR) and aims to import human subjectivity by automatically adjusting the search process to what the system evolves "to believe" is significant content within the query. In this engine, traditional GA operators work closely with the DSOTM to better attune the apparent discriminative characteristics observed in an image by a human user.


2018 ◽  
Vol 7 (3.6) ◽  
pp. 175 ◽  
Author(s):  
R I. Heaven Rose ◽  
A C. Subajini

Content Based Image Retrieval (CBIR) for medical imageries is still in its early stage.  There are many challenging research issues.  Retrieve similar images only is the current problem in medical CBIR. One idea to solve this difficult is minimizing the gap among two descriptions i.e. low level extracted features of image and high level human perception of image.  There are various Relevance Feedback (WF) methods have been considered to minimize the semantic gap in medical CBIR system. But most of them were deals with hard Feedback. In Hard Feedback system user can interact with the system in one query session. We recommend to aid the usage of lenient relevance response to better capture the intention of users. The meta-knowledge mined from multiple user’s experience be able to   increase the precision of subsequent image recovery results. Here we suggest an algorithm to mine lenient association rules from the group of suggestion i.e. image weight value given by the user. To reduce the amount of strong rules we offer two rule lessening techniques related to redundancy detection and confidence quantization.  Best first search and Binary search methods are similarly applied to advance the procedure of weight interface. The effectiveness of the offered system is assessed regarding precision and average retrieval time. The experimental results on medical images display that the proposed method is able to improve the accuracy of medical CBIR system and reduces the retrieval time than other usual methods.  


Sign in / Sign up

Export Citation Format

Share Document