A Multi-Label Image Annotation With Multi-Level Tagging System

2018 ◽  
pp. 28-47
Author(s):  
Kalaivani Anbarasan ◽  
Chitrakala S.
Keyword(s):  
Image Retrieval ◽  
Retrieval System ◽  
Image Annotation ◽  
Image Features ◽  
Semantic Gap ◽  
Low Level ◽  
Image Retrieval System ◽  
Multi Level ◽  
High Level ◽  
Tagging System

The content based image retrieval system retrieves relevant images based on image features. The lack of performance in the content based image retrieval system is due to the semantic gap. Image annotation is a solution to bridge the semantic gap between low-level content features and high-level semantic concepts Image annotation is defined as tagging images with a single or multiple keywords based on low-level image features. The major issue in building an effective annotation framework is the integration of both low level visual features and high-level textual information into an annotation model. This chapter focus on new statistical-based image annotation model towards semantic based image retrieval system. A multi-label image annotation with multi-level tagging system is introduced to annotate image regions with class labels and extract color, location and topological tags of segmented image regions. The proposed method produced encouraging results and the experimental results outperformed state-of-the-art methods

Downsizing the Semantic Gap in Contextual Image Retrieval System Using Superintend Gross Silhouette Descriptor

2020 ◽  
Vol 8 (4) ◽  
pp. 1-20
Author(s):  
Girija G. Chiddarwar ◽  
S.Phani Kumar
Keyword(s):  
Image Retrieval ◽  
Correlation Coefficient ◽  
Retrieval System ◽  
Shape Descriptor ◽  
Query Image ◽  
Relationship Strength ◽  
Image Retrieval System ◽  
High Level ◽  
Straight Lines ◽  
The Relationship

Since shape is the most important feature for recognizing objects, it has to be extracted accurately in order to enhance the content based image retrieval system, but challenges prevailed in extracting shape features of an object in an image due to inability of shape descriptor which extracts a limited number of different shapes that are not invariant, alongside the inability to extracting features of overlapping objects, and the shape connotation gap problem between low level and high level features. In order to overcome these problems, this work proposes a Superintend Gross Silhouette Descriptor which uses pixel coordinates on spatial domain of the image for finding the real shape of the object by means of straight lines so it has the ability to detect the overlapped objects as well as the polygonal shapes. After being extracted, features would be trained using a random woodland classifier which classifies the features into a group of classes at maximum convergence for mitigating the shape connotation problem. At the time of retrieval, the features of the query image would be tested with trained features for measuring the similarity by the dynamite correlation coefficient method, which is a measure of the linear correlation so it would render the absolute value of the correlation coefficient which maintains the relationship strength among features.

scholarly journals Bag-of-Words Representation in Image Annotation: A Review

2012 ◽  
Vol 2012 ◽  
pp. 1-19 ◽  
Author(s):  
Chih-Fong Tsai
Keyword(s):  
Image Retrieval ◽  
Image Annotation ◽  
Classification Problem ◽  
Feature Representation ◽  
Future Research ◽  
Bag Of Words ◽  
Low Level ◽  
Learning Techniques ◽  
Class Labels ◽  
High Level

Content-based image retrieval (CBIR) systems require users to query images by their low-level visual content; this not only makes it hard for users to formulate queries, but also can lead to unsatisfied retrieval results. To this end, image annotation was proposed. The aim of image annotation is to automatically assign keywords to images, so image retrieval users are able to query images by keywords. Image annotation can be regarded as the image classification problem: that images are represented by some low-level features and some supervised learning techniques are used to learn the mapping between low-level features and high-level concepts (i.e., class labels). One of the most widely used feature representation methods is bag-of-words (BoW). This paper reviews related works based on the issues of improving and/or applying BoW for image annotation. Moreover, many recent works (from 2006 to 2012) are compared in terms of the methodology of BoW feature generation and experimental design. In addition, several different issues in using BoW are discussed, and some important issues for future research are discussed.

An Efficient Web Image Annotation Ranking Algorithm

2010 ◽  
Vol 108-111 ◽  
pp. 81-87
Author(s):  
Zheng Liu
Keyword(s):  
Image Retrieval ◽  
Real World ◽  
Retrieval System ◽  
Image Annotation ◽  
Region Growing ◽  
Ranking Algorithm ◽  
Manifold Ranking ◽  
Image Retrieval System ◽  
Data Points ◽  
Web Images

Existing image annotation approaches mainly concentrate on achieving annotation results. Annotation order has not been taken into account carefully. As orderly annotation list could enhance the performance of image retrieval system, it is of great importance to rank annotations. This paper presents an algorithm to rank Web image annotating results. For an annotated Web image, we firstly partition the image by a region growing method. Secondly, relevance degree between two annotations is estimated through considering both semantic similarity and image content. Next, the regions of unlabeled image to be ranked serve as queries and annotations are used as the data points to be ranked. And then, manifold-ranking algorithm is executed to get the ordered annotation list. Experiments conducted on real-world Web images through NDCG metric demonstrate the effectiveness of the proposed approach.

scholarly journals A Novel Adaptive Feature Fusion Strategy for Image Retrieval

Entropy ◽  
2021 ◽  
Vol 23 (12) ◽  
pp. 1670
Author(s):  
Xiaojun Lu ◽  
Libo Zhang ◽  
Lei Niu ◽  
Qing Chen ◽  
Jianping Wang
Keyword(s):  
Image Retrieval ◽  
Information Entropy ◽  
Retrieval System ◽  
Feature Fusion ◽  
Research Direction ◽  
Image Features ◽  
Retrieval Strategy ◽  
Fusion Image ◽  
Single Feature ◽  
Image Retrieval System

In the era of big data, it is challenging to efficiently retrieve the required images from the vast amount of data. Therefore, a content-based image retrieval system is an important research direction to address this problem. Furthermore, a multi-feature-based image retrieval system can compensate for the shortage of a single feature to a certain extent, which is essential for improving retrieval system performance. Feature selection and feature fusion strategies are critical in the study of multi-feature fusion image retrieval. This paper proposes a multi-feature fusion image retrieval strategy with adaptive features based on information entropy theory. Firstly, we extract the image features, construct the distance function to calculate the similarity using the information entropy proposed in this paper, and obtain the initial retrieval results. Then, we obtain the precision of single feature retrieval based on the correlation feedback as the retrieval trust and use the retrieval trust to select the effective features automatically. After that, we initialize the weights of selected features using the average weights, construct the probability transfer matrix, and use the PageRank algorithm to update the initialized feature weights to obtain the final weights. Finally, we calculate the comprehensive similarity based on the final weights and output the detection results. This has two advantages: (1) the proposed strategy uses multiple features for image retrieval, which has better performance and more substantial generalization than the retrieval strategy based on a single feature; (2) compared with the fixed-feature retrieval strategy, our method selects the best features for fusion in each query, which takes full advantages of each feature. The experimental results show that our proposed method outperforms other methods. In the datasets of Corel1k, UC Merced Land-Use, and RSSCN7, the top10 retrieval precision is 99.55%, 88.02%, and 88.28%, respectively. In the Holidays dataset, the mean average precision (mAP) was 92.46%.

Sign in / Sign up

Export Citation Format

Share Document