Narrowing the semantic-gap using multi-modal ontology for semantic image retrieval

Author(s):  
R.I. Minu ◽  
K.K. Thyagharajan
2012 ◽  
Vol 03 (01) ◽  
pp. 473-478 ◽  
Author(s):  
Minu R.I. ◽  
◽  
Thyagharajan K.K. ◽  

2011 ◽  
Vol 268-270 ◽  
pp. 1427-1432
Author(s):  
Chang Yong Ri ◽  
Min Yao

This paper presented the key problems to shorten “semantic gap” between low-level visual features and high-level semantic features to implement high-level semantic image retrieval. First, introduced ontology based semantic image description and semantic extraction methods based on machine learning. Then, illustrated image grammar on the high-level semantic image understanding and retrieval, and-or graph and context based methods of semantic image. Finally, we discussed the development directions and research emphases in this field.


Author(s):  
Mohd Suffian Sulaiman ◽  
Sharifalillah Nordin ◽  
Nursuriati Jamil

Ontology is a semantic technology that provides the possible approach to bridge the issue on semantic gap in image retrieval between low-level visual features and high-level human semantic. The semantic gap occurs when there is a discrepancy between the information that is extracted from visual data and the text description. In other words, there is a difference between the computational representation in machine and human natural language. In this paper, an ontology has been utilized to reduce the semantic gap by developing a multi-modality ontology image retrieval with the enhancement of a retrieval mechanism by using the object properties filter. To achieve this, a multi-modality ontology semantic image framework was proposed, comprising of four main components which were resource identification, information extraction, knowledge-based construction and retrieval mechanism. A new approach, namely object properties filter is proposed by customizing the semantic image retrieval algorithm and the graphical user interface to facilitate the user to engage with the machine i.e. computers, in order to enhance the retrieval performance. The experiment results showed that the proposed approach delivered better results compared to the approach that did not use the object properties filter based on probability precision measurement.  


2018 ◽  
Vol 45 (1) ◽  
pp. 117-135 ◽  
Author(s):  
Amna Sarwar ◽  
Zahid Mehmood ◽  
Tanzila Saba ◽  
Khurram Ashfaq Qazi ◽  
Ahmed Adnan ◽  
...  

The advancements in the multimedia technologies result in the growth of the image databases. To retrieve images from such image databases using visual attributes of the images is a challenging task due to the close visual appearance among the visual attributes of these images, which also introduces the issue of the semantic gap. In this article, we recommend a novel method established on the bag-of-words (BoW) model, which perform visual words integration of the local intensity order pattern (LIOP) feature and local binary pattern variance (LBPV) feature to reduce the issue of the semantic gap and enhance the performance of the content-based image retrieval (CBIR). The recommended method uses LIOP and LBPV features to build two smaller size visual vocabularies (one from each feature), which are integrated together to build a larger size of the visual vocabulary, which also contains complementary features of both descriptors. Because for efficient CBIR, the smaller size of the visual vocabulary improves the recall, while the bigger size of the visual vocabulary improves the precision or accuracy of the CBIR. The comparative analysis of the recommended method is performed on three image databases, namely, WANG-1K, WANG-1.5K and Holidays. The experimental analysis of the recommended method on these image databases proves its robust performance as compared with the recent CBIR methods.


Sign in / Sign up

Export Citation Format

Share Document