scholarly journals SIR-DL: AN ARCHITECTURE OF SEMANTIC-BASED IMAGE RETRIEVAL USING DEEP LEARNING TECHNIQUE AND RDF TRIPLE LANGUAGE

2019 ◽  
Vol 35 (1) ◽  
pp. 39-56
Author(s):  
Van The Thanh ◽  
Do Quang Khoi ◽  
Le Huu Ha ◽  
Le Manh Thanh
Keyword(s):  
Information System ◽  
Deep Learning ◽  
Image Retrieval ◽  
Multimedia Systems ◽  
Visual Feature ◽  
Query Image ◽  
Semantic Classification ◽  
Visual Words ◽  
Learning Technique ◽  
Similar Images

The problem of finding and identifying semantics of images is applied in multimedia applications of many different fields such as Hospital Information System, Geographic Information System, Digital Library System, etc. In this paper, we propose the semantic-based image retrieval (SBIR) system based on the deep learning technique; this system is called as SIR-DL that generates visual semantics based on classifying image contents. At the same time we identify the semantics of similar images on Ontology, which describes semantics of visual features of images. Firstly, the color and spatial features of segmented images are we extracted and these visual feature vectors are trained on the deep neural network to obtain visual words vectors. The process of image retrieval is executed rely on semantic classification of SIR-DL according to the visual feature vector of the query image from which it produces a visual word vector. Then, we retrieve it on Ontology to provide the identities and the semantics of similar images corresponds to a similarity measure. In order to carry out SIR-DL, the algorithms and diagram of this image retrieval system are proposed after that we implement them on ImageCLEF@IAPR, which has 20,000 images. On the base of the experimental results, the effectiveness of our method is evaluated by the accuracy, precision, recall, and F-measure; these results are compared with some of works recently published on the same image dataset. It shows that SIR-DL effectively solves the problem of semantic-based image retrieval and can be used to build multimedia systems in many different fields.

Classification and Retrieval of Images Based on Extensive Context and Content Feature Set

2019 ◽  
Vol 12 (3) ◽  
pp. 162-170 ◽  
Author(s):  
Thiriveedhi Yellamanda Srinivasa Rao ◽  
Pakanati Chenna Reddy
Keyword(s):  
Image Retrieval ◽  
Nearest Neighbor ◽  
Recall Rate ◽  
K Nearest Neighbor ◽  
Query Image ◽  
Visual Words ◽  
Similar Images ◽  
Classification Of Images ◽  
Two Stages ◽  
Scaling Invariant

Background: This paper renders a classification and retrieval of image achievements in the search area of image retrieval, especially content-based image retrieval, an area that has been very active and successful in the past few years. Objective: Primarily the features extracted established on the bag of visual words (BOW) can be arranged by utilizing Scaling Invariant Feature Transform (SIFT) and developed K-Means clustering method. Methods: The texture is extracted for a developed multi-texton method by our study. Our retrieval process consists of two stages such as retrieval and classification. The images will be classified established on the features by applying k- Nearest Neighbor (kNN) algorithm. This will separate the images into various classes in order to develop the precision and recall rate initially. Results: After the classification of images, the similar images are retrieved from the relevant class as per the afforded query image.

scholarly journals A Content Based Approach to Medical X-Ray Image Retrieval using Texture Features

2014 ◽  
Vol 12 (7) ◽  
pp. 3742-3748 ◽  
Author(s):  
Sumathi Ganesan ◽  
T.S. Subashini
Keyword(s):  
Image Retrieval ◽  
Imaging Techniques ◽  
Texture Features ◽  
X Rays ◽  
Query Image ◽  
City Block ◽  
X Ray ◽  
Important Research Topic ◽  
Similar Images ◽  
The City

Of late, the amount of digital X-ray images that are produced in hospitals is increasing incredibly fast. Efficient storing, processing and retrieving of X-ray images have thus become an important research topic. With the exponential need that arises in the search for the clinically relevant and visually similar medical images over a vast database, the arena of digital imaging techniques is forced to provide a potential and path-breaking methodology in the midst of technical advancements so as to give the best match in accordance to the user’s query image. CBIR helps doctors to compare X-rays of their current patients with images from similar cases and they could also use these images as queries to find the similar entries in the X-ray database. This paper focuses on six different classes of X-ray images, viz. chest, skull, foot, spine, pelvic and palm for efficient image retrieval. Initially the various X-rays are automatically classified into the six-different classes using BPNN and SVM as classifiers and GLCM co-efficient as features for classification. Indexing is done to make the retrieval fast and retrieval of similar images is based on the city block distance.  

scholarly journals ENHANCED MULTIQUERY SYSTEM USING KNN FOR CONTENT BASED IMAGE RETRIEVAL

2017 ◽  
Vol 16 (1) ◽  
pp. 7515-7523
Author(s):  
Meenu Meenu ◽  
Sonika Jindal
Keyword(s):  
Image Retrieval ◽  
Multimedia Systems ◽  
Content Based Image Retrieval ◽  
Query Image ◽  
Storage Devices ◽  
Feature Vectors ◽  
Candidate Image ◽  
Image Set ◽  
Classification Of Images ◽  
Representative Image

Content Based Image Retrieval (CBIR) techniques are becoming an essential requirement in the multimedia systems with the widespread use of internet, declining cost of storage devices and the exponential growth of un-annotated digital image information available in recent years.  Therefore multi query systems have been used rather than a single query in order to bridge the semantic gaps and in order to understand user’s requirements. Moreover, query replacement algorithm has been used in the previous works in which user provides multiple images to the query image set referred as representative images. Feature vectors are extracted for each image in the representative image set and every image in the database. The centroid, Crep of the representative images is obtained by computing the mean of their feature vectors. Then every image in the representative image set is replaced with the same candidate image in the dataset one by one and new centroids are calculated for every replacement .The distance between each of the centroids resulting from the replacement and the representative image centroid Crep is calculated using Euclidean distance. The cumulative sum of these distances determines the similarity of the candidate image with the representative image set and is used for ranking the images. The smaller the distance, the similar will be the image with the representative image set. But it has some research gaps like it takes a lot of time to extract feature of each and every image from the database and compare our image with the database images and complexity as well as cost increases. So in our proposed work, the KNN algorithm is applied for classification of images in the database image set using the query images and the candidate images are reduced to images returned after classification mechanism which leads to decrease the execution time and reduce the number of iterations. Hence due to hybrid model of multi query and KNN, the effectiveness of image retrieval in CBIR system increases. The language used in this work is C /C++ with Open CV libraries and IDE is Visual studio 2015. The experimental results show that our method is more effective to improve the performance of the retrieval of images.

scholarly journals An Efficient Two-layer based Technique for Content-based Image Retrieval

2021 ◽  
Vol 5 (1) ◽  
pp. 28
Author(s):  
Fawzi Abdul Azeez Salih ◽  
Alan Anwer Abdulla
Keyword(s):  
Image Retrieval ◽  
Texture Features ◽  
Superior Performance ◽  
Content Based Image Retrieval ◽  
Discrete Wavelet ◽  
Color Spaces ◽  
Query Image ◽  
Current State ◽  
Similar Images ◽  
Different Color

The rapid advancement and exponential evolution in the multimedia applications raised the attentional research on content-based image retrieval (CBIR). The technique has a significant role for searching and finding similar images to the query image through extracting the visual features. In this paper, an approach of two layers of search has been developed which is known as two-layer based CBIR. The first layer is concerned with comparing the query image to all images in the dataset depending on extracting the local feature using bag of features (BoF) mechanism which leads to retrieve certain most similar images to the query image. In other words, first step aims to eliminate the most dissimilar images to the query image to reduce the range of search in the dataset of images. In the second layer, the query image is compared to the images obtained in the first layer based on extracting the (texture and color)-based features. The Discrete Wavelet Transform (DWT) and Local Binary Pattern (LBP) were used as texture features. However, for the color features, three different color spaces were used, namely RGB, HSV, and YCbCr. The color spaces are utilized by calculating the mean and entropy for each channel separately. Corel-1K was used for evaluating the proposed approach. The experimental results prove the superior performance of the proposed concept of two-layer over the current state-of-the-art techniques in terms of precision rate in which achieved 82.15% and 77.27% for the top-10 and top-20, respectively.

A Novel Image Encryption with Deep Learning Model for Secure Content based Image Retrieval

2019 ◽  
pp. 54-64
Author(s):  
Mohamed Elsharkawy ◽  
◽  
Ahmed N. Al Masri ◽  
◽  
Keyword(s):  
Deep Learning ◽  
Image Retrieval ◽  
Image Encryption ◽  
Cuckoo Search ◽  
Content Based Image Retrieval ◽  
Query Image ◽  
Search Optimization ◽  
Proposed Model ◽  
Cuckoo Search Optimization ◽  
Visual Properties

From the last decades, a massive quantity of images gets generated and continues to rise to a maximum extent in the forthcoming data. The process of retrieving images based on a query image (QI) is a proficient method of accessing the visual properties from large datasets. Content-based image retrieval (CBIR) provides a way of effectively retrieving images from large databases. At the same time, image encryption techniques can be integrated into the CBIR model to retrieve the images securely. Therefore, this paper presents new image encryption with a deep learning-based secure CBIR model called IEDL-SCBIR. The proposed IEDL-SCBIR technique intends to encrypt the images as well as securely retrieve them. The proposed IEDL-SCBIR technique follows a two-stage process: optimal elliptic curve cryptography (ECC) based encryption and DL based image retrieval. The proposed model derives a cuckoo search optimization (CSO) with the ECC technique for the image encryption process in which the CSO algorithm is applied for optimal key generation. In addition, VGG based feature extraction with Euclidean distance-based similarity measurement is applied for the retrieval process. To validate the enhanced performance of the IEDL-SCBIR technique, a comprehensive results analysis takes place, and the obtained results demonstrate the betterment over the other methods.

scholarly journals Large Scale Near-Duplicate Celebrity Web Images Retrieval Using Visual and Textual Features

2013 ◽  
Vol 2013 ◽  
pp. 1-11 ◽  
Author(s):  
Fengcai Qiao ◽  
Cheng Wang ◽  
Xin Zhang ◽  
Hui Wang
Keyword(s):  
Image Retrieval ◽  
Large Scale ◽  
Image Annotation ◽  
Research Problem ◽  
Visual Features ◽  
Query Image ◽  
Visual Words ◽  
Historical Figures ◽  
Web Images ◽  
Textual Features

Near-duplicate image retrieval is a classical research problem in computer vision toward many applications such as image annotation and content-based image retrieval. On the web, near-duplication is more prevalent in queries for celebrities and historical figures which are of particular interest to the end users. Existing methods such as bag-of-visual-words (BoVW) solve this problem mainly by exploiting purely visual features. To overcome this limitation, this paper proposes a novel text-based data-driven reranking framework, which utilizes textual features and is combined with state-of-art BoVW schemes. Under this framework, the input of the retrieval procedure is still only a query image. To verify the proposed approach, a dataset of 2 million images of 1089 different celebrities together with their accompanying texts is constructed. In addition, we comprehensively analyze the different categories of near duplication observed in our constructed dataset. Experimental results on this dataset show that the proposed framework can achieve higher mean average precision (mAP) with an improvement of 21% on average in comparison with the approaches based only on visual features, while does not notably prolong the retrieval time.

REGION-BASED SEMANTIC IMAGE CLASSIFICATION

2006 ◽  
Vol 06 (03) ◽  
pp. 357-375
Author(s):  
ZAHER AL AGHBARI
Keyword(s):  
Image Retrieval ◽  
Image Databases ◽  
Hill Climbing ◽  
Support Vector ◽  
Test Image ◽  
Query Interface ◽  
Query Image ◽  
Semantic Classification ◽  
Low Level ◽  
Vector Machines

In the field of content-based image retrieval, there exist a gap between low-level descriptions of image content and the semantic needs of users to query image databases. This paper demonstrates an approach to image retrieval founded on classifying image regions hierarchically based on their semantics (e.g. sky, snow, rocks, etc.) that resemble peoples' perception rather than on low-level features (e.g. color, texture, shape, etc.). Particularly, we consider outdoor images and automatically classify their regions based on their semantics using a support vector machines (SVMs). The SVMs learns the semantics of specified classes from specific low-level feature of the test image regions. Image regions are, first, segmented using a hill-climbing approach. Then, those regions are classified by the SVMs. Such semantic classification allows the implementation of intuitive query interface. As we show in our experiments, the high precision of semantic classification justifies the feasibility of our approach.

scholarly journals Content-Based Image Retrieval System for Real Images

10.29007/w4sr ◽  
2018 ◽  
Author(s):  
Yin-Fu Huang ◽  
Bo-Rong Chen
Keyword(s):  
Image Retrieval ◽  
Retrieval System ◽  
Image Database ◽  
Multimedia Data ◽  
Content Based Image Retrieval ◽  
Real Image ◽  
Query Image ◽  
Image Retrieval System ◽  
Similar Images ◽  
Network Technologies

With the rapid progress of network technologies and multimedia data, information retrieval techniques gradually become content-based, and not text-based yet. In this paper, we propose a content-based image retrieval system to query similar images in a real image database. First, we employ segmentation and main object detection to separate the main object from an image. Then, we extract MPEG-7 features from the object and select relevant features using the SAHS algorithm. Next, two approaches “one-against- all” and “one-against-one” are proposed to build the classifiers based on SVM. To further reduce indexing complexity, K-means clustering is used to generate MPEG-7 signatures. Thus, we combine the classes predicted by the classifiers and the results based on the MPEG-7 signatures, and find out the similar images to a query image. Finally, the experimental results show that our method is feasible in image searching from the real image database and more effective than the other methods.

scholarly journals Temu Kembali Citra Tenun Nusa Tenggara Timur menggunakan Esktraksi Fitur yang Robust terhadap Perubahan Skala, Rotasi, dan Pencahayaan

2020 ◽  
Vol 7 (2) ◽  
pp. 349
Author(s):  
Budiman Baso ◽  
Nanik Suciati
Keyword(s):  
Image Retrieval ◽  
Computation Time ◽  
Histogram Equalization ◽  
Content Based Image Retrieval ◽  
Bag Of Visual Words ◽  
Query Image ◽  
Feature Extraction Method ◽  
Visual Words ◽  
Adaptive Histogram Equalization ◽  
Visual Vocabulary

<p class="Abstrak">Ragam motif pada tenun Nusa Tenggara Timur (NTT) seperti flora, fauna dan geometris menjadi suatu keunikan yang dapat membedakan daerah asal dan jenis dari tenun tersebut. Pada penelitian ini, sistem temu kembali citra berbasis isi atau <em>Content-Based Image Retrieval</em> (CBIR) diimplementasikan pada citra tenun NTT sehingga user dapat mencari citra tenun pada <em>database</em> menggunakan citra <em>query </em>berdasarkan fitur visual yang terkandung dalam citra. Seringkali citra <em>query</em> yang diinputkan <em>user</em> memiliki skala, rotasi dan pencahayaan yang bervariasi, sehingga diperlukan suatu metode ektraksi fitur yang dapat mengakomodasi variasi tersebut. Sistem temu kembali citra tenun pada penelitian ini menggunakan model <em>Bag of Visual Words</em> (BoVW) dari <em>keypoints</em> pada citra yang diekstrak dengan metode <em>Speeded Up Robust Feature</em> (SURF). BoVW dibangun menggunakan K-Means untuk menghasilkan <em>visual vocabulary</em> dari <em>keypoints</em> pada seluruh citra <em>training</em>. Representasi BoVW diharapkan dapat menangani variasi skala dan rotasi pada citra. Sedangkan untuk mengatasi variasi pencahayaan pada citra, dilakukan perbaikan kualitas citra dengan menggunakan <em>Contrast Limited Adaptive Histogram Equalization</em> (CLAHE). Percobaan dilakukan dengan membandingkan kinerja dari representasi BoVW yang dibangun menggunakan fitur SURF dengan <em>Maximally Stable Extremal Regions</em> (MSER) pada temu kembali citra tenun. Hasil uji coba menunjukkan bahwa metode SURF menghasilkan rata-rata akurasi 89,86% dan waktu komputasi 9,94 detik, sedangkan MSER menghasilkan rata-rata akurasi 84,04% dan waktu komputasi 1,95 detik.</p><p class="Abstrak"> </p><p class="Abstrak"><em><strong>Abstract</strong></em></p><p class="Abstract"><em>The variety of motifs in East Nusa Tenggara tenun such as flora, fauna and geometric is an unique thing that can distinguish the region of origin and type of the tenun. In this study, the Content-Based Image Retrieval (CBIR) system is implemented in the tenun image. With Content-based techniques Users can search tenun images on the image database by using query images based on visual features contained in the image. Often the query image that the user enters has a different scale, rotation and lighting, so a feature extraction method is needed that can accommodate these differences. The tenun image retrieval system in this study used the Bag of Visual Words (BoVW) model of the keypoints in the extracted image using the Speeded Up Robust Feature (SURF) method. BoVW was built using K-Means to produce visual vocabulary from keypoints on all training images. The representation of BoVW is expected to be able to handle scale variations and rotations in images. Whereas to overcome the lighting variations in the image, image quality improvement is done by using Contrast Limited Adaptive Histogram Equalization (CLAHE). The experiment was conducted by comparing the performance of the BoVW representation which was built using the SURF feature with Maximally Stable Extremal Regions (MSER) at the tenun image retrieval. The results of the trial showed that SURF obtained higher accuracy in all conditions of tenun image data with an average value of 89.86% whereas MSER obtained an average accuracy value of 84.04%. But MSER's computation time is 1.95 seconds faster than SURF which is 9.94 seconds.</em></p><p class="Abstrak"><em><strong><br /></strong></em></p>

scholarly journals A Review on LBP in Image Retrieval System for Future Enhancement and Vector Images

2020 ◽  
pp. 155-161
Author(s):  
K Rajalakshmi ◽  
V Krishna Dharshini ◽  
S Selva Meena
Keyword(s):  
Image Retrieval ◽  
Image Database ◽  
Content Based Image Retrieval ◽  
Large Set ◽  
Query Image ◽  
Matching Algorithm ◽  
Image Retrieval System ◽  
Similar Images ◽  
Vector Images ◽  
Similar Kind

Content-Based Image Retrieval is a process to retrieve the similar images from the large set of image database corresponding to the query image. In CBIR low level or pixel level features such as color, texture and shape of the images are extracted and on the basis of similarity matching algorithm the required similar kind of images are retrieved from the image database. To understand the evaluation and evolution of CBIR system various research was studied and various research is going on this way also. In this paper, we have discussed some of the popular pixel level feature extraction techniques for Content-Based Image Retrieval and we also present here about the performance of each technique.

Sign in / Sign up

Export Citation Format

Share Document