Machine Learning Approach for Content Based Image Retrieval

Author(s):  
Siddhivinayak Kulkarni

Developments in technology and the Internet have led to an increase in number of digital images and videos. Thousands of images are added to WWW every day. Content based Image Retrieval (CBIR) system typically consists of a query example image, given by the user as an input, from which low-level image features are extracted. These low level image features are used to find images in the database which are most similar to the query image and ranked according their similarity. This chapter evaluates various CBIR techniques based on fuzzy logic and neural networks and proposes a novel fuzzy approach to classify the colour images based on their content, to pose a query in terms of natural language and fuse the queries based on neural networks for fast and efficient retrieval. A number of experiments were conducted for classification, and retrieval of images on sets of images and promising results were obtained.

2021 ◽  
Vol 8 (7) ◽  
pp. 97-105
Author(s):  
Ali Ahmed ◽  
◽  
Sara Mohamed ◽  

Content-Based Image Retrieval (CBIR) systems retrieve images from the image repository or database in which they are visually similar to the query image. CBIR plays an important role in various fields such as medical diagnosis, crime prevention, web-based searching, and architecture. CBIR consists mainly of two stages: The first is the extraction of features and the second is the matching of similarities. There are several ways to improve the efficiency and performance of CBIR, such as segmentation, relevance feedback, expansion of queries, and fusion-based methods. The literature has suggested several methods for combining and fusing various image descriptors. In general, fusion strategies are typically divided into two groups, namely early and late fusion strategies. Early fusion is the combination of image features from more than one descriptor into a single vector before the similarity computation, while late fusion refers either to the combination of outputs produced by various retrieval systems or to the combination of different rankings of similarity. In this study, a group of color and texture features is proposed to be used for both methods of fusion strategies. Firstly, an early combination of eighteen color features and twelve texture features are combined into a single vector representation and secondly, the late fusion of three of the most common distance measures are used in the late fusion stage. Our experimental results on two common image datasets show that our proposed method has good performance retrieval results compared to the traditional way of using single features descriptor and also has an acceptable retrieval performance compared to some of the state-of-the-art methods. The overall accuracy of our proposed method is 60.6% and 39.07% for Corel-1K and GHIM-10K ‎datasets, respectively.


2013 ◽  
Vol 25 (04) ◽  
pp. 1350045
Author(s):  
Mana Tarjoman ◽  
Emad Fatemizadeh ◽  
Kambiz Badie

Content-based image retrieval (CBIR) makes use of low-level image features, such as color, texture and shape, to index images with minimal human interaction. Considering the gap between low-level image features and the high-level semantic concepts in the CBIR, we proposed an image retrieval system for brain magnetic resonance images based on saliency map. The saliency map of an image contains important image regions which are visually more conspicuous by virtue of their contrast with respect to surrounding regions. First, the proposed approach exploits the ant colony optimization (ACO) technique to measure the image's saliency through ants' movements on the image. The textural features are then calculated from the saliency map of the images. The image indexing is done with an adaptive neuro-fuzzy inference system (ANFIS), which can categorize the magnetic resonance images as normal or tumoral. In online image retrieval, a query image is introduced to the system and the system will return the relevant images. The experimental result shows the accuracy of 98.67% for the image retrieval in our proposed system and improves the retrieval efficiency in compare with the classical CBIR systems.


Content based image retrieval uses different feature descriptors for image search and retrieval. For image retrieval from huge image repositories, the query image features are extracted and compares these features with the contents of feature repository. The most matching image is found and retrieved from the database. This mapping is done based on the distance calculated between feature vector of query image and the extracted feature vectors of images in the database. There are various distance measures used for comparing image feature vectors. This paper compares a set of distance measures using a set of features used for CBIR. The city-block distance measure gives the best results for CBIR.


Author(s):  
Alan Wee-Chung Liew ◽  
Ngai-Fong Law

With the rapid growth of Internet and multimedia systems, the use of visual information has increased enormously, such that indexing and retrieval techniques have become important. Historically, images are usually manually annotated with metadata such as captions or keywords (Chang & Hsu, 1992). Image retrieval is then performed by searching images with similar keywords. However, the keywords used may differ from one person to another. Also, many keywords can be used for describing the same image. Consequently, retrieval results are often inconsistent and unreliable. Due to these limitations, there is a growing interest in content-based image retrieval (CBIR). These techniques extract meaningful information or features from an image so that images can be classified and retrieved automatically based on their contents. Existing image retrieval systems such as QBIC and Virage extract the so-called low-level features such as color, texture and shape from an image in the spatial domain for indexing. Low-level features sometimes fail to represent high level semantic image features as they are subjective and depend greatly upon user preferences. To bridge the gap, a top-down retrieval approach involving high level knowledge can complement these low-level features. This articles deals with various aspects of CBIR. This includes bottom-up feature- based image retrieval in both the spatial and compressed domains, as well as top-down task-based image retrieval using prior knowledge.


2020 ◽  
Vol 2020 ◽  
pp. 1-20
Author(s):  
Jaya H. Dewan ◽  
Sudeep D. Thepade

Billions of multimedia data files are getting created and shared on the web, mainly social media websites. The explosive increase in multimedia data, especially images and videos, has created an issue of searching and retrieving the relevant data from the archive collection. In the last few decades, the complexity of the image data has increased exponentially. Text-based image retrieval techniques do not meet the needs of the users due to the difference between image contents and text annotations associated with an image. Various methods have been proposed in recent years to tackle the problem of the semantic gap and retrieve images similar to the query specified by the user. Image retrieval based on image contents has attracted many researchers as it uses the visual content of the image such as color, texture, and shape feature. The low-level image features represent the image contents as feature vectors. The query image feature vector is compared with the dataset images feature vectors to retrieve similar images. The main aim of this article is to appraise the various image retrieval methods based on feature extraction, description, and matching content that has been presented in the last 10–15 years based on low-level feature contents and local features and proposes a promising future research direction for researchers.


2020 ◽  
Vol 31 (4) ◽  
pp. 43
Author(s):  
Nuha Mohammed Khassaf ◽  
Shaimaa Hameed Shaker

At the present time, everyone is interested in dealing with images in different fields such as geographic maps, medical images, images obtaining by Camera, microscope, telescope, agricultural field photos, paintings, industrial parts drawings, space photos, etc. Content Based Image Retrieval (CBIR) is an efficient retrieval of relevant images from databases based on features extracted from the image. Follow the proposed system for retrieving images related to a query image from a large set of images, based approach to extract the texture features present in the image using statistical methods (PCA, MAD, GLCM, and Fusion) after pre-processing of images. The proposed system was trained using 1D CNN using a dataset Corel10k which widely used for experimental evaluation of CBIR performance the results of proposed system shows that the highest accuracy is 97.5% using Fusion (PCA, MAD), where the accuracy is 95% using MAD, 90% using PCA. The performance result is acceptable compared to previous work.


2017 ◽  
Vol 8 (2) ◽  
Author(s):  
Rahmad Hidayat ◽  
Agus Harjoko ◽  
Anny Kartika Sari

Abstract. Content-based Image Retrieval (CBIR) is an image search process by comparing the image features sought by the images contained in the database. Low-level features in the image are commonly used in CBIR is the color, texture, and shape. This article conducts a review of journals related to CBIR, particularly research based on low-level features. The journals are then classified based on the color space, features and feature extraction methods. The results show that the color space often used is the RGB and HSV due to their compatibility with the hardware and human perception of color. The features most often used in CBIR is the color feature. This is due to the fact that color features can easily and quickly be extracted. The most often used method to extract the color feature is the color histogram, the most common method used to extract texture features is the gray level co-occurence matrix, and the method most widely used to extract the shape feature is canny edge.Keywords: CBIR, color, texture, shape. Abstract. Content based Image Retrieval (CBIR) merupakan proses pencarian gambar dengan membandingkan fitur-fitur yang terdapat pada gambar yang dicari dengan gambar yang terdapat dalam basis data. Fitur-fitur low level pada gambar yang biasa digunakan dalam CBIR adalah warna, tekstur, dan bentuk Artikel ini melakukan tinjauan terhadap penelitian-penelitian yang berkaitan dengan CBIR, khususnya penelitian yang berbasis pada fitur low level. Penelitian-penelitian tersebut kemudian diklasifikasikan berdasarkan ruang warna, fitur dan metode ekstraksi fitur. Hasil tinjauan menunjukkan bahwa ruang warna yang sering digunakan adalah RGB dan HSV karena dianggap cocok dengan hardware dan persepsi manusia terhadap warna. Adapun fitur yang paling sering digunakan dalam CBIR adalah fitur warna. Hal ini disebabkan fitur warna mudah dan cepat diekstraksi. Metode yang paling sering digunakan untuk mengekstraksi fitur warna adalah histogram warna, metode yang paling sering digunakan untuk mengekstraksi fitur tekstur adalah gray level co-occurence matrix, dan metode yang paling banyak digunakan untuk, mengekstraksi fitur bentuk adalah canny edge.Kata kunci: CBIR, warna, tekstur, bentuk.


2021 ◽  
Vol 0 (0) ◽  
Author(s):  
Idris Kharroubi ◽  
Thomas Lim ◽  
Xavier Warin

AbstractWe study the approximation of backward stochastic differential equations (BSDEs for short) with a constraint on the gains process. We first discretize the constraint by applying a so-called facelift operator at times of a grid. We show that this discretely constrained BSDE converges to the continuously constrained one as the mesh grid converges to zero. We then focus on the approximation of the discretely constrained BSDE. For that we adopt a machine learning approach. We show that the facelift can be approximated by an optimization problem over a class of neural networks under constraints on the neural network and its derivative. We then derive an algorithm converging to the discretely constrained BSDE as the number of neurons goes to infinity. We end by numerical experiments.


Sign in / Sign up

Export Citation Format

Share Document