scholarly journals Improved maximum inner product search with better theoretical guarantee using randomized partition trees

2018 ◽  
Vol 107 (6) ◽  
pp. 1069-1094 ◽  
Author(s):  
Omid Keivani ◽  
Kaushik Sinha ◽  
Parikshit Ram
Keyword(s):  
Inner Product ◽  
Product Search

Learning Sparse Binary Code for Maximum Inner Product Search

2021 ◽  
Author(s):  
Changyi Ma ◽  
Fangchen Yu ◽  
Yueyao Yu ◽  
Wenye Li
Keyword(s):  
Binary Code ◽  
Inner Product ◽  
Product Search

scholarly journals Norm-Explicit Quantization: Improving Vector Quantization for Maximum Inner Product Search

2020 ◽  
Vol 34 (01) ◽  
pp. 51-58 ◽  
Author(s):  
Xinyan Dai ◽  
Xiao Yan ◽  
Kelvin K. W. Ng ◽  
Jiu Liu ◽  
James Cheng
Keyword(s):  
Data Compression ◽  
Vector Quantization ◽  
Similarity Search ◽  
Euclidean Distance ◽  
Quantization Error ◽  
Experimental Results ◽  
Inner Product ◽  
Direction Error ◽  
Product Search ◽  
Norm Error

Vector quantization (VQ) techniques are widely used in similarity search for data compression, computation acceleration and etc. Originally designed for Euclidean distance, existing VQ techniques (e.g., PQ, AQ) explicitly or implicitly minimize the quantization error. In this paper, we present a new angle to analyze the quantization error, which decomposes the quantization error into norm error and direction error. We show that quantization errors in norm have much higher influence on inner products than quantization errors in direction, and small quantization error does not necessarily lead to good performance in maximum inner product search (MIPS). Based on this observation, we propose norm-explicit quantization (NEQ) — a general paradigm that improves existing VQ techniques for MIPS. NEQ quantizes the norms of items in a dataset explicitly to reduce errors in norm, which is crucial for MIPS. For the direction vectors, NEQ can simply reuse an existing VQ technique to quantize them without modification. We conducted extensive experiments on a variety of datasets and parameter configurations. The experimental results show that NEQ improves the performance of various VQ techniques for MIPS, including PQ, OPQ, RQ and AQ.

scholarly journals Understanding and Improving Proximity Graph Based Maximum Inner Product Search

2020 ◽  
Vol 34 (01) ◽  
pp. 139-146
Author(s):  
Jie Liu ◽  
Xiao Yan ◽  
Xinyan Dai ◽  
Zhirong Li ◽  
James Cheng ◽  
...  
Keyword(s):  
State Of The Art ◽  
Small World ◽  
Inner Product ◽  
Robust Performance ◽  
Small Norm ◽  
Order Of Magnitude ◽  
Product Search ◽  
Proximity Graph ◽  
Product Proximity ◽  
Strong Norm

The inner-product navigable small world graph (ip-NSW) represents the state-of-the-art method for approximate maximum inner product search (MIPS) and it can achieve an order of magnitude speedup over the fastest baseline. However, to date it is still unclear where its exceptional performance comes from. In this paper, we show that there is a strong norm bias in the MIPS problem, which means that the large norm items are very likely to become the result of MIPS. Then we explain the good performance of ip-NSW as matching the norm bias of the MIPS problem — large norm items have big in-degrees in the ip-NSW proximity graph and a walk on the graph spends the majority of computation on these items, thus effectively avoids unnecessary computation on small norm items. Furthermore, we propose the ip-NSW+ algorithm, which improves ip-NSW by introducing an additional angular proximity graph. Search is first conducted on the angular graph to find the angular neighbors of a query and then the MIPS neighbors of these angular neighbors are used to initialize the candidate pool for search on the inner-product proximity graph. Experiment results show that ip-NSW+ consistently and significantly outperforms ip-NSW and provides more robust performance under different data distributions.

Indexing and mining large-scale neuron databases using maximum inner product search

2017 ◽  
Vol 63 ◽  
pp. 680-688 ◽  
Author(s):  
Zhongyu Li ◽  
Ruogu Fang ◽  
Fumin Shen ◽  
Amin Katouzian ◽  
Shaoting Zhang
Keyword(s):  
Large Scale ◽  
Inner Product ◽  
Product Search

Maximum inner product search for morphological retrieval of large-scale neuron data

2016 ◽  
Author(s):  
Zhongyu Li ◽  
Fumin Shen ◽  
Ruogu Fang ◽  
Sailesh Conjeti ◽  
Amin Katouzian ◽  
...  
Keyword(s):  
Large Scale ◽  
Inner Product ◽  
Product Search
Sign in / Sign up

Export Citation Format

Share Document