Efficient and effective similarity search over probabilistic data based on Earth Mover’s Distance

2011 ◽  
Vol 21 (4) ◽  
pp. 535-559 ◽  
Author(s):  
Jia Xu ◽  
Zhenjie Zhang ◽  
Anthony K. H. Tung ◽  
Ge Yu
Keyword(s):  
Similarity Search ◽  
Earth Mover’S Distance ◽  
Probabilistic Data ◽  
Earth Mover's Distance

Efficient and effective similarity search over probabilistic data based on earth mover's distance

2010 ◽  
Vol 3 (1-2) ◽  
pp. 758-769 ◽  
Author(s):  
Jia Xu ◽  
Zhenjie Zhang ◽  
Anthony K. H. Tung ◽  
Ge Yu
Keyword(s):  
Similarity Search ◽  
Earth Mover’S Distance ◽  
Probabilistic Data ◽  
Earth Mover's Distance

scholarly journals Earth mover's distance based similarity search at scale

2013 ◽  
Vol 7 (4) ◽  
pp. 313-324 ◽  
Author(s):  
Yu Tang ◽  
Leong Hou U ◽  
Yilun Cai ◽  
Nikos Mamoulis ◽  
Reynold Cheng
Keyword(s):  
Similarity Search ◽  
Earth Mover’S Distance ◽  
Earth Mover's Distance

The Earth Mover’s Distance as a Metric for the Space of Inorganic Compositions

2020 ◽  
Author(s):  
Cameron Hargreaves ◽  
Matthew Dyer ◽  
Michael Gaultois ◽  
Vitaliy Kurlin ◽  
Matthew J Rosseinsky
Keyword(s):  
Euclidean Distance ◽  
Nearest Neighbor ◽  
Nearest Neighbor Search ◽  
Inorganic Crystal Structure Database ◽  
Earth Mover’S Distance ◽  
Chemical Similarity ◽  
Earth Mover's Distance ◽  
Neighbor Search ◽  
The Earth ◽  
Binary Compounds

It is a core problem in any field to reliably tell how close two objects are to being the same, and once this relation has been established we can use this information to precisely quantify potential relationships, both analytically and with machine learning (ML). For inorganic solids, the chemical composition is a fundamental descriptor, which can be represented by assigning the ratio of each element in the material to a vector. These vectors are a convenient mathematical data structure for measuring similarity, but unfortunately, the standard metric (the Euclidean distance) gives little to no variance in the resultant distances between chemically dissimilar compositions. We present the Earth Mover’s Distance (EMD) for inorganic compositions, a well-defined metric which enables the measure of chemical similarity in an explainable fashion. We compute the EMD between two compositions from the ratio of each of the elements and the absolute distance between the elements on the modified Pettifor scale. This simple metric shows clear strength at distinguishing compounds and is efficient to compute in practice. The resultant distances have greater alignment with chemical understanding than the Euclidean distance, which is demonstrated on the binary compositions of the Inorganic Crystal Structure Database (ICSD). The EMD is a reliable numeric measure of chemical similarity that can be incorporated into automated workflows for a range of ML techniques. We have found that with no supervision the use of this metric gives a distinct partitioning of binary compounds into clear trends and families of chemical property, with future applications for nearest neighbor search queries in chemical database retrieval systems and supervised ML techniques.

Sign in / Sign up

Export Citation Format

Share Document