rényi divergence
Recently Published Documents


TOTAL DOCUMENTS

101
(FIVE YEARS 46)

H-INDEX

12
(FIVE YEARS 3)

2021 ◽  
Author(s):  
Eeshan Modak ◽  
Himanshu Asnani ◽  
Vinod M. Prabhakaran

2021 ◽  
Vol 62 (9) ◽  
pp. 092205
Author(s):  
Bjarne Bergh ◽  
Robert Salzmann ◽  
Nilanjana Datta
Keyword(s):  

Author(s):  
Zahid Hussain

The construction of divergence measures between two Pythagorean fuzzy sets (PFSs) is significant as it has a variety of applications in different areas such as multicriteria decision making, pattern recognition and image processing. The main purpose of this study to introduce an information-theoretic divergence so-called Pythagorean fuzzy Jensen-Rényi divergence (PFJRD) between two PFSs. The strength and characterization of the proposed Jensen-Rényi divergence between Pythagorean fuzzy sets lie in its practical applications which are very closed to real life. The proposed divergence measure is utilized to induce some useful similarity measures between PFSs. We apply them in pattern recognition, characterization of the similarity between linguistic variables and in multiple criteria decision making. To demonstrate the practical utility and applicability, we present some numerical examples related to daily life with the construction of Pythagorean fuzzy TOPSIS (Techniques of preference similar to ideal solution). Which is utilized to rank the Belt and Road initiative (BRI) projects. Our numerical simulation results show that the suggested measures are well suitable in pattern recognition, characterization of linguistic variables and multi-criteria decision-making environment.


Mathematics ◽  
2021 ◽  
Vol 9 (12) ◽  
pp. 1423
Author(s):  
Javier Bonilla ◽  
Daniel Vélez ◽  
Javier Montero ◽  
J. Tinguaro Rodríguez

In the last two decades, information entropy measures have been relevantly applied in fuzzy clustering problems in order to regularize solutions by avoiding the formation of partitions with excessively overlapping clusters. Following this idea, relative entropy or divergence measures have been similarly applied, particularly to enable that kind of entropy-based regularization to also take into account, as well as interact with, cluster size variables. Particularly, since Rényi divergence generalizes several other divergence measures, its application in fuzzy clustering seems promising for devising more general and potentially more effective methods. However, previous works making use of either Rényi entropy or divergence in fuzzy clustering, respectively, have not considered cluster sizes (thus applying regularization in terms of entropy, not divergence) or employed divergence without a regularization purpose. Then, the main contribution of this work is the introduction of a new regularization term based on Rényi relative entropy between membership degrees and observation ratios per cluster to penalize overlapping solutions in fuzzy clustering analysis. Specifically, such Rényi divergence-based term is added to the variance-based Fuzzy C-means objective function when allowing cluster sizes. This then leads to the development of two new fuzzy clustering methods exhibiting Rényi divergence-based regularization, the second one extending the first by considering a Gaussian kernel metric instead of the Euclidean distance. Iterative expressions for these methods are derived through the explicit application of Lagrange multipliers. An interesting feature of these expressions is that the proposed methods seem to take advantage of a greater amount of information in the updating steps for membership degrees and observations ratios per cluster. Finally, an extensive computational study is presented showing the feasibility and comparatively good performance of the proposed methods.


Author(s):  
Kun Fang ◽  
Hamza Fawzi

AbstractHaving a distance measure between quantum states satisfying the right properties is of fundamental importance in all areas of quantum information. In this work, we present a systematic study of the geometric Rényi divergence (GRD), also known as the maximal Rényi divergence, from the point of view of quantum information theory. We show that this divergence, together with its extension to channels, has many appealing structural properties, which are not satisfied by other quantum Rényi divergences. For example we prove a chain rule inequality that immediately implies the “amortization collapse” for the geometric Rényi divergence, addressing an open question by Berta et al. [Letters in Mathematical Physics 110:2277–2336, 2020, Equation (55)] in the area of quantum channel discrimination. As applications, we explore various channel capacity problems and construct new channel information measures based on the geometric Rényi divergence, sharpening the previously best-known bounds based on the max-relative entropy while still keeping the new bounds single-letter and efficiently computable. A plethora of examples are investigated and the improvements are evident for almost all cases.


Entropy ◽  
2021 ◽  
Vol 23 (5) ◽  
pp. 514
Author(s):  
Shigeru Furuichi ◽  
Nicuşor Minculete

We give bounds on the difference between the weighted arithmetic mean and the weighted geometric mean. These imply refined Young inequalities and the reverses of the Young inequality. We also studied some properties on the difference between the weighted arithmetic mean and the weighted geometric mean. Applying the newly obtained inequalities, we show some results on the Tsallis divergence, the Rényi divergence, the Jeffreys–Tsallis divergence and the Jensen–Shannon–Tsallis divergence.


Entropy ◽  
2021 ◽  
Vol 23 (4) ◽  
pp. 463
Author(s):  
Khoder Makkawi ◽  
Nourdine Ait-Tmazirte ◽  
Maan El Badaoui El Najjar ◽  
Nazih Moubayed

When applying a diagnostic technique to complex systems, whose dynamics, constraints, and environment evolve over time, being able to re-evaluate the residuals that are capable of detecting defaults and proposing the most appropriate ones can quickly prove to make sense. For this purpose, the concept of adaptive diagnosis is introduced. In this work, the contributions of information theory are investigated in order to propose a Fault-Tolerant multi-sensor data fusion framework. This work is part of studies proposing an architecture combining a stochastic filter for state estimation with a diagnostic layer with the aim of proposing a safe and accurate state estimation from potentially inconsistent or erroneous sensors measurements. From the design of the residuals, using α-Rényi Divergence (α-RD), to the optimization of the decision threshold, through the establishment of a function that is dedicated to the choice of α at each moment, we detail each step of the proposed automated decision-support framework. We also dwell on: (1) the consequences of the degree of freedom provided by this α parameter and on (2) the application-dictated policy to design the α tuning function playing on the overall performance of the system (detection rate, false alarms, and missed detection rates). Finally, we present a real application case on which this framework has been tested. The problem of multi-sensor localization, integrating sensors whose operating range is variable according to the environment crossed, is a case study to illustrate the contributions of such an approach and show the performance.


Sign in / Sign up

Export Citation Format

Share Document