scholarly journals Channel-Supermodular Entropies: Order Theory and an Application to Query Anonymization

Entropy ◽  
2021 ◽  
Vol 24 (1) ◽  
pp. 39
Author(s):  
Arthur Américo ◽  
MHR Khouzani ◽  
Pasquale Malacaria
Keyword(s):  
Greedy Algorithm ◽  
Shannon Entropy ◽  
Information Leakage ◽  
Order Theory ◽  
Sufficient Condition ◽  
Symmetric Channel ◽  
Special Cases ◽  
Entropy Measures

This work introduces channel-supermodular entropies, a subset of quasi-concave entropies. Channel-supermodularity is a property shared by some of the most commonly used entropies in the literature, including Arimoto–Rényi conditional entropies (which include Shannon and min-entropy as special cases), k-tries entropies, and guessing entropy. Based on channel-supermodularity, new preorders for channels that strictly include degradedness and inclusion (or Shannon ordering) are defined, and these preorders are shown to provide a sufficient condition for the more-capable and capacity ordering, not only for Shannon entropy but also regarding analogous concepts for other entropy measures. The theory developed is then applied in the context of query anonymization. We introduce a greedy algorithm based on channel-supermodularity for query anonymization and prove its optimality, in terms of information leakage, for all symmetric channel-supermodular entropies.

First-order Theory of Fields with Arbitrary Spin

2020 ◽  
pp. 135-146
Author(s):  
Daniel Canarutto
Keyword(s):  
Order Theory ◽  
Arbitrary Spin ◽  
General Description ◽  
First Order ◽  
First Order Theory ◽  
Special Cases ◽  
Spinor Geometry ◽  
Theory Of Fields ◽  
Angular Momentum Algebra ◽  
Dirac Spinors

By exploiting the previously exposed results in 2-spinor geometry, a general description of fields of arbitrary spin is exposed and shown to admit a first-order Lagrangian which extends the theory of Dirac spinors. The needed bundle is the fibered direct product of a symmetric ‘main sector’—carrying an irreducible representation of the angular-momentum algebra—and an induced sequence of ‘ghost sectors’. Several special cases are considered; in particular, one recovers the Bargmann-Wigner and Joos-Weinberg equations.

A sufficient condition for instability of BGK type waves in both unmagnetized and magnetized plasmas

1977 ◽  
Vol 17 (1) ◽  
pp. 57-68 ◽  
Author(s):  
E. Infeld ◽  
G. Rowlands
Keyword(s):  
Magnetic Field ◽  
Linear Theory ◽  
General Problem ◽  
Uniform Magnetic Field ◽  
Magnetized Plasmas ◽  
Sufficient Condition ◽  
General Sufficient Condition ◽  
Special Cases

This paper investigates the general problem of stability of Bernstein—Greene— Kruskal type waves. By investigating perturbations perpendicular to the wave, we obtain a general sufficient condition for instability. This is then extended to the case of magnetized plasmas with a uniform magnetic field in the direction of the BGK wave. New perturbed modes, having no counterpart in linear theory, are also found. Various special cases are considered and previous, more particular results confirmed.

Recurrence Plot based entropies and their ability to detect transitions

2020 ◽  
Author(s):  
K. Hauke Kraemer ◽  
Norbert Marwan ◽  
Karoline Wiesner ◽  
Jürgen Kurths
Keyword(s):  
Time Series ◽  
Shannon Entropy ◽  
Recurrence Plot ◽  
Climate Dynamics ◽  
Value Distribution ◽  
Tipping Points ◽  
Recurrence Plots ◽  
The Past ◽  
Entropy Measures ◽  
Regime Transitions

<p>Many dynamical processes in Earth Sciences are the product of many interacting components and have often limited predictability, not least because they can exhibit regime transitions (e.g. tipping points).To quantify complexity, entropy measures such as the Shannon entropy of the value distribution are widely used. Amongst other more sophisticated ideas, a number of entropy measures based on recurrence plots have been suggested. Because different structures, e.g. diagonal lines, of the recurrence plot are used for the estimation of probabilities, these entropy measures represent different aspects of the analyzed system and, thus, behave differently. In the past, this fact has led to difficulties in interpreting and understanding those measures. We review the definitions, the motivation and interpretation of these entropy measures, compare their differences and discuss some of the pitfalls when using them.</p><p>Finally, we illustrate their potential in an application on paleoclimate time series. Using the presented entropy measures, changes and transitions in the climate dynamics in the past can be identified and interpreted.</p>

FOURTH MOMENT STRUCTURE OF THE GARCH(p,q) PROCESS

1999 ◽  
Vol 15 (6) ◽  
pp. 824-846 ◽  
Author(s):  
Changli He ◽  
Timo Teräsvirta
Keyword(s):  
Statistical Theory ◽  
Autocorrelation Function ◽  
Fourth Moment ◽  
Sufficient Condition ◽  
Necessary And Sufficient Condition ◽  
Special Cases ◽  
The Moment ◽  
Necessary And Sufficient

In this paper, a necessary and sufficient condition for the existence of the unconditional fourth moment of the GARCH(p,q) process is given and also an expression for the moment itself. Furthermore, the autocorrelation function of the centered and squared observations of this process is derived. The statistical theory is further illustrated by a few special cases such as the GARCH(2,2) process and the ARCH(q) process.

On the general bilinear time series model

1988 ◽  
Vol 25 (3) ◽  
pp. 553-564 ◽  
Author(s):  
Jian Liu ◽  
Peter J. Brockwell
Keyword(s):  
Time Series ◽  
Stationary Solution ◽  
Time Series Model ◽  
Sufficient Condition ◽  
Necessary And Sufficient Condition ◽  
Special Cases ◽  
Non Linear ◽  
Necessary And Sufficient ◽  
Special Case

A sufficient condition is derived for the existence of a strictly stationary solution of the general bilinear time series equations. The condition is shown to reduce to the conditions of Pham and Tran (1981) and Bhaskara Rao et al. (1983) in the special cases which they consider. Under the condition specified, a solution is constructed which is shown to be causal, stationary and ergodic. It is moreover the unique causal solution and the unique stationary solution of the defining equations. In the special case when the defining equations contain no non-linear terms, our condition reduces to the well-known necessary and sufficient condition for existence of a causal stationary solution.

scholarly journals Alternative Entropy Measures and Generalized Khinchin–Shannon Inequalities

Entropy ◽  
2021 ◽  
Vol 23 (12) ◽  
pp. 1618
Author(s):  
Rubem P. Mondaini ◽  
Simão C. de Albuquerque Neto
Keyword(s):  
Information Theory ◽  
Algebraic Structure ◽  
Physical Systems ◽  
Special Cases ◽  
Entropy Measures ◽  
The Rich ◽  
Two Parameter

The Khinchin–Shannon generalized inequalities for entropy measures in Information Theory, are a paradigm which can be used to test the Synergy of the distributions of probabilities of occurrence in physical systems. The rich algebraic structure associated with the introduction of escort probabilities seems to be essential for deriving these inequalities for the two-parameter Sharma–Mittal set of entropy measures. We also emphasize the derivation of these inequalities for the special cases of one-parameter Havrda–Charvat’s, Rényi’s and Landsberg–Vedral’s entropy measures.

scholarly journals 𝑯𝑵- Entropy: A New Measureof Information And Its Properties

2022 ◽  
Vol 24 (1) ◽  
pp. 105-118
Author(s):  
Mervat Mahdy ◽  
◽  
Dina S. Eltelbany ◽  
Hoda Mohammed ◽  
◽  
...  
Keyword(s):  
Information Theory ◽  
Shannon Entropy ◽  
Basic Concept ◽  
Random Quantity ◽  
Numerical Results ◽  
Alternative Measure ◽  
Weighted Version ◽  
Amount Of Information ◽  
Entropy Measures ◽  
Cumulative Residual

Entropy measures the amount of uncertainty and dispersion of an unknown or random quantity, this concept introduced at first by Shannon (1948), it is important for studies in many areas. Like, information theory: entropy measures the amount of information in each message received, physics: entropy is the basic concept that measures the disorder of the thermodynamical system, and others. Then, in this paper, we introduce an alternative measure of entropy, called 𝐻𝑁- entropy, unlike Shannon entropy, this proposed measure of order α and β is more flexible than Shannon. Then, the cumulative residual 𝐻𝑁- entropy, cumulative 𝐻𝑁- entropy, and weighted version have been introduced. Finally, comparison between Shannon entropy and 𝐻𝑁- entropy and numerical results have been introduced.

scholarly journals A Black Hole-Aided Deep-Helix Channel Model for DNA

2022 ◽  
Author(s):  
Md Abdul Latif Sarker ◽  
Md Fazlul Kader ◽  
Md Mostafa Kamal Sarker ◽  
Moon Lee ◽  
Dong Han
Keyword(s):  
Black Hole ◽  
Computer Simulations ◽  
Shannon Entropy ◽  
Deoxyribonucleic Acid ◽  
Channel Model ◽  
Central Black Hole ◽  
Binary Symmetric Channel ◽  
Symmetric Channel ◽  
Information Bound ◽  
Capacity Bound

Abstract In this article, we present a black-hole-aided deep-helix (bh-dh) channel model to enhance information bound and mitigate a multiple-helix directional issue in Deoxyribonucleic acid (DNA) communications. The recent observations of DNA do not match with Shannon bound due to their multiple-helix directional issue. Hence, we propose a bh-dh channel model in this paper. The proposed bh-dh channel model follows a similar fashion of DNA and enriches the earlier DNA observations as well as achieving a composite like information bound. To do successfully the proposed bh-dh channel model, we first define a black-hole-aided Bernoulli-process and then consider a symmetric bh-dh channel model. After that, the geometric and graphical insight shows the resemblance of the proposed bh-dh channel model in DNA and Galaxy layout. In our exploration, the proposed bh-dh symmetric channel geometrically sketches a deep-pair-ellipse when a deep-pair information bit or digit is distributed in the proposed channel. Furthermore, the proposed channel graphically shapes as a beautiful circulant ring. The ring contains a central-hole, which looks like a central-black-hole of a Galaxy. The coordinates of the inner-ellipses denote a deep-double helix, and the coordinates of the outer-ellipses sketch a deep-parallel strand. Finally, the proposed bh-dh symmetric channel significantly outperforms the traditional binary-symmetric channel and is verified by computer simulations in terms of Shannon entropy and capacity bound.

Rényi Entropy and Rényi Divergence in Sequential Effect Algebra

2020 ◽  
Vol 27 (02) ◽  
pp. 2050008
Author(s):  
Zahra Eslami Giski
Keyword(s):  
Shannon Entropy ◽  
Effect Algebra ◽  
Sequential Effect ◽  
Renyi Entropy ◽  
Rényi Entropy ◽  
Numerical Examples ◽  
Basic Properties ◽  
Rényi Divergence ◽  
Leibler Divergence ◽  
Entropy Measures

The aim of this study is to extend the results concerning the Shannon entropy and Kullback–Leibler divergence in sequential effect algebra to the case of Rényi entropy and Rényi divergence. For this purpose, the Rényi entropy of finite partitions in sequential effect algebra and its conditional version are proposed and the basic properties of these entropy measures are derived. In addition, the notion of Rényi divergence of a partition in sequential effect algebra is introduced and the basic properties of this quantity are studied. In particular, it is proved that the Kullback–Leibler divergence and Shannon’s entropy of partitions in a given sequential effect algebra can be obtained as limits of their Rényi divergence and Rényi entropy respectively. Finally, to illustrate the results, some numerical examples are presented.

THEORETICAL PROPERTIES OF THE WEIGHTED GENERALIZED GAMMA AND RELATED DISTRIBUTIONS

2015 ◽  
Vol 29 (3) ◽  
pp. 421-432 ◽  
Author(s):  
Hewa A. Priyadarshani ◽  
Broderick O. Oluyede
Keyword(s):  
Gamma Distribution ◽  
Hazard Function ◽  
Gamma Model ◽  
Generalized Gamma Distribution ◽  
New Class ◽  
Generalized Gamma ◽  
Special Cases ◽  
Entropy Measures ◽  
Skewness Coefficient ◽  
Coefficient Of Skewness

A new class of weighted generalized gamma distribution (WGGD) and related distributions are presented. Theoretical properties of the generalized gamma model, WGGD including the hazard function, reverse hazard function, moments, coefficient of variation, coefficient of skewness, coefficient of kurtosis, and entropy measures are derived. The results presented here generalizes the generalized gamma distribution and includes several distributions as special cases. The special cases include generalized gamma, weighted gamma, weighted exponential, weighted Weibull, weighted Rayleigh distributions, and their underlying or parent distributions.

Sign in / Sign up

Export Citation Format

Share Document