scholarly journals Alternative Entropy Measures and Generalized Khinchin–Shannon Inequalities

Entropy ◽  
2021 ◽  
Vol 23 (12) ◽  
pp. 1618
Author(s):  
Rubem P. Mondaini ◽  
Simão C. de Albuquerque Neto

The Khinchin–Shannon generalized inequalities for entropy measures in Information Theory, are a paradigm which can be used to test the Synergy of the distributions of probabilities of occurrence in physical systems. The rich algebraic structure associated with the introduction of escort probabilities seems to be essential for deriving these inequalities for the two-parameter Sharma–Mittal set of entropy measures. We also emphasize the derivation of these inequalities for the special cases of one-parameter Havrda–Charvat’s, Rényi’s and Landsberg–Vedral’s entropy measures.

Entropy ◽  
2021 ◽  
Vol 23 (6) ◽  
pp. 702
Author(s):  
Velimir Ilić ◽  
Ivan Djordjević

The measures of information transfer which correspond to non-additive entropies have intensively been studied in previous decades. The majority of the work includes the ones belonging to the Sharma–Mittal entropy class, such as the Rényi, the Tsallis, the Landsberg–Vedral and the Gaussian entropies. All of the considerations follow the same approach, mimicking some of the various and mutually equivalent definitions of Shannon information measures, and the information transfer is quantified by an appropriately defined measure of mutual information, while the maximal information transfer is considered as a generalized channel capacity. However, all of the previous approaches fail to satisfy at least one of the ineluctable properties which a measure of (maximal) information transfer should satisfy, leading to counterintuitive conclusions and predicting nonphysical behavior even in the case of very simple communication channels. This paper fills the gap by proposing two parameter measures named the α-q-mutual information and the α-q-capacity. In addition to standard Shannon approaches, special cases of these measures include the α-mutual information and the α-capacity, which are well established in the information theory literature as measures of additive Rényi information transfer, while the cases of the Tsallis, the Landsberg–Vedral and the Gaussian entropies can also be accessed by special choices of the parameters α and q. It is shown that, unlike the previous definition, the α-q-mutual information and the α-q-capacity satisfy the set of properties, which are stated as axioms, by which they reduce to zero in the case of totally destructive channels and to the (maximal) input Sharma–Mittal entropy in the case of perfect transmission, which is consistent with the maximum likelihood detection error. In addition, they are non-negative and less than or equal to the input and the output Sharma–Mittal entropies, in general. Thus, unlike the previous approaches, the proposed (maximal) information transfer measures do not manifest nonphysical behaviors such as sub-capacitance or super-capacitance, which could qualify them as appropriate measures of the Sharma–Mittal information transfer.


2017 ◽  
Vol 17 (7&8) ◽  
pp. 611-622
Author(s):  
Cosmo Lupo ◽  
Stefano Pirandola

Quantum information theory determines the maximum rates at which information can be transmitted through physical systems described by quantum mechanics. Here we consider the communication protocol known as quantum reading. Quantum reading is a protocol for retrieving the information stored in a digital memory by using a quantum probe, e.g., shining quantum states of light to read an optical memory. In a variety of situations using a quantum probe enhances the performance of the reading protocol in terms of fidelity, data density and energy efficiency. Here we review and characterize the quantum reading capacity of a memory model, defined as the maximum rate of reliable reading. We show that, like other quantities in quantum information theory, the quantum reading capacity is super-additive. Moreover, we determine conditions under which the use of an entangled ancilla improves the performance of quantum reading.


2013 ◽  
Vol 725 ◽  
pp. 446-461 ◽  
Author(s):  
Julian F. Scott

AbstractThe three-dimensional analogue of Moffatt eddies is derived for a corner formed by the intersection of three orthogonal planes. The complex exponents of the first few modes are determined and the flows resulting from the primary modes (those which decay least rapidly as the apex is approached and, hence, should dominate the near-apex flow) examined in detail. There are two independent primary modes, one symmetric, the other antisymmetric, with respect to reflection in one of the symmetry planes of the cone. Any linear combination of these modes yields a possible primary flow. Thus, there is not one, but a two-parameter family of such flows. The particle-trajectory equations are integrated numerically to determine the streamlines of primary flows. Three special cases in which the flow is antisymmetric under reflection lead to closed streamlines. However, for all other cases, the streamlines are not closed and quasi-periodic limiting trajectories are approached when the trajectory equations are integrated either forwards or backwards in time. A generic streamline follows the backward-time trajectory in from infinity, undergoes a transient phase in which particle motion is no longer quasi-periodic, before being thrown back out to infinity along the forward-time trajectory.


1993 ◽  
Vol 25 (03) ◽  
pp. 714-716
Author(s):  
K. D. Glazebrook

We propose a two-parameter family of conjugate prior distributions for the number of undiscovered objects in a class of Bayesian search models. The family contains the one-parameter Euler and Heine families as special cases. The two parameters may be interpreted respectively as an overall success rate and a rate of depletion of the source of objects. The new family gives enhanced flexibility in modelling.


2002 ◽  
Vol 12 (04) ◽  
pp. 783-813 ◽  
Author(s):  
K. THAMILMARAN ◽  
M. LAKSHMANAN

We present a detailed investigation of the rich variety of bifurcations and chaos associated with a very simple nonlinear parallel nonautonomous LCR circuit with Chua's diode as its only nonlinear element as briefly reported recently [Thamilmaran et al., 2000]. It is proposed as a variant of the simplest nonlinear nonautonomous circuit introduced by Murali, Lakshmanan and Chua (MLC) [Murali et al., 1994]. In our study we have constructed two-parameter phase diagrams in the forcing amplitude-frequency plane, both numerically and experimentally. We point out that under the influence of a periodic excitation a rich variety of bifurcation phenomena, including the familiar period-doubling sequence, intermittent and quasiperiodic routes to chaos as well as period-adding sequences, occur. In addition, we have also observed that the periods of many windows satisfy the familiar Farey sequence. Further, reverse bifurcations, antimonotonicity, remerging chaotic band attractors, and so on, also occur in this system. Numerical simulation results using Poincaré section, Lyapunov exponents, bifurcation diagrams and phase trajectories are found to be in agreement with experimental observations. The chaotic dynamics of this circuit is observed experimentally and confirmed both by numerical and analytical studies as well PSPICE simulation results. The results are also compared with the dynamics of the original MLC circuit with reference to the two-parameter space to show the richness of the present circuit.


1993 ◽  
Vol 25 (3) ◽  
pp. 714-716 ◽  
Author(s):  
K. D. Glazebrook

We propose a two-parameter family of conjugate prior distributions for the number of undiscovered objects in a class of Bayesian search models. The family contains the one-parameter Euler and Heine families as special cases. The two parameters may be interpreted respectively as an overall success rate and a rate of depletion of the source of objects. The new family gives enhanced flexibility in modelling.


2014 ◽  
Vol 12 (05) ◽  
pp. 583-612 ◽  
Author(s):  
Ernest G. Kalnins ◽  
W. Miller

Quadratic algebras are generalizations of Lie algebras; they include the symmetry algebras of second-order superintegrable systems in two dimensions as special cases. The superintegrable systems are exactly solvable physical systems in classical and quantum mechanics. For constant curvature spaces, we show that the free quadratic algebras generated by the first- and second-order elements in the enveloping algebras of their Euclidean and orthogonal symmetry algebras correspond one-to-one with the possible superintegrable systems with potential defined on these spaces. We describe a contraction theory for quadratic algebras and show that for constant curvature superintegrable systems, ordinary Lie algebra contractions induce contractions of the quadratic algebras of the superintegrable systems that correspond to geometrical pointwise limits of the physical systems. One consequence is that by contracting function space realizations of representations of the generic superintegrable quantum system on the 2-sphere (which give the structure equations for Racah/Wilson polynomials) to the other superintegrable systems one obtains the full Askey scheme of orthogonal hypergeometric polynomials.


2016 ◽  
Vol 8 (1) ◽  
pp. 51-82
Author(s):  
D. Greenhoe

Metric spaces provide a framework for analysis and have several very useful properties. Many of these properties follow in part from the  triangle inequality. However, there are several applications in which the triangle inequality does not hold but in which we may still like to perform analysis. This paper investigates what happens if the triangle inequality is removed all together, leaving what is called a distance space, and also what happens if the triangle inequality is replaced with a much more general two parameter relation, which is herein called the "power triangle inequality". The power triangle inequality represents an uncountably large class of inequalities, and includes the  triangle inequality,  relaxed triangle inequality, and   inframetric inequality as special cases. The power triangle inequality is defined in terms of a function that is herein called the power triangle function. The power triangle function is itself a power mean, and as such is continuous and monotone with respect to its exponential parameter, and also includes the operations of  maximum,  minimum,  mean square,  arithmetic mean, geometric mean, and  harmonic mean as special cases.


1999 ◽  
pp. 599-611
Author(s):  
M. Matić ◽  
Charles E. M. Pearce ◽  
Josip Pečarić

Sign in / Sign up

Export Citation Format

Share Document