Interpretation of Lagrange multipliers of generalized maximum-entropy distributions

2002 ◽  
Vol 299 (2-3) ◽  
pp. 153-158 ◽  
Author(s):  
T.D. Frank
Entropy ◽  
2020 ◽  
Vol 22 (1) ◽  
pp. 91
Author(s):  
Ingo Klein ◽  
Monika Doll

A distribution that maximizes an entropy can be found by applying two different principles. On the one hand, Jaynes (1957a,b) formulated the maximum entropy principle (MaxEnt) as the search for a distribution maximizing a given entropy under some given constraints. On the other hand, Kapur (1994) and Kesavan and Kapur (1989) introduced the generalized maximum entropy principle (GMaxEnt) as the derivation of an entropy for which a given distribution has the maximum entropy property under some given constraints. In this paper, both principles were considered for cumulative entropies. Such entropies depend either on the distribution function (direct), on the survival function (residual) or on both (paired). We incorporate cumulative direct, residual, and paired entropies in one approach called cumulative Φ entropies. Maximizing this entropy without any constraints produces an extremely U-shaped (=bipolar) distribution. Maximizing the cumulative entropy under the constraints of fixed mean and variance tries to transform a distribution in the direction of a bipolar distribution, as far as it is allowed by the constraints. A bipolar distribution represents so-called contradictory information, which is in contrast to minimum or no information. In the literature, to date, only a few maximum entropy distributions for cumulative entropies have been derived. In this paper, we extended the results to well known flexible distributions (like the generalized logistic distribution) and derived some special distributions (like the skewed logistic, the skewed Tukey λ and the extended Burr XII distribution). The generalized maximum entropy principle was applied to the generalized Tukey λ distribution and the Fechner family of skewed distributions. Finally, cumulative entropies were estimated such that the data was drawn from a maximum entropy distribution. This estimator will be applied to the daily S&P500 returns and time durations between mine explosions.


Entropy ◽  
2019 ◽  
Vol 21 (8) ◽  
pp. 776 ◽  
Author(s):  
Robert K. Niven ◽  
Markus Abel ◽  
Michael Schlegel ◽  
Steven H. Waldrip

The concept of a “flow network”—a set of nodes and links which carries one or more flows—unites many different disciplines, including pipe flow, fluid flow, electrical, chemical reaction, ecological, epidemiological, neurological, communications, transportation, financial, economic and human social networks. This Feature Paper presents a generalized maximum entropy framework to infer the state of a flow network, including its flow rates and other properties, in probabilistic form. In this method, the network uncertainty is represented by a joint probability function over its unknowns, subject to all that is known. This gives a relative entropy function which is maximized, subject to the constraints, to determine the most probable or most representative state of the network. The constraints can include “observable” constraints on various parameters, “physical” constraints such as conservation laws and frictional properties, and “graphical” constraints arising from uncertainty in the network structure itself. Since the method is probabilistic, it enables the prediction of network properties when there is insufficient information to obtain a deterministic solution. The derived framework can incorporate nonlinear constraints or nonlinear interdependencies between variables, at the cost of requiring numerical solution. The theoretical foundations of the method are first presented, followed by its application to a variety of flow networks.


2020 ◽  
Vol 11 (1) ◽  
Author(s):  
Amilcar Orlian Fernandez-Dominguez

AbstractAccording to the Organisation for Economic Co-operation and Development (OECD), violence should be considered by examining both actual and perceived crime. However, the studies related to violence and internal migration under the Mexican drug war episode focus only on one aspect of violence (perception or actual), so their conclusions rely mostly on limited evidence. This article complements previous work by examining the effects of both perceived and actual violence on interstate migration through estimation of a gravity model along three 5-year periods spanning from 2000 to 2015. Using the methods of generalized maximum entropy (to account for endogeneity) and the Blinder–Oaxaca decomposition, the results show that actual violence (measured by homicide rates) does affect migration, but perceived violence explains a greater proportion of higher average migration after 2005. Since this proportion increased after 2010 and actual violence, the results suggest that there was some adaptation to the new levels of violence in the period 2010–2015.


Sign in / Sign up

Export Citation Format

Share Document