Harald Cramér, Random variables and probability distributions. (Cambridge tracts in mathematics and mathematical physics, Nr. 36), Cambridge 1937. 121 S. Preis: broschiert 6s 6d

1938 ◽  
Vol 18 (2) ◽  
pp. 145-145
Author(s):  
E. Kamke
Keyword(s):  
Probability Distributions ◽  
Random Variables ◽  
Mathematical Physics

DISSONANCE — A MEASURE OF VARIABILITY FOR ORDINAL RANDOM VARIABLES

2001 ◽  
Vol 09 (01) ◽  
pp. 39-53 ◽  
Author(s):  
RONALD R. YAGER
Keyword(s):  
Distribution Function ◽  
Cumulative Distribution Function ◽  
Probability Distributions ◽  
Random Variables ◽  
Cumulative Distribution ◽  
General Properties

We look at the issue of obtaining a variance like measure associated with probability distributions over ordinal sets. We call these dissonance measures. We specify some general properties desired in these dissonance measures. The centrality of the cumulative distribution function in formulating the concept of dissonance is pointed out. We introduce some specific examples of measures of dissonance.

Introduction to Information Theory

2014 ◽  
Author(s):  
M. Vidyasagar
Keyword(s):  
Information Theory ◽  
Probability Distribution ◽  
Relative Entropy ◽  
Probability Distributions ◽  
Random Variables ◽  
Conditional Entropy ◽  
Random Variable ◽  
Entropy Function ◽  
Concave Functions ◽  
Leibler Divergence

This chapter provides an introduction to some elementary aspects of information theory, including entropy in its various forms. Entropy refers to the level of uncertainty associated with a random variable (or more precisely, the probability distribution of the random variable). When there are two or more random variables, it is worthwhile to study the conditional entropy of one random variable with respect to another. The last concept is relative entropy, also known as the Kullback–Leibler divergence, which measures the “disparity” between two probability distributions. The chapter first considers convex and concave functions before discussing the properties of the entropy function, conditional entropy, uniqueness of the entropy function, and the Kullback–Leibler divergence.

Sign in / Sign up

Export Citation Format

Share Document