On the symmetrized s-divergence

Abstract In this study, we work with the relative divergence of type s,s\in {\mathbb{R}} , which includes the Kullback-Leibler divergence and the Hellinger and χ 2 distances as particular cases. We study the symmetrized divergences in additive and multiplicative forms. Some basic properties such as symmetry, monotonicity and log-convexity are established. An important result from the convexity theory is also proved.

Download Full-text

On the symmetrized S-divergence

ITM Web of Conferences ◽

10.1051/itmconf/20192901004 ◽

2019 ◽

Vol 29 ◽

pp. 01004

Author(s):

Slavko Simić

Keyword(s):

Leibler Divergence ◽

Convexity Theory ◽

Relative Divergence

In this paper we worked with the relative divergence of type s, s ∈ ℝ, which include Kullback-Leibler divergence and the Hellinger and χ2 distances as particular cases. We give here a study of the sym- metrized divergences in additive and multiplicative forms. Some ba-sic properties as symmetry, monotonicity and log-convexity are estab-lished. An important result from the Convexity Theory is also proved.

Download Full-text

Rényi Entropy and Rényi Divergence in Sequential Effect Algebra

Open Systems & Information Dynamics ◽

10.1142/s1230161220500080 ◽

2020 ◽

Vol 27 (02) ◽

pp. 2050008

Author(s):

Zahra Eslami Giski

Keyword(s):

Shannon Entropy ◽

Effect Algebra ◽

Sequential Effect ◽

Renyi Entropy ◽

Rényi Entropy ◽

Numerical Examples ◽

Basic Properties ◽

Rényi Divergence ◽

Leibler Divergence ◽

Entropy Measures

The aim of this study is to extend the results concerning the Shannon entropy and Kullback–Leibler divergence in sequential effect algebra to the case of Rényi entropy and Rényi divergence. For this purpose, the Rényi entropy of finite partitions in sequential effect algebra and its conditional version are proposed and the basic properties of these entropy measures are derived. In addition, the notion of Rényi divergence of a partition in sequential effect algebra is introduced and the basic properties of this quantity are studied. In particular, it is proved that the Kullback–Leibler divergence and Shannon’s entropy of partitions in a given sequential effect algebra can be obtained as limits of their Rényi divergence and Rényi entropy respectively. Finally, to illustrate the results, some numerical examples are presented.

Download Full-text

On the Essence and Tipology of International Public Goods

Voprosy Ekonomiki ◽

10.32609/0042-8736-2005-3-131-141 ◽

2005 ◽

pp. 131-141

Author(s):

V. Mortikov

Keyword(s):

Economic Policy ◽

Social Construction ◽

Public Goods ◽

Public Good ◽

Global Public Goods ◽

Club Goods ◽

Basic Properties ◽

International Public Goods ◽

Regional Public Goods ◽

Joint Products

The basic properties of international public goods are analyzed in the paper. Special attention is paid to the typology of international public goods: pure and impure, excludable and nonexcludable, club goods, regional public goods, joint products. The author argues that social construction of international public good depends on many factors, for example, government economic policy. Aggregation technologies in the supply of global public goods are examined.

Download Full-text

The advancement of silicon-on-insulator (SOI) devices and their basic properties

Semiconductor Physics Quantum Electronics & Optoelectronics ◽

10.15407/spqeo23.03.227 ◽

2020 ◽

Vol 23 (3) ◽

pp. 227-252

Author(s):

T.E. Rudenko ◽

◽

A.N. Nazarov ◽

V.S. Lysenko ◽

◽

...

Keyword(s):

Silicon On Insulator ◽

Basic Properties ◽

Soi Devices

Download Full-text

Basic Properties of an Ultrasonic Probe with a Through Hole for Puncture and Detection Principle of a Puncture Needle

IEEJ Transactions on Sensors and Micromachines ◽

10.1541/ieejsmas.132.420 ◽

2012 ◽

Vol 132 (11) ◽

pp. 420-424 ◽

Cited By ~ 1

Author(s):

Yuusuke Tanaka ◽

Katsuhiko Tanaka ◽

Susumu Sugiyama ◽

Hisanori Shiomi ◽

Yoshimasa Kurumi ◽

...

Keyword(s):

Ultrasonic Probe ◽

Basic Properties ◽

Puncture Needle ◽

Through Hole ◽

Detection Principle

Download Full-text

Large-sample confidence intervals of information-theoretic measures in linguistics

Journal of Research Design and Statistics in Linguistics and Communication Science ◽

10.1558/jrds.40134 ◽

2020 ◽

Vol 6 (1) ◽

pp. 19-54

Author(s):

Ryan Ka Yau Lai ◽

Youngah Do

Keyword(s):

Maximum Likelihood ◽

Corpus Linguistics ◽

Delta Method ◽

Confidence Bounds ◽

Likelihood Estimator ◽

Information Theoretic ◽

Leibler Divergence ◽

Information Theoretic Measures ◽

Data Points ◽

Measure Of Uncertainty

This article explores a method of creating confidence bounds for information-theoretic measures in linguistics, such as entropy, Kullback-Leibler Divergence (KLD), and mutual information. We show that a useful measure of uncertainty can be derived from simple statistical principles, namely the asymptotic distribution of the maximum likelihood estimator (MLE) and the delta method. Three case studies from phonology and corpus linguistics are used to demonstrate how to apply it and examine its robustness against common violations of its assumptions in linguistics, such as insufficient sample size and non-independence of data points.

Download Full-text