Bayesian or Laplacien inference, entropy and information theory and information geometry in data and signal processing

2015 ◽  
Author(s):  
Ali Mohammad-Djafari
Keyword(s):  
Information Theory ◽  
Signal Processing ◽  
Information Geometry

scholarly journals Isometric Signal Processing under Information Geometric Framework

Entropy ◽  
2019 ◽  
Vol 21 (4) ◽  
pp. 332 ◽  
Author(s):  
Hao Wu ◽  
Yongqiang Cheng ◽  
Hongqiang Wang
Keyword(s):  
Signal Processing ◽  
Probability Distribution ◽  
Geometric Structure ◽  
Information Geometry ◽  
Sufficient Condition ◽  
Necessary And Sufficient Condition ◽  
Statistical Manifold ◽  
Intrinsic Parameter ◽  
Geometric Framework ◽  
Necessary And Sufficient

Information geometry is the study of the intrinsic geometric properties of manifolds consisting of a probability distribution and provides a deeper understanding of statistical inference. Based on this discipline, this letter reports on the influence of the signal processing on the geometric structure of the statistical manifold in terms of estimation issues. This letter defines the intrinsic parameter submanifold, which reflects the essential geometric characteristics of the estimation issues. Moreover, the intrinsic parameter submanifold is proven to be a tighter one after signal processing. In addition, the necessary and sufficient condition of invariant signal processing of the geometric structure, i.e., isometric signal processing, is given. Specifically, considering the processing with the linear form, the construction method of linear isometric signal processing is proposed, and its properties are presented in this letter.

scholarly journals Kählerian Information Geometry for Signal Processing

Entropy ◽  
2015 ◽  
Vol 17 (4) ◽  
pp. 1581-1605 ◽  
Author(s):  
Jaehyung Choi ◽  
Andrew Mullhaupt
Keyword(s):  
Signal Processing ◽  
Information Geometry

scholarly journals Entropy-Based Algorithms for Signal Processing

Entropy ◽  
2020 ◽  
Vol 22 (6) ◽  
pp. 621
Author(s):  
Gwanggil Jeon ◽  
Abdellah Chehri
Keyword(s):  
Information Theory ◽  
Signal Processing ◽  
Computer Science ◽  
Important Research ◽  
Research Areas ◽  
Key Factor

Entropy, the key factor of information theory, is one of the most important research areas in computer science [...]

Optimization in Digital Watermarking Techniques

2010 ◽  
pp. 369-406 ◽  
Author(s):  
Santi P. Maity ◽  
Claude Delpha
Keyword(s):  
Game Theory ◽  
Information Theory ◽  
Signal Processing ◽  
Soft Computing ◽  
Digital Watermarking ◽  
Research Area ◽  
Future Research ◽  
Design And Implementation ◽  
Soft Computing Techniques ◽  
Rigorous Mathematical Analysis

Digital watermarking (DWM) becomes a multidisciplinary research area involving theory of communications, signal processing, multimedia coding, information theory, cryptography, computer science and game theory etc. This chapter looks digital watermarking as an optimization problem from different combination of these areas. The goal is to resolve the conflicting requirements of different parameters and properties of digital watermarking. The chapter also presents a review of recent advances in the state-of-the-art algorithms for optimized watermarking techniques. Optimized watermarking methods are then discussed from the rigorous mathematical analysis to theoretical derivations of algorithms with the aid of soft computing techniques. The design and implementation of optimized watermarking methods for the image, video and sound signals are discussed in the context of various diverse applications. Finally, the scope of future research in this area is highlighted.

Optimization in Digital Watermarking Techniques

2013 ◽  
pp. 1493-1529
Author(s):  
Santi P. Maity ◽  
Claude Delpha
Keyword(s):  
Game Theory ◽  
Information Theory ◽  
Signal Processing ◽  
Soft Computing ◽  
Digital Watermarking ◽  
Research Area ◽  
Future Research ◽  
Design And Implementation ◽  
Soft Computing Techniques ◽  
Rigorous Mathematical Analysis

Digital watermarking (DWM) becomes a multidisciplinary research area involving theory of communications, signal processing, multimedia coding, information theory, cryptography, computer science and game theory etc. This chapter looks digital watermarking as an optimization problem from different combination of these areas. The goal is to resolve the conflicting requirements of different parameters and properties of digital watermarking. The chapter also presents a review of recent advances in the state-of-the-art algorithms for optimized watermarking techniques. Optimized watermarking methods are then discussed from the rigorous mathematical analysis to theoretical derivations of algorithms with the aid of soft computing techniques. The design and implementation of optimized watermarking methods for the image, video and sound signals are discussed in the context of various diverse applications. Finally, the scope of future research in this area is highlighted.

scholarly journals Information Theory Applications in Signal Processing

Entropy ◽  
2019 ◽  
Vol 21 (7) ◽  
pp. 653 ◽  
Author(s):  
Sergio Cruces ◽  
Rubén Martín-Clemente ◽  
Wojciech Samek
Keyword(s):  
Information Theory ◽  
Signal Processing ◽  
Mathematical Theory

The birth of Information Theory, right after the pioneering work of Claude Shannon and his celebrated publication of the paper “A mathematical theory of Communication” [...]

Sign in / Sign up

Export Citation Format

Share Document