Rate Distortion Theory: The Influences of the Source and Distortion Measure in Structuring Source Coding

1978 ◽  
pp. 295-317 ◽  
Author(s):  
David J. Sakrison
Keyword(s):  
Source Coding ◽  
Rate Distortion ◽  
Rate Distortion Theory ◽  
Distortion Measure

scholarly journals Mutual Information, the Linear Prediction Model, and CELP Voice Codecs

2019 ◽  
Author(s):  
Jerry Gibson
Keyword(s):  
Mutual Information ◽  
Linear Prediction ◽  
Rate Distortion ◽  
Source Model ◽  
Rate Distortion Theory ◽  
Input Source ◽  
Distortion Measure ◽  
Adaptive Codebook ◽  
Log Ratio ◽  
Linear Prediction Model

We write the mutual information between an input speech utterance and its reconstruction by a Code-Excited Linear Prediction (CELP) codec in terms of the mutual information between the input speech and the contributions due to the short term predictor, the adaptive codebook, and the fixed codebook. We then show that a recently introduced quantity, the log ratio of entropy powers, can be used to estimate these mutual informations in terms of bits/sample. A key result is that for many common distributions and for Gaussian autoregressive processes, the entropy powers in the ratio can be replaced by the corresponding minimum mean squared errors. We provide examples of estimating CELP codec performance using the new results and compare to the performance of the AMR codec and other CELP codecs. Similar to rate distortion theory, this method only needs the input source model and the appropriate distortion measure.

scholarly journals Mutual Information, the Linear Prediction Model, and CELP Voice Codecs

Information ◽  
2019 ◽  
Vol 10 (5) ◽  
pp. 179 ◽  
Author(s):  
Jerry Gibson
Keyword(s):  
Mutual Information ◽  
Linear Prediction ◽  
Rate Distortion ◽  
Source Model ◽  
Rate Distortion Theory ◽  
Input Source ◽  
Distortion Measure ◽  
Adaptive Codebook ◽  
Log Ratio ◽  
Linear Prediction Model

We write the mutual information between an input speech utterance and its reconstruction by a code-excited linear prediction (CELP) codec in terms of the mutual information between the input speech and the contributions due to the short-term predictor, the adaptive codebook, and the fixed codebook. We then show that a recently introduced quantity, the log ratio of entropy powers, can be used to estimate these mutual informations in terms of bits/sample. A key result is that for many common distributions and for Gaussian autoregressive processes, the entropy powers in the ratio can be replaced by the corresponding minimum mean squared errors. We provide examples of estimating CELP codec performance using the new results and compare these to the performance of the adaptive multirate (AMR) codec and other CELP codecs. Similar to rate distortion theory, this method only needs the input source model and the appropriate distortion measure.

scholarly journals On the Analogy of the Problems of Optimizing the Choice of Information Security Controls with Some Problems of Communication Theory

2021 ◽  
pp. 30-35
Author(s):  
Vadim Gribunin ◽  
◽  
Andrey Timonov ◽  
Keyword(s):  
Information Security ◽  
Communication Theory ◽  
Rate Distortion ◽  
Budget Allocation ◽  
Optimal Choice ◽  
Automated System ◽  
Optimal Placement ◽  
Rate Distortion Theory ◽  
Security Controls ◽  
Theory Research

Purpose of the article: optimization of the choice of information security tools in a multi-level automated system, taking into account higher levels, quality indicators of information security tools, as well as the general financial budget. Demonstration of analogies of solving these problems with known problems from communication theory. Research method: optimal choice of information security tools based on risk analysis and the Lagrange multiplier method; Optimal bit budget allocation based on the Waterfilling optimization algorithm. Optimal placement of information security tools in a multilevel automated system based on bisectional search. Obtained result: the article shows analogies between some problems of communication theory and the optimal choice of information security tools. The well-known problem of the optimal choice of information security tools is solved using the rate-distortion theory, the well-known problem of the optimal budget allocation for their purchase is solved by analogy with the problem of distributing the power of transmitters. For the first time, the problem posed for the optimal placement of information security tools in a multilevel automated system was solved by analogy with the problem of distributing the total bit budget between quantizers.

Sign in / Sign up

Export Citation Format

Share Document