Estimation of non-Gaussian random variables in Gaussian noise: Properties of the MMSE

Author(s):  
Dongning Guo ◽  
Shlomo Shamai ◽  
Sergio Verdu
Author(s):  
V. M. Artyushenko ◽  
V. I. Volovach

Mathematical methods allowing to model non-Gaussian random variables and processes are considered. The models and description of non-Gaussian correlated processes in the form of generated Gaussian noise are analyzed, as well as the methods of formation of stationary random processes defined by the one-dimensional density distribution of Vero -abilities and the autocorrelation function. Examples of formation of non-Gaussian random variables and processes are given.


Author(s):  
Dimitrios I. Papadimitriou ◽  
Zissimos P. Mourelatos ◽  
Zhen Hu

This paper proposes a new second-order Saddlepoint Approximation (SOSA) method for reliability analysis of nonlinear systems with correlated non-Gaussian and multimodal random variables. The proposed method overcomes the limitation of current available SOSA methods which are applicable to problems with only Gaussian random variables, by employing a Gaussian Mixture Model (GMM). The latter is first constructed using the Expectation Maximization (EM) method to approximate the joint probability density function of the input variables. Expressions of the statistical moments of the response variables are then derived using a second-order Taylor expansion of the limit-state function and the GMM. The standard SOSA method is finally integrated with the GMM to effectively analyze the reliability of systems with correlated non-Gaussian random variables. The accuracy of the proposed method is compared with existing methods including a SOSA based on Nataf transformation. Numerical examples demonstrate the effectiveness of the proposed approach.


2021 ◽  
pp. 2150039
Author(s):  
Javier E. Contreras-Reyes

Fisher information is a measure to quantify information and estimate system-defining parameters. The scaling and uncertainty properties of this measure, linked with Shannon entropy, are useful to characterize signals through the Fisher–Shannon plane. In addition, several non-gaussian distributions have been exemplified, given that assuming gaussianity in evolving systems is unrealistic, and the derivation of distributions that addressed asymmetry and heavy–tails is more suitable. The latter has motivated studying Fisher information and the uncertainty principle for skew-gaussian random variables for this paper. We describe the skew-gaussian distribution effect on uncertainty principle, from which the Fisher information, the Shannon entropy power, and the Fisher divergence are derived. Results indicate that flexibility of skew-gaussian distribution with a shape parameter allows deriving explicit expressions of these measures and define a new Fisher–Shannon information plane. Performance of the proposed methodology is illustrated by numerical results and applications to condition factor time series.


2018 ◽  
Vol 141 (2) ◽  
Author(s):  
Dimitrios I. Papadimitriou ◽  
Zissimos P. Mourelatos ◽  
Zhen Hu

This paper proposes a new second-order saddlepoint approximation (SOSA) method for reliability analysis of nonlinear systems with correlated non-Gaussian and multimodal random variables. The proposed method overcomes the limitation of current available SOSA methods, which are applicable to problems with only Gaussian random variables, by employing a Gaussian mixture model (GMM). The latter is first constructed using the expectation maximization (EM) method to approximate the joint probability density function (PDF) of the input variables. Expressions of the statistical moments of the response variables are then derived using a second-order Taylor expansion of the limit-state function and the GMM. The standard SOSA method is finally integrated with the GMM to effectively analyze the reliability of systems with correlated non-Gaussian random variables. The accuracy of the proposed method is compared with existing methods including a SOSA based on Nataf transformation. Numerical examples demonstrate the effectiveness of the proposed approach.


Sign in / Sign up

Export Citation Format

Share Document