scholarly journals Estimation of a fold convolution in additive noise model with compactly supported noise density

2019 ◽  
Vol 2 (1) ◽  
pp. 76-83
Author(s):  
Cao Xuan Phuong
Keyword(s):  
Random Noise ◽  
Random Variable ◽  
Noise Model ◽  
Compactly Supported ◽  
Squared Error ◽  
Regularization Parameters ◽  
Noise Density ◽  
Integrated Squared Error ◽  
The Mean ◽  
Parameter Regularization

Consider the model Y = X + Z , where Y is an observable random variable, X is an unobservable random variable with unknown density f , and Z is a random noise independent of X . The density g of Z is known exactly and assumed to be compactly supported. We are interested in estimating the m- fold convolution fm=f*...*f on the basis of independent and identically distributed (i.i.d.) observations Y1,..,Yn drawn from the distribution of Y . Based on the observations as well as the ridge-parameter regularization method, we propose an estimator for the function fm depending on two regularization parameters in which a parameter is given and a parameter must be chosen. The proposed estimator is shown to be consistent with respect to the mean integrated squared error under some conditions of the parameters. After that we derive a convergence rate of the estimator under some additional regular assumptions for the density f .

scholarly journals Transmetric Density Estimation

2016 ◽  
Vol 5 (2) ◽  
pp. 35
Author(s):  
Sigve Hovda
Keyword(s):  
Density Estimation ◽  
Kernel Density Estimation ◽  
Kernel Density ◽  
Convergence Order ◽  
Graphical Display ◽  
Mean Integrated Squared Error ◽  
Squared Error ◽  
Integrated Squared Error ◽  
The Mean ◽  
Convergence Orders

<div>A transmetric is a generalization of a metric that is tailored to properties needed in kernel density estimation.  Using transmetrics in kernel density estimation is an intuitive way to make assumptions on the kernel of the distribution to improve convergence orders and to reduce the number of dimensions in the graphical display.  This framework is required for discussing the estimators that are suggested by Hovda (2014).</div><div> </div><div>Asymptotic arguments for the bias and the mean integrated squared error is difficult in the general case, but some results are given when the transmetric is of the type defined in Hovda (2014).  An important contribution of this paper is that the convergence order can be as high as $4/5$, regardless of the number of dimensions.</div>

Pruning from Adaptive Regularization

1994 ◽  
Vol 6 (6) ◽  
pp. 1223-1232 ◽  
Author(s):  
Lars Kai Hansen ◽  
Carl Edward Rasmussen
Keyword(s):  
Bayesian Methods ◽  
Random Variable ◽  
Bayesian Regularization ◽  
Generalization Error ◽  
Weight Decay ◽  
Adaptive Regularization ◽  
Regularization Parameters ◽  
Noise Limit ◽  
The Mean

Inspired by the recent upsurge of interest in Bayesian methods we consider adaptive regularization. A generalization based scheme for adaptation of regularization parameters is introduced and compared to Bayesian regularization. We show that pruning arises naturally within both adaptive regularization schemes. As model example we have chosen the simplest possible: estimating the mean of a random variable with known variance. Marked similarities are found between the two methods in that they both involve a “noise limit,” below which they regularize with infinite weight decay, i.e., they prune. However, pruning is not always beneficial. We show explicitly that both methods in some cases may increase the generalization error. This corresponds to situations where the underlying assumptions of the regularizer are poorly matched to the environment.

NONLINEAR WAVELET ESTIMATION OF CONDITIONAL DENSITY UNDER LEFT-TRUNCATED AND α-MIXING ASSUMPTIONS

2011 ◽  
Vol 09 (06) ◽  
pp. 989-1023 ◽  
Author(s):  
SI-LI NIU ◽  
HAN-YING LIANG
Keyword(s):  
Asymptotic Expression ◽  
Kernel Estimator ◽  
Conditional Density ◽  
Left Truncation ◽  
Mean Integrated Squared Error ◽  
Wavelet Estimator ◽  
Squared Error ◽  
Integrated Squared Error ◽  
The Mean ◽  
Mixing Sequence

In this paper, we construct a nonlinear wavelet estimator of conditional density function for a left truncation model. We provide an asymptotic expression for the mean integrated squared error (MISE) of the estimator. It is assumed that the lifetime observations form a stationary α-mixing sequence. Unlike for kernel estimator, the MISE expression of the nonlinear wavelet estimator is not affected by the presence of discontinuities in the curves.

scholarly journals Properties of Transmetric Density Estimation

2016 ◽  
Vol 5 (3) ◽  
pp. 63
Author(s):  
Sigve Hovda
Keyword(s):  
Density Estimation ◽  
Kernel Density ◽  
Density Estimator ◽  
Unified Approach ◽  
Squared Error ◽  
Special Cases ◽  
Integrated Squared Error ◽  
The Common ◽  
The Mean ◽  
Convergence Orders

Transmetric density estimation is a generalization of kernel density estimation that is proposed in Hovda(2014) and Hovda (2016), This framework involves the possibility of making assumptions on the kernel of the distribution to improve convergence orders and to reduce the number of dimensions in the graphical display.  In this paper we show that several state-of-the-art nonparametric, semiparametric and even parametric methods are special cases of this formulation, meaning that there is a unified approach. Moreover, it is shown that parameters can be trained using unbiased cross-validation.  When parameter estimation is included, the mean integrated squared error of the transmetric density estimator is lower than for the common kernel density estimator, when the number of dimensions is larger than two.

scholarly journals Optimizing Time Histograms for Non-Poissonian Spike Trains

2011 ◽  
Vol 23 (12) ◽  
pp. 3125-3144 ◽  
Author(s):  
Takahiro Omi ◽  
Shigeru Shinomoto
Keyword(s):  
Goodness Of Fit ◽  
Optimization Method ◽  
Spike Trains ◽  
Time Axis ◽  
Squared Error ◽  
Neurophysiological Studies ◽  
Inhomogeneous Density ◽  
Integrated Squared Error ◽  
The Mean ◽  
The Given

The time histogram is a fundamental tool for representing the inhomogeneous density of event occurrences such as neuronal firings. The shape of a histogram critically depends on the size of the bins that partition the time axis. In most neurophysiological studies, however, researchers have arbitrarily selected the bin size when analyzing fluctuations in neuronal activity. A rigorous method for selecting the appropriate bin size was recently derived so that the mean integrated squared error between the time histogram and the unknown underlying rate is minimized (Shimazaki & Shinomoto, 2007 ). This derivation assumes that spikes are independently drawn from a given rate. However, in practice, biological neurons express non-Poissonian features in their firing patterns, such that the spike occurrence depends on the preceding spikes, which inevitably deteriorate the optimization. In this letter, we revise the method for selecting the bin size by considering the possible non-Poissonian features. Improvement in the goodness of fit of the time histogram is assessed and confirmed by numerically simulated non-Poissonian spike trains derived from the given fluctuating rate. For some experimental data, the revised algorithm transforms the shape of the time histogram from the Poissonian optimization method.

scholarly journals A General Result on the Mean Integrated Squared Error of the Hard Thresholding Wavelet Estimator underα-Mixing Dependence

2014 ◽  
Vol 2014 ◽  
pp. 1-12 ◽  
Author(s):  
Christophe Chesneau
Keyword(s):  
Density Estimation ◽  
General Setting ◽  
Type Model ◽  
Hard Thresholding ◽  
Mean Integrated Squared Error ◽  
Wavelet Estimator ◽  
Squared Error ◽  
Integrated Squared Error ◽  
The Mean ◽  
Weakly Dependent Data

We consider the estimation of an unknown functionffor weakly dependent data (α-mixing) in a general setting. Our contribution is theoretical: we prove that a hard thresholding wavelet estimator attains a sharp rate of convergence under the mean integrated squared error (MISE) over Besov balls without imposing too restrictive assumptions on the model. Applications are given for two types of inverse problems: the deconvolution density estimation and the density estimation in a GARCH-type model, both improve existing results in this dependent context. Another application concerns the regression model with random design.

scholarly journals Bootstrap Selector for the Smoothing Parameter of Beran’s Estimator

2021 ◽  
Vol 7 (1) ◽  
pp. 28
Author(s):  
Rebeca Peláez Suárez ◽  
Ricardo Cao Abad ◽  
Juan M. Vilar Fernández
Keyword(s):  
Confidence Intervals ◽  
Simulation Study ◽  
Smoothing Parameter ◽  
Bootstrap Confidence Intervals ◽  
Bootstrap Approximation ◽  
Mean Integrated Squared Error ◽  
Smoothed Bootstrap ◽  
Squared Error ◽  
Integrated Squared Error ◽  
The Mean

This work proposes a resampling technique to approximate the smoothing parameter of Beran’s estimator. It is based on resampling by the smoothed bootstrap and minimising the bootstrap approximation of the mean integrated squared error to find the bootstrap bandwidth. The behaviour of this method has been tested by simulation on several models. Bootstrap confidence intervals are also addressed in this research and their performance is analysed in the simulation study.

Sign in / Sign up

Export Citation Format

Share Document