On the ‘optimal’ density power divergence tuning parameter

Author(s):  
Sancharee Basak ◽  
Ayanendranath Basu ◽  
M. C. Jones
Entropy ◽  
2020 ◽  
Vol 22 (3) ◽  
pp. 270
Author(s):  
Elena Castilla ◽  
Nirian Martín ◽  
Leandro Pardo ◽  
Konstantinos Zografos

This paper presents a model selection criterion in a composite likelihood framework based on density power divergence measures and in the composite minimum density power divergence estimators, which depends on an tuning parameter α . After introducing such a criterion, some asymptotic properties are established. We present a simulation study and two numerical examples in order to point out the robustness properties of the introduced model selection criterion.


Entropy ◽  
2021 ◽  
Vol 23 (9) ◽  
pp. 1147
Author(s):  
Shonosuke Sugasawa ◽  
Shouto Yonekura

Although robust divergence, such as density power divergence and γ-divergence, is helpful for robust statistical inference in the presence of outliers, the tuning parameter that controls the degree of robustness is chosen in a rule-of-thumb, which may lead to an inefficient inference. We here propose a selection criterion based on an asymptotic approximation of the Hyvarinen score applied to an unnormalized model defined by robust divergence. The proposed selection criterion only requires first and second-order partial derivatives of an assumed density function with respect to observations, which can be easily computed regardless of the number of parameters. We demonstrate the usefulness of the proposed method via numerical studies using normal distributions and regularized linear regression.


Entropy ◽  
2020 ◽  
Vol 22 (4) ◽  
pp. 399 ◽  
Author(s):  
Marco Riani ◽  
Anthony C. Atkinson ◽  
Aldo Corbellini ◽  
Domenico Perrotta

Minimum density power divergence estimation provides a general framework for robust statistics, depending on a parameter α , which determines the robustness properties of the method. The usual estimation method is numerical minimization of the power divergence. The paper considers the special case of linear regression. We developed an alternative estimation procedure using the methods of S-estimation. The rho function so obtained is proportional to one minus a suitably scaled normal density raised to the power α . We used the theory of S-estimation to determine the asymptotic efficiency and breakdown point for this new form of S-estimation. Two sets of comparisons were made. In one, S power divergence is compared with other S-estimators using four distinct rho functions. Plots of efficiency against breakdown point show that the properties of S power divergence are close to those of Tukey’s biweight. The second set of comparisons is between S power divergence estimation and numerical minimization. Monitoring these two procedures in terms of breakdown point shows that the numerical minimization yields a procedure with larger robust residuals and a lower empirical breakdown point, thus providing an estimate of α leading to more efficient parameter estimates.


Test ◽  
2008 ◽  
Vol 18 (2) ◽  
pp. 316-341 ◽  
Author(s):  
Sangyeol Lee ◽  
Junmo Song

Sankhya B ◽  
2013 ◽  
Vol 75 (1) ◽  
pp. 16-28 ◽  
Author(s):  
Sujayendu Patra ◽  
Avijit Maji ◽  
Ayanendranath Basu ◽  
Leandro Pardo

Sign in / Sign up

Export Citation Format

Share Document