power divergence
Recently Published Documents


TOTAL DOCUMENTS

129
(FIVE YEARS 33)

H-INDEX

13
(FIVE YEARS 2)

Symmetry ◽  
2021 ◽  
Vol 13 (11) ◽  
pp. 2067
Author(s):  
Shuji Ando ◽  
Hikaru Hoshi ◽  
Aki Ishii ◽  
Sadao Tomizawa

The double symmetry model satisfies both the symmetry and point symmetry models simultaneously. To measure the degree of deviation from the double symmetry model, a two-dimensional index that can concurrently measure the degree of deviation from symmetry and point symmetry is considered. This two-dimensional index is constructed by combining two existing indexes. Although the existing indexes are constructed using power divergence, the existing two-dimensional index that can concurrently measure both symmetries is constructed using only Kullback-Leibler information, which is a special case of power divergence. Previous studies note the importance of using several indexes of divergence to compare the degrees of deviation from a model for several square contingency tables. This study, therefore, proposes a two-dimensional index based on power divergence in order to measure deviation from double symmetry for square contingency tables. Numerical examples show the utility of the proposed two-dimensional index using two datasets.


Symmetry ◽  
2021 ◽  
Vol 13 (11) ◽  
pp. 2031
Author(s):  
Tomotaka Momozaki ◽  
Tomoyuki Nakagawa ◽  
Aki Ishii ◽  
Yusuke Saigusa ◽  
Sadao Tomizawa

In the analysis of two-way contingency tables, the degree of departure from independence is measured using measures of association between row and column variables (e.g., Yule’s coefficients of association and of colligation, Cramér’s coefficient, and Goodman and Kruskal’s coefficient). On the other hand, in the analysis of square contingency tables with the same row and column classifications, we are interested in measuring the degree of departure from symmetry rather than independence. Over past years, many studies have proposed various types of indexes based on their power divergence (or diversity index) to represent the degree of departure from symmetry. This study proposes a two-dimensional index to measure the degree of departure from symmetry in terms of the log odds of each symmetric cell with respect to the main diagonal of the table. By measuring the degree of departure from symmetry in terms of the log odds of each symmetric cell, the analysis results are easier to interpret than existing indexes. Numerical experiments show the utility of the proposed two-dimensional index. We show the usefulness of the proposed two-dimensional index by using real data.


Entropy ◽  
2021 ◽  
Vol 23 (9) ◽  
pp. 1147
Author(s):  
Shonosuke Sugasawa ◽  
Shouto Yonekura

Although robust divergence, such as density power divergence and γ-divergence, is helpful for robust statistical inference in the presence of outliers, the tuning parameter that controls the degree of robustness is chosen in a rule-of-thumb, which may lead to an inefficient inference. We here propose a selection criterion based on an asymptotic approximation of the Hyvarinen score applied to an unnormalized model defined by robust divergence. The proposed selection criterion only requires first and second-order partial derivatives of an assumed density function with respect to observations, which can be easily computed regardless of the number of parameters. We demonstrate the usefulness of the proposed method via numerical studies using normal distributions and regularized linear regression.


Entropy ◽  
2021 ◽  
Vol 23 (8) ◽  
pp. 1005
Author(s):  
Ryosuke Kasai ◽  
Yusaku Yamaguchi ◽  
Takeshi Kojima ◽  
Omar M. Abou Al-Ola ◽  
Tetsuya Yoshinaga

The problem of tomographic image reconstruction can be reduced to an optimization problem of finding unknown pixel values subject to minimizing the difference between the measured and forward projections. Iterative image reconstruction algorithms provide significant improvements over transform methods in computed tomography. In this paper, we present an extended class of power-divergence measures (PDMs), which includes a large set of distance and relative entropy measures, and propose an iterative reconstruction algorithm based on the extended PDM (EPDM) as an objective function for the optimization strategy. For this purpose, we introduce a system of nonlinear differential equations whose Lyapunov function is equivalent to the EPDM. Then, we derive an iterative formula by multiplicative discretization of the continuous-time system. Since the parameterized EPDM family includes the Kullback–Leibler divergence, the resulting iterative algorithm is a natural extension of the maximum-likelihood expectation-maximization (MLEM) method. We conducted image reconstruction experiments using noisy projection data and found that the proposed algorithm outperformed MLEM and could reconstruct high-quality images that were robust to measured noise by properly selecting parameters.


2021 ◽  
pp. 096228022110172
Author(s):  
Abhik Ghosh ◽  
Magne Thoresen

Variable selection in ultra-high dimensional regression problems has become an important issue. In such situations, penalized regression models may face computational problems and some pre-screening of the variables may be necessary. A number of procedures for such pre-screening has been developed; among them the Sure Independence Screening (SIS) enjoys some popularity. However, SIS is vulnerable to outliers in the data, and in particular in small samples this may lead to faulty inference. In this paper, we develop a new robust screening procedure. We build on the density power divergence (DPD) estimation approach and introduce DPD-SIS and its extension iterative DPD-SIS. We illustrate the behavior of the methods through extensive simulation studies and show that they are superior to both the original SIS and other robust methods when there are outliers in the data. Finally, we illustrate its use in a study on regulation of lipid metabolism.


Entropy ◽  
2021 ◽  
Vol 23 (3) ◽  
pp. 367
Author(s):  
Byungsoo Kim ◽  
Sangyeol Lee ◽  
Dongwon Kim

In the integer-valued generalized autoregressive conditional heteroscedastic (INGARCH) models, parameter estimation is conventionally based on the conditional maximum likelihood estimator (CMLE). However, because the CMLE is sensitive to outliers, we consider a robust estimation method for bivariate Poisson INGARCH models while using the minimum density power divergence estimator. We demonstrate the proposed estimator is consistent and asymptotically normal under certain regularity conditions. Monte Carlo simulations are conducted to evaluate the performance of the estimator in the presence of outliers. Finally, a real data analysis using monthly count series of crimes in New South Wales and an artificial data example are provided as an illustration.


Sign in / Sign up

Export Citation Format

Share Document