scholarly journals Calibration of the empirical likelihood for high-dimensional data

2012 ◽  
Vol 65 (3) ◽  
pp. 529-550 ◽  
Author(s):  
Yukun Liu ◽  
Changliang Zou ◽  
Zhaojun Wang
Keyword(s):  
Empirical Likelihood ◽  
High Dimensional Data ◽  
High Dimensional

scholarly journals Linear Kernel Tests via Empirical Likelihood for High-Dimensional Data

2019 ◽  
Vol 33 ◽  
pp. 3454-3461 ◽  
Author(s):  
Lizhong Ding ◽  
Zhi Liu ◽  
Yu Li ◽  
Shizhong Liao ◽  
Yong Liu ◽  
...  
Keyword(s):  
Empirical Likelihood ◽  
Null Hypothesis ◽  
Goodness Of Fit ◽  
High Dimensional Data ◽  
High Dimensional ◽  
Test Problems ◽  
Limiting Distributions ◽  
Goodness Of Fit Test ◽  
Linear Statistics ◽  
Sample Test

We propose a framework for analyzing and comparing distributions without imposing any parametric assumptions via empirical likelihood methods. Our framework is used to study two fundamental statistical test problems: the two-sample test and the goodness-of-fit test. For the two-sample test, we need to determine whether two groups of samples are from different distributions; for the goodness-of-fit test, we examine how likely it is that a set of samples is generated from a known target distribution. Specifically, we propose empirical likelihood ratio (ELR) statistics for the two-sample test and the goodness-of-fit test, both of which are of linear time complexity and show higher power (i.e., the probability of correctly rejecting the null hypothesis) than the existing linear statistics for high-dimensional data. We prove the nonparametric Wilks’ theorems for the ELR statistics, which illustrate that the limiting distributions of the proposed ELR statistics are chi-square distributions. With these limiting distributions, we can avoid bootstraps or simulations to determine the threshold for rejecting the null hypothesis, which makes the ELR statistics more efficient than the recently proposed linear statistic, finite set Stein discrepancy (FSSD). We also prove the consistency of the ELR statistics, which guarantees that the test power goes to 1 as the number of samples goes to infinity. In addition, we experimentally demonstrate and theoretically analyze that FSSD has poor performance or even fails to test for high-dimensional data. Finally, we conduct a series of experiments to evaluate the performance of our ELR statistics as compared to state-of-the-art linear statistics.

A Fast Clustering Algorithm for Large-scale and High Dimensional Data

2009 ◽  
Vol 35 (7) ◽  
pp. 859-866
Author(s):  
Ming LIU ◽  
Xiao-Long WANG ◽  
Yuan-Chao LIU
Keyword(s):  
Large Scale ◽  
Clustering Algorithm ◽  
High Dimensional Data ◽  
High Dimensional

scholarly journals Mean Empirical Likelihood Inference for Response Mean with Data Missing at Random

2020 ◽  
Vol 2020 ◽  
pp. 1-12
Author(s):  
Hanji He ◽  
Guangming Deng
Keyword(s):  
Empirical Likelihood ◽  
Missing At Random ◽  
Confidence Regions ◽  
Likelihood Inference ◽  
High Dimensional ◽  
Finite Sample ◽  
The Mean ◽  
Data Missing ◽  
Consistency And Asymptotic Normality ◽  
The Impact

We extend the mean empirical likelihood inference for response mean with data missing at random. The empirical likelihood ratio confidence regions are poor when the response is missing at random, especially when the covariate is high-dimensional and the sample size is small. Hence, we develop three bias-corrected mean empirical likelihood approaches to obtain efficient inference for response mean. As to three bias-corrected estimating equations, we get a new set by producing a pairwise-mean dataset. The method can increase the size of the sample for estimation and reduce the impact of the dimensional curse. Consistency and asymptotic normality of the maximum mean empirical likelihood estimators are established. The finite sample performance of the proposed estimators is presented through simulation, and an application to the Boston Housing dataset is shown.

Approximate Cluster Heat Maps of Large High-Dimensional Data

2018 ◽  
Author(s):  
Punit Rathore ◽  
James C. Bezdek ◽  
Dheeraj Kumar ◽  
Sutharshan Rajasegarar ◽  
Marimuthu Palaniswami
Keyword(s):  
High Dimensional Data ◽  
High Dimensional ◽  
Heat Maps
Sign in / Sign up

Export Citation Format

Share Document