A comparison between robust information theoretic estimator and asymptotic maximum likelihood estimator for misspecified model

2018 ◽  
Author(s):  
Xin Zhou ◽  
Steven Kay
Keyword(s):  
Maximum Likelihood ◽  
Maximum Likelihood Estimator ◽  
Likelihood Estimator ◽  
Information Theoretic ◽  
Misspecified Model

Large-sample confidence intervals of information-theoretic measures in linguistics

2020 ◽  
Vol 6 (1) ◽  
pp. 19-54
Author(s):  
Ryan Ka Yau Lai ◽  
Youngah Do
Keyword(s):  
Maximum Likelihood ◽  
Corpus Linguistics ◽  
Delta Method ◽  
Confidence Bounds ◽  
Likelihood Estimator ◽  
Information Theoretic ◽  
Leibler Divergence ◽  
Information Theoretic Measures ◽  
Data Points ◽  
Measure Of Uncertainty

This article explores a method of creating confidence bounds for information-theoretic measures in linguistics, such as entropy, Kullback-Leibler Divergence (KLD), and mutual information. We show that a useful measure of uncertainty can be derived from simple statistical principles, namely the asymptotic distribution of the maximum likelihood estimator (MLE) and the delta method. Three case studies from phonology and corpus linguistics are used to demonstrate how to apply it and examine its robustness against common violations of its assumptions in linguistics, such as insufficient sample size and non-independence of data points.

The Comparison Between the Bayes Estimator and the Maximum Likelihood Estimator of the Reliability Function for Negative Exponential Distribution

2018 ◽  
pp. 439
Author(s):  
Hazim Mansour Gorgees ◽  
Bushra Abdualrasool Ali ◽  
Raghad Ibrahim Kathum
Keyword(s):  
Maximum Likelihood ◽  
Maximum Likelihood Estimator ◽  
Exponential Distribution ◽  
Reliability Function ◽  
Bayes Estimator ◽  
Likelihood Estimator ◽  
Monte Carlo Simulation Technique ◽  
Negative Exponential Distribution ◽  
Negative Exponential ◽  
Better Than

     In this paper, the maximum likelihood estimator and the Bayes estimator of the reliability function for negative exponential distribution has been derived, then a Monte –Carlo simulation technique was employed to compare the performance of such estimators. The integral mean square error (IMSE) was used as a criterion for this comparison. The simulation results displayed that the Bayes estimator performed better than the maximum likelihood estimator for different samples sizes.

scholarly journals Transforming variables to central normality

2021 ◽  
Author(s):  
Jakob Raymaekers ◽  
Peter J. Rousseeuw
Keyword(s):  
Maximum Likelihood ◽  
Maximum Likelihood Estimator ◽  
Simulation Study ◽  
Real Data ◽  
Data Sets ◽  
Transformation Parameter ◽  
Likelihood Estimator ◽  
Extensive Simulation ◽  
Highly Sensitive

AbstractMany real data sets contain numerical features (variables) whose distribution is far from normal (Gaussian). Instead, their distribution is often skewed. In order to handle such data it is customary to preprocess the variables to make them more normal. The Box–Cox and Yeo–Johnson transformations are well-known tools for this. However, the standard maximum likelihood estimator of their transformation parameter is highly sensitive to outliers, and will often try to move outliers inward at the expense of the normality of the central part of the data. We propose a modification of these transformations as well as an estimator of the transformation parameter that is robust to outliers, so the transformed data can be approximately normal in the center and a few outliers may deviate from it. It compares favorably to existing techniques in an extensive simulation study and on real data.

Covariance matrix of the bias-corrected maximum likelihood estimator in generalized linear models

2013 ◽  
Vol 55 (3) ◽  
pp. 643-652
Author(s):  
Gauss M. Cordeiro ◽  
Denise A. Botter ◽  
Alexsandro B. Cavalcanti ◽  
Lúcia P. Barroso
Keyword(s):  
Maximum Likelihood ◽  
Maximum Likelihood Estimator ◽  
Covariance Matrix ◽  
Generalized Linear Models ◽  
Linear Models ◽  
Likelihood Estimator

Large deviations and Berry–Esseen inequalities for estimators in nonhomogeneous diffusion driven by fractional Brownian motion

2020 ◽  
Vol 28 (3) ◽  
pp. 183-196
Author(s):  
Kouacou Tanoh ◽  
Modeste N’zi ◽  
Armel Fabrice Yodé
Keyword(s):  
Differential Equation ◽  
Brownian Motion ◽  
Maximum Likelihood ◽  
Large Deviations ◽  
Stochastic Differential Equation ◽  
Fractional Brownian Motion ◽  
Maximum Likelihood Estimator ◽  
Bayes Estimator ◽  
Likelihood Estimator

AbstractWe are interested in bounds on the large deviations probability and Berry–Esseen type inequalities for maximum likelihood estimator and Bayes estimator of the parameter appearing linearly in the drift of nonhomogeneous stochastic differential equation driven by fractional Brownian motion.

Sign in / Sign up

Export Citation Format

Share Document