Alternative Bias Approximations in Regressions with a Lagged-Dependent Variable

1993 ◽  
Vol 9 (1) ◽  
pp. 62-80 ◽  
Author(s):  
Jan F. Kiviet ◽  
Garry D.A. Phillips
Keyword(s):  
Least Squares ◽  
Mean Squared Error ◽  
Multiple Linear Regression Model ◽  
Small Sample ◽  
Large Sample ◽  
Squared Error ◽  
Coefficient Vector ◽  
Lagged Dependent Variable ◽  
Biased Estimators ◽  
The One

The small sample bias of the least-squares coefficient estimator is examined in the dynamic multiple linear regression model with normally distributed whitenoise disturbances and an arbitrary number of regressors which are all exogenous except for the one-period lagged-dependent variable. We employ large sample (T → ∞) and small disturbance (σ → 0) asymptotic theory and derive and compare expressions to O(T−1) and to O(σ2), respectively, for the bias in the least-squares coefficient vector. In some simulations and for an empirical example, we examine the mean (squared) error of these expressions and of corrected estimation procedures that yield estimates that are unbiased to O(T−l) and to O(σ2), respectively. The large sample approach proves to be superior, easily applicable, and capable of generating more efficient and less biased estimators.

scholarly journals Dynamic Regression and Filtered Data Series: A Laplace Approximation to the Effects of Filtering in Small Samples

1996 ◽  
Vol 12 (3) ◽  
pp. 432-457 ◽  
Author(s):  
Eric Ghysels ◽  
Offer Lieberman
Keyword(s):  
Regression Model ◽  
Quadratic Forms ◽  
Mean Squared Error ◽  
Small Sample ◽  
Data Series ◽  
Finite Sample ◽  
Sample Bias ◽  
Squared Error ◽  
Lagged Dependent Variable ◽  
Dynamic Regression Model

It is common for an applied researcher to use filtered data, like seasonally adjusted series, for instance, to estimate the parameters of a dynamic regression model. In this paper, we study the effect of (linear) filters on the distribution of parameters of a dynamic regression model with a lagged dependent variable and a set of exogenous regressors. So far, only asymptotic results are available. Our main interest is to investigate the effect of filtering on the small sample bias and mean squared error. In general, these results entail a numerical integration of derivatives of the joint moment generating function of two quadratic forms in normal variables. The computation of these integrals is quite involved. However, we take advantage of the Laplace approximations to the bias and mean squared error, which substantially reduce the computational burden, as they yield relatively simple analytic expressions. We obtain analytic formulae for approximating the effect of filtering on the finite sample bias and mean squared error. We evaluate the adequacy of the approximations by comparison with Monte Carlo simulations, using the Census X-11 filter as a specific example

scholarly journals Comparison of Two Estimators of the Regression Coefficient Vector Under Pitman’s Closeness Criterion

2020 ◽  
Author(s):  
Jibo Wu
Keyword(s):  
Least Squares ◽  
Mean Squared Error ◽  
Ordinary Least Squares ◽  
Least Squares Estimator ◽  
Squared Error ◽  
Ordinary Least Squares Estimator ◽  
Mixed Estimator ◽  
Coefficient Vector ◽  
The Mean ◽  
Pitman’S Closeness Criterion

Schaffrin and Toutenburg [1] proposed a weighted mixed estimation based on the sample information and the stochastic prior information, and they also show that the weighted mixed estimator is superior to the ordinary least squares estimator under the mean squared error criterion. However, there has no paper to discuss the performance of the two estimators under the Pitman’s closeness criterion. This paper presents the comparison of the weighted mixed estimator and the ordinary least squares estimator using the Pitman’s closeness criterion. A simulation study is performed to illustrate the performance of the weighted mixed estimator and the ordinary least squares estimator under the Pitman’s closeness criterion.

Use of reflectance spectroscopy to estimate the organic carbon and CaCO3 contents of soils

2012 ◽  
Vol 61 (2) ◽  
pp. 277-290 ◽  
Author(s):  
Ádám Csorba ◽  
Vince Láng ◽  
László Fenyvesi ◽  
Erika Michéli
Keyword(s):  
Organic Carbon ◽  
Least Squares ◽  
Partial Least Squares ◽  
Partial Least Squares Regression ◽  
Mean Squared Error ◽  
Reflectance Spectroscopy ◽  
Least Squares Regression ◽  
Root Mean Squared Error ◽  
Squared Error

Napjainkban egyre nagyobb igény mutatkozik olyan technológiák és módszerek kidolgozására és alkalmazására, melyek lehetővé teszik a gyors, költséghatékony és környezetbarát talajadat-felvételezést és kiértékelést. Ezeknek az igényeknek felel meg a reflektancia spektroszkópia, mely az elektromágneses spektrum látható (VIS) és közeli infravörös (NIR) tartományában (350–2500 nm) végzett reflektancia-mérésekre épül. Figyelembe véve, hogy a talajokról felvett reflektancia spektrum információban nagyon gazdag, és a vizsgált tartományban számos talajalkotó rendelkezik karakterisztikus spektrális „ujjlenyomattal”, egyetlen görbéből lehetővé válik nagyszámú, kulcsfontosságú talajparaméter egyidejű meghatározása. Dolgozatunkban, a reflektancia spektroszkópia alapjaira helyezett, a talajok ösz-szetételének meghatározását célzó módszertani fejlesztés első lépéseit mutatjuk be. Munkánk során talajok szervesszén- és CaCO3-tartalmának megbecslését lehetővé tévő többváltozós matematikai-statisztikai módszerekre (részleges legkisebb négyzetek módszere, partial least squares regression – PLSR) épülő prediktív modellek létrehozását és tesztelését végeztük el. A létrehozott modellek tesztelése során megállapítottuk, hogy az eljárás mindkét talajparaméter esetében magas R2értéket [R2(szerves szén) = 0,815; R2(CaCO3) = 0,907] adott. A becslés pontosságát jelző közepes négyzetes eltérés (root mean squared error – RMSE) érték mindkét paraméter esetében közepesnek mondható [RMSE (szerves szén) = 0,467; RMSE (CaCO3) = 3,508], mely a reflektancia mérési előírások standardizálásával jelentősen javítható. Vizsgálataink alapján arra a következtetésre jutottunk, hogy a reflektancia spektroszkópia és a többváltozós kemometriai eljárások együttes alkalmazásával, gyors és költséghatékony adatfelvételezési és -értékelési módszerhez juthatunk.

Estimating an Autoregressive Current Effects Model of Sales Response when Observations are Aggregated over Time: Least Squares versus Maximum Likelihood

1988 ◽  
Vol 25 (3) ◽  
pp. 301-307
Author(s):  
Wilfried R. Vanhonacker
Keyword(s):  
Maximum Likelihood ◽  
Least Squares ◽  
Serial Correlation ◽  
Mean Squared Error ◽  
Generalized Least Squares ◽  
Parameter Estimates ◽  
Squared Error ◽  
Positive Serial Correlation ◽  
Serial Correlation Coefficient ◽  
Over Time

Estimating autoregressive current effects models is not straightforward when observations are aggregated over time. The author evaluates a familiar iterative generalized least squares (IGLS) approach and contrasts it to a maximum likelihood (ML) approach. Analytic and numerical results suggest that (1) IGLS and ML provide good estimates for the response parameters in instances of positive serial correlation, (2) ML provides superior (in mean squared error) estimates for the serial correlation coefficient, and (3) IGLS might have difficulty in deriving parameter estimates in instances of negative serial correlation.

OPTIMAL BANDWIDTH CHOICE FOR ESTIMATION OF INVERSE CONDITIONAL–DENSITY–WEIGHTED EXPECTATIONS

2009 ◽  
Vol 26 (1) ◽  
pp. 94-118 ◽  
Author(s):  
David Tomás Jacho-Chávez
Keyword(s):  
Mean Squared Error ◽  
Kernel Estimator ◽  
Random Variable ◽  
Small Sample ◽  
Conditional Density ◽  
Monte Carlo Experiment ◽  
Continuous Random Variable ◽  
Optimal Bandwidth ◽  
Squared Error ◽  
Error Expansion

This paper characterizes the bandwidth value (h) that is optimal for estimating parameters of the form $\eta \, = \,E\left[ {\omega /f_{V|U} \left({V|U} \right)} \right]$, where the conditional density of a scalar continuous random variable V, given a random vector U, $f_{V|U} $, is replaced by its kernel estimator. That is, the parameter η is the expectation of ω inversely weighted by $f_{V|U} $, and it is the building block of various semiparametric estimators already proposed in the literature such as Lewbel (1998), Lewbel (2000b), Honoré and Lewbel (2002), Khan and Lewbel (2007), and Lewbel (2007). The optimal bandwidth is derived by minimizing the leading terms of a second-order mean squared error expansion of an in-probability approximation of the resulting estimator with respect to h. The expansion also demonstrates that the bandwidth can be chosen on the basis of bias alone, and that a simple “plug-in” estimator for the optimal bandwidth can be constructed. Finally, the small sample performance of our proposed estimator of the optimal bandwidth is assessed by a Monte Carlo experiment.

scholarly journals Improving on Adjusted R-Squared

2019 ◽  
Author(s):  
Julian Karch
Keyword(s):  
Mean Squared Error ◽  
Multiple Linear Regression Model ◽  
R Package ◽  
Model Fit ◽  
Fast Computation ◽  
Unbiased Estimators ◽  
Squared Error ◽  
Optimal Estimator ◽  
Optimality Properties ◽  
Variance Explained

The amount of variance explained is widely reported for quantifying the model fit of a multiple linear regression model. The default adjusted R-squared estimator has the disadvantage of not being unbiased. The theoretically optimal Olkin-Pratt estimator is unbiased. Despite this, it is not being used due to being difficult to compute. In this paper, I present an algorithm for the exact and fast computation of the Olkin-Pratt estimator, which enables using it. I compare the Olkin-Pratt, the adjusted R-squared, and 18 alternative estimators using a simulation study. The metrics I use for comparison closely resemble established theoretical optimality properties. Importantly, the exact Olkin-Pratt estimator is shown to be optimal under the standard metric, which considers an estimator optimal if it has the least mean squared error among all unbiased estimators. Under the important alternative metric, which aims for the estimator with the lowest mean squared error, no optimal estimator could be identified. Based on these results, I carefully provide recommendations on when to use which estimator, which first and foremost depends on the choice of which metric is deemed most appropriate. If such a choice is infeasible, I recommend using the exact Olkin-Pratt instead of the default adjusted R-squared estimator. To facilitate this, I provide the R package altR2, which implements the Olkin-Pratt estimator as well as all other estimators.

scholarly journals A new modified ridge-type estimator for the beta regression model: simulation and application

2021 ◽  
Vol 7 (1) ◽  
pp. 1035-1057
Author(s):  
Muhammad Nauman Akram ◽  
◽  
Muhammad Amin ◽  
Ahmed Elhassanein ◽  
Muhammad Aman Ullah ◽  
...  
Keyword(s):  
Regression Model ◽  
Mean Squared Error ◽  
Model Simulation ◽  
Beta Regression ◽  
Explanatory Variables ◽  
Squared Error ◽  
The Matrix ◽  
Biased Estimators ◽  
Highly Correlated ◽  
Beta Regression Model

<abstract> <p>The beta regression model has become a popular tool for assessing the relationships among chemical characteristics. In the BRM, when the explanatory variables are highly correlated, then the maximum likelihood estimator (MLE) does not provide reliable results. So, in this study, we propose a new modified beta ridge-type (MBRT) estimator for the BRM to reduce the effect of multicollinearity and improve the estimation. Initially, we show analytically that the new estimator outperforms the MLE as well as the other two well-known biased estimators i.e., beta ridge regression estimator (BRRE) and beta Liu estimator (BLE) using the matrix mean squared error (MMSE) and mean squared error (MSE) criteria. The performance of the MBRT estimator is assessed using a simulation study and an empirical application. Findings demonstrate that our proposed MBRT estimator outperforms the MLE, BRRE and BLE in fitting the BRM with correlated explanatory variables.</p> </abstract>

Sign in / Sign up

Export Citation Format

Share Document