For sequences of i.i.d. random variables whose common tail 1 – F is regularly varying at infinity wtih an unknown index –α < 0, it is well known that the Hill estimator is consistent for α–1 and usually asymptotically normally distributed. However, because the Hill estimator is a function of k = k(n), the number of upper order statistics used and which is only subject to the conditions k →∞, k/n → 0, its use in practice is problematic since there are few reliable guidelines about how to choose k. The purpose of this paper is to make the use of the Hill estimator more reliable through an averaging technique which reduces the asymptotic variance. As a direct result the range in which the smoothed estimator varies as a function of k decreases and the successful use of the esimator is made less dependent on the choice of k. A tail empirical process approach is used to prove the weak convergence of a process closely related to the Hill estimator. The smoothed version of the Hill estimator is a functional of the tail empirical process.
Rapid variation with remainder and rates of convergence