Published online by Cambridge University Press: 05 June 2012
One purpose of asymptotic statistics is to compare the performance of estimators for large sample sizes. This chapter discusses asymptotic lower bounds for estimation in locally asymptotically normal models. These show, among others, in what sense maximum likelihood estimators are asymptotically efficient.
Asymptotic Concentration
Suppose the problem is to estimate based on observations from a model governed by the parameter (). What is the best asymptotic performance of an estimator sequence Tn for
To simplify the situation, we shall in most of this chapter assume that the sequence converges in distribution under every possible value of. Next we rephrase the question as: What are the best possible limit distributions? In analogy with the CramerRao theorem a “best” limit distribution is referred to as an asymptotic lower bound. Under certain restrictions the normal distribution with mean zero and covariance the inverse Fisher information is an asymptotic lower bound for estimating in a smooth parametric model. This is the main result of this chapter, but it needs to be qualified.
The notion of a “best” limit distribution is understood in terms of concentration. If the limit distribution is a priori assumed to be normal, then this is usually translated into asymptotic unbiasedness and minimum variance. The statement that converges in distribution to a distribution can be roughly understood in the sense that eventually Tn is approximately normally distributed with mean and variance given by
Because Tn is meant to estimate, optimal choices for the asymptotic mean and variance are and variance as small as possible. These choices ensure not only that the asymptotic mean square error is small but also that the limit distribution is maximally concentrated near zero. For instance, the probability of the interval is maximized by choosingminimal.
We do not wish to assume a priori that the estimators are asymptotically normal. That normal limits are best will actually be an interesting conclusion.
To save this book to your Kindle, first ensure no-reply@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.
Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.
Find out more about the Kindle Personal Document Service.
To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.
To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.