Hostname: page-component-cd9895bd7-gvvz8 Total loading time: 0 Render date: 2024-12-26T07:26:48.801Z Has data issue: false hasContentIssue false
  • English
  • Français

UNIFORM ASYMPTOTICS AND CONFIDENCE REGIONS BASED ON THE ADAPTIVE LASSO WITH PARTIALLY CONSISTENT TUNING

Published online by Cambridge University Press:  08 April 2021

Nicolai Amann  and
Ulrike Schneider
Nicolai Amann
Affiliation:
University of Vienna
Ulrike Schneider*
Affiliation:
TU Wien
*
Address correspondence to Ulrike Schneider, Institute of Statistics and Mathematical Methods in Economics, TU Wien, Wiedner Hauptstraße 8/E105-2, A-1040 Vienna, Austria; e-mail: ulrike.schneider@tuwien.ac.at.
Rights & Permissions [Opens in a new window]

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the ‘Save PDF’ action button.

We consider the adaptive Lasso estimator with componentwise tuning in the framework of a low-dimensional linear regression model. In our setting, at least one of the components is penalized at the rate of consistent model selection and certain components may not be penalized at all. We perform a detailed study of the consistency properties and the asymptotic distribution which includes the effects of componentwise tuning within a so-called moving-parameter framework. These results enable us to explicitly provide a set $\mathcal {M}$ such that every open superset acts as a confidence set with uniform asymptotic coverage equal to 1, whereas removing an arbitrarily small open set along the boundary yields a confidence set with uniform asymptotic coverage equal to 0. The shape of the set $\mathcal {M}$ depends on the regressor matrix as well as the deviations within the componentwise tuning parameters. Our findings can be viewed as a broad generalization of Pötscher and Schneider (2009, Journal of Statistical Planning and Inference 139, 2775–2790; 2010, Electronic Journal of Statistics 4, 334–360), who considered distributional properties and confidence intervals based on components of the adaptive Lasso estimator for the case of orthogonal regressors.

Type
ARTICLES
Information
Econometric Theory , Volume 39 , Issue 6: SPECIAL ISSUE IN HONOR OF BENEDIKT M PÖTSCHER , December 2023 , pp. 1097 - 1122
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
© The Author(s), 2021. Published by Cambridge University Press

References

REFERENCES

Caner, M. & Fan, M. (2015) Hybrid generalized empirical likelihood estimators: Instrument selection with adaptive Lasso. Journal of Econometrics 187, 256–274.CrossRefGoogle Scholar
DeGregorio, A. & Iacus, S. (2012) Adaptive Lasso-type estimation for multivariate diffusion processes. Econometric Theory 28, 838–860.CrossRefGoogle Scholar
Geyer, C. (1996) On the asymptotics of convex stochastic optimization. Unpublished manuscript.Google Scholar
Huang, J., Ma, S., & Zhang, C.-H. (2008) Adaptive Lasso for sparse high-dimensional regression models. Statistical Science 18, 1603–1618.Google Scholar
Kock, A.B. (2016) Consistent and conservative model selection with the adaptive LASSO in stationary and nonstationary autoregressions. Econometric Theory 32, 243–259.CrossRefGoogle Scholar
Kock, A.B. & Callot, L. (2015) Oracle inequalities for high dimensional vector autoregressions. Journal of Econometrics 186, 325–344.CrossRefGoogle Scholar
Medeiros, M.C. & Mendes, E.F. (2017) Adaptive LASSO estimation for ARDL models with GARCH innovations. Econometric Reviews 36, 622–637.CrossRefGoogle Scholar
Pollard, D. (1991) Asymptotics for least absolute deviation regression estimators. Econometric Theory 7, 186–199.CrossRefGoogle Scholar
Pötscher, B.M. (2009) Confidence sets based on sparse estimators are necessarily large. Sankya 71-A, 1–18.Google Scholar
Pötscher, B.M. & Schneider, U. (2009) On the distribution of the adaptive LASSO estimator. Journal of Statistical Planning and Inference 139, 2775–2790.CrossRefGoogle Scholar
Pötscher, B.M. & Schneider, U. (2010) Confidence sets based on penalized maximum likelihood estimators in Gaussian regression. Electronic Journal of Statistics 4, 334–360.CrossRefGoogle Scholar
Tibshirani, R. (1996) Regression shrinkage and selection via the Lasso. Journal of the Royal Statistical Society Series B 58, 267–288.Google Scholar
Zou, H. (2006) The adaptive Lasso and its oracle properties. Journal of the American Statistical Association 101, 1418–1429.CrossRefGoogle Scholar