Hostname: page-component-cd9895bd7-8ctnn Total loading time: 0 Render date: 2024-12-27T07:26:11.140Z Has data issue: false hasContentIssue false
  • English
  • Français

On the convergence rates of some adaptive Markov chain Monte Carlo algorithms

Part of: Markov processes Probabilistic methods, simulation and stochastic differential equations

Published online by Cambridge University Press:  30 March 2016

Yves Atchadé  and
Yizao Wang
Yves Atchadé*
Affiliation:
University of Michigan, Ann Arbor
Yizao Wang*
Affiliation:
University of Cincinnati
*
∗ Postal address: Department of Statistics, University of Michigan, 439 West Hall, 1085 South University, Ann Arbor, MI 48109-1107, USA.
∗∗ Postal address: Department of Mathematical Sciences, University of Cincinnati, 2815 Commons Way, Cincinnati OH 45221, USA. Email address: yizao.wang@uc.edu
Rights & Permissions [Opens in a new window]

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the ‘Save PDF’ action button.

In this paper we study the mixing time of certain adaptive Markov chain Monte Carlo (MCMC) algorithms. Under some regularity conditions, we show that the convergence rate of importance resampling MCMC algorithms, measured in terms of the total variation distance, is O(n-1). By means of an example, we establish that, in general, this algorithm does not converge at a faster rate. We also study the interacting tempering algorithm, a simplified version of the equi-energy sampler, and establish that its mixing time is of order O(n-1/2).

Keywords

Adaptive Markov chain Monte Carlomixing timetotal variation distanceimportance resampling algorithmequi-energy sampler

MSC classification

Primary: 65C05: Monte Carlo methods 65C40: Computational Markov chains
Secondary: 60J05: Discrete-time Markov processes on general state spaces
Type
Research Papers
Information
Journal of Applied Probability , Volume 52 , Issue 3 , September 2015 , pp. 811 - 825
Copyright
Copyright © 2015 by the Applied Probability Trust 

References

Andrieu, C. and Atchadé, Y. F. (2007). On the efficiency of adaptive MCMC algorithms. Electron. Commun. Prob. 12 336-349.Google Scholar
Andrieu, C., Jasra, A., Doucet, A. and Del Moral, P. (2008). A note on convergence of the equi-energy sampler. Stoch. Anal. Appl. 26 298-312.Google Scholar
Andrieu, C., Jasra, A., Doucet, A. and Del Moral, P. (2011). On nonlinear Markov chain Monte Carlo. Bernoulli 17 987-1014.CrossRefGoogle Scholar
Atchadé, Y. F. (2009). Resampling from the past to improve on MCMC algorithms. Far East J. Theoret. Statist. 27 81-99.Google Scholar
Atchadé, Y. F. (2010). A cautionary tale on the efficiency of some adaptive Monte Carlo schemes. Ann. Appl. Prob. 20 841-868.Google Scholar
Atchadé, Y., Fort, G., Moulines, E. and Priouret, P. (2011). Adaptive Markov chain Monte Carlo: theory and methods. In Bayesian Time Series Models, Cambridge University Press, pp. 32–51.Google Scholar
Bercu, B., Del Moral, P. and Doucet, A. (2012). Fluctuations of interacting Markov chain Monte Carlo methods. Stoch. Process. Appl. 122 1304-1331.Google Scholar
Cattiaux, P. and Guillin, A. (2008). Deviation bounds for additive functionals of Markov processes. ESAIM Prob. Statist. 12 12-29.Google Scholar
Fort, G., Moulines, E. and Priouret, P. (2011). Convergence of adaptive and interacting Markov chain Monte Carlo algorithms. Ann. Statist. 39 3262-3289.CrossRefGoogle Scholar
Fort, G., Moulines, E., Priouret, P. and Vandekerkhove, P. (2014). A central limit theorem for adaptive and interacting Markov chains. Bernoulli 20 457-485.Google Scholar
Häggström, O. and Rosenthal, J. S. (2007). On variance conditions for Markov chain CLTs. Electron. Commun. Prob. 12 454-464.CrossRefGoogle Scholar
Kou, S. C., Zhou, Q. and Wong, W. H. (2006). Equi-energy sampler with applications in statistical inference and statistical mechanics. Ann. Statist. 34 1581-1652.Google Scholar
Mengersen, K. L. and Tweedie, R. L. (1996). Rates of convergence of the Hastings and Metropolis algorithms. Ann. Statist. 24 101-121.Google Scholar
Schmidler, S. C. and Woodard, D. B. (2011). Lower bounds on the convergence rates of adaptive MCMC methods. Tech. Rep., Duke University.Google Scholar
Van der Vaart, A. W. and Wellner, J. A. (1996). Weak Convergence and Empirical Processes: With Applications to Statistics. Springer, New York.Google Scholar
Woodard, D. B., Schmidler, S. C. and Huber, M. (2009). Conditions for rapid mixing of parallel and simulated tempering on multimodal distributions. Ann. Appl. Prob. 19 617-640.Google Scholar