Adaptive Metropolis

There have been several arXived entries on adaptive MCM on the past days. One is an adaptive extension to the recent Read Paper by Christophe Andrieu, Arnaud Doucet and Roman Holenstein, Particle Markov chain Monte Carlo where Silva, Giordani, Kohn and Pitt manage to use an adapted mixture of normals as their proposal within non-linear state-space models. They also obtain unbiased estimators of the likelihood, which may have an appeal in ABC settings! To see this extension appearing a few weeks after the original paper is amazing as well. A second paper by Matti Vihola considers the impact of removing the stabilising term in the Haario-Saaksman-Tamminen original paper

on the convergence of the corresponding adaptative Metropolis algorithm. The change is in using instead a stochastic approximation update

where decreases to zero at a proper speed and is the empirical mean updated the same way. The paper is highly technical but shows the almost sure explosion of the resulting sequence under a flat target, an ergodic for a double Laplace target and a unimodal proposal, and a more general version under assumptions on the target and for a proposal suggested by Gareth Roberts and Jeff Rosenthal (2009)

which is akin to a renewal process in that the static part is not adaptative and thus regulates the behaviour of the whole chain. At last, Yves Atachadé and Gersende Fort posted the second half of their paper on limit theorems for some adaptive MCMC algorithms with subgeometric kernels, yet another fairly technical work that relates to Andrieu and Moulines (2006) and Saaksman and Vihola (2008). The adaptivity is controlled by retroprojections and contains as a special case stochastic approximation schemes, the main assumptions being a drift condition on the core kernel

and a diminishing adaptation condition common to all adaptive MCMC papers.