The approximation in ABC

An interesting new paper about ABC was posted by Richard Wilkinson on ArXiv today. The main point in the paper is to replace the approximation error resulting from the loose acceptance condition in regular ABC (i.e. when accepting a simulated value within a distance ε from the observation) with an exact ABC simulation from a controlled approximation to the target, essentially a convolution of the regular target with an arbitrary kernel π. The idea is indeed interesting in that the outcome is completely controlled, thanks to the degree of freedom brought by the choice of the kernel π, but I think its scope does not compare with the kernel smoothing perspective found in Beaumont et al. (2002). The convolution of the distribution f of the observables with the arbitrary kernel π indeed does not bring us closer to the ideal inference based on the true posterior, while the nonparametric motivations of Beaumont et al. (2002) and more recently of Blum and François (2008) have the goal of improving the approximation to the true posterior, based on previous simulations. (The criticism in the current paper of the Epanechnikov kernel as a poor choice for a measurement error distribution is thus off-key, given that the incentive is nonparametric in Beaumont et al. (2002). Note also that the final extension of the paper both to Monte Carlo integration and to model choice is quite indistinguishable from a nonparametric approximation of the posterior distribution.) In that sense, both papers of Beaumont et al. (2002) and of Blum and François (2008) develop adaptive methods in the sense of sequential Monte Carlo, like the PMC version of ours.

This type of work also relates to the theory of model approximation built by Tony O’Hagan in the early 2000’s (as pointed out in the paper).

My main criticism of the paper is that the approach proposed by Wilkinson requires a modification of the ABC algorithm and thus that the algorithm is exact only after this modification, i.e. after changing the problem. The algorithm also includes an upper bound c on the convolution kernel π, which is not an enormous requirement given that π is arbitrary but still is a requirement. The extension of the method to include MCMC steps as in ABC-MCMC is altogether not surprising, but the comparison of two MCMC versions is rather interesting, one avoiding the use of the upper bound c by integrating both approximations in a single acceptance step. The paper rightly concludes by stating that more work is needed, in particular to include the additional approximation step due to the use of summary (insufficient) statistics, which is much more of an issue, as discussed in yesterday’s blog.

4 Responses to “The approximation in ABC”

  1. […] inference under the perturbed HMM scheme. In this sense, this equivalence brings the paper close to Wilkinson’s (2008) and Fearnhead’s and Prangle’s. While this also establishes asymptotic bias for a […]

  2. […] rather quickly so I may miss some points in the paper but my overall feeling is of a proximity to Richard Wilkinson’s exact ABC on an approximate target. The interesting input in the paper is that ABC is […]

  3. […] Richard Wilkinson, University of Sheffield (whose paper is discussed on that post); […]

  4. […] was a paper by Wilkinson posted earlier on arXiv and discussed in this post that also discusses the impact of the approximation of the posterior, apparently from a different […]

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

This site uses Akismet to reduce spam. Learn how your comment data is processed.