Sequential Monte Carlo without likelihoods

ABC-PRC acceptance probability

While peeping at the slides of the working groups of the 2008-09 Program on Sequential Monte Carlo Methods, I came upon a short presentation of the ABC-PRC version of Sisson, Fan and Tanaka of the ABC algorithm that does not seem to be aware the bias exhibited in our paper with Marc Beaumont, Jean-Marie Cornuet and Jean-Michel Marin, following a first exchange of Marc with the authors. Since this appears to be the case for many people using ABC, I recap here our point.

The difficulty with the method centers at the acceptance probability above, that is derived from the SMC sampler of Del Moral, Doucet and Jasra (2006, JRSS B), with the difference that the likelihood is removed in a standard ABC fashion. However, the missing likelihood in the denominator is not compensated for and this creates the bias. The difficulty is not acknowledged in PNAS (which rejected our submission on the ground that the problem was “well-known”, which is apparently not that true). The update published on Scott Sisson’s webpage does not acknowledge the bias but rather puts the blame for poor performances on the fact that “poor choices of backward kernels such as L = K can in some cases result in importance weights with a very large or infinite variance“. Rather interestingly, the solution put forward in the update for the backward kernel L ends up with a form that is identical with the population Monte Carlo solution we propose, but for the wrong reason altogether!

14 Responses to “Sequential Monte Carlo without likelihoods”

  1. […] years than 5 million years as thought previously). Tina Toni talked about the application of ABC-SMC and ABC model choice to complex biochemical dynamics. Pierre Pudlo and Mohammed Sedki introduced […]

  2. […] to build a better kernel q is indeed a constant feature in SMC methods, from Sisson et al.’s ABC-PRC (2007)—note that Drovandi and Pettitt mistakenly consider the method to include partial rejection […]

  3. […] we proved is not a correct importance weight. Using the joint target does not evacuate this […]

  4. […] the bibliography is biased towards the publications and preprints of the authors, with the controversial PNAS paper included within the major papers (see also this post), and a preprint of them […]

Leave a Reply to Another ABC paper « Xi'an's Og Cancel reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

This site uses Akismet to reduce spam. Learn how your comment data is processed.