Sequential Monte Carlo without likelihoods
While peeping at the slides of the working groups of the 2008-09 Program on Sequential Monte Carlo Methods, I came upon a short presentation of the ABC-PRC version of Sisson, Fan and Tanaka of the ABC algorithm that does not seem to be aware the bias exhibited in our paper with Marc Beaumont, Jean-Marie Cornuet and Jean-Michel Marin, following a first exchange of Marc with the authors. Since this appears to be the case for many people using ABC, I recap here our point.
The difficulty with the method centers at the acceptance probability above, that is derived from the SMC sampler of Del Moral, Doucet and Jasra (2006, JRSS B), with the difference that the likelihood is removed in a standard ABC fashion. However, the missing likelihood in the denominator is not compensated for and this creates the bias. The difficulty is not acknowledged in PNAS (which rejected our submission on the ground that the problem was “well-known”, which is apparently not that true). The update published on Scott Sisson’s webpage does not acknowledge the bias but rather puts the blame for poor performances on the fact that “poor choices of backward kernels such as L = K can in some cases result in importance weights with a very large or infinite variance“. Rather interestingly, the solution put forward in the update for the backward kernel L ends up with a form that is identical with the population Monte Carlo solution we propose, but for the wrong reason altogether!
May 6, 2011 at 8:49 am
[…] years than 5 million years as thought previously). Tina Toni talked about the application of ABC-SMC and ABC model choice to complex biochemical dynamics. Pierre Pudlo and Mohammed Sedki introduced […]
July 24, 2010 at 12:11 am
[…] to build a better kernel q is indeed a constant feature in SMC methods, from Sisson et al.’s ABC-PRC (2007)—note that Drovandi and Pettitt mistakenly consider the method to include partial rejection […]
June 4, 2010 at 12:17 am
[…] we proved is not a correct importance weight. Using the joint target does not evacuate this […]
April 3, 2009 at 12:04 am
[…] the bibliography is biased towards the publications and preprints of the authors, with the controversial PNAS paper included within the major papers (see also this post), and a preprint of them […]