Thanks for your comments on our paper. I’m not sure that I fully agree with them, so I would like to take the opportunity to address these. I have chatted to you informally about this at the conference we’re both currently attending(!), but I thought it would be useful to express them here for your readers.

Firstly, you comment that “ABC-MCMC is never justified [on marginal space, using a Monte Carlo estimate of the likelihood] in the literature, rather as an MCMC algorthm targeting the auxiliary variable joint [distribution], see e.g. Marjoram et al (2003).”

I’m not fully convinced by this comment. Nowhere in the Marjoram et al (2003) paper is even the suggestion of an auxiliary variable joint distribution mentioned (unless I misread, of course). The only discussion is on marginal space samplers. Marjoram et al (2003) also explicitly implement a sampler using Monte Carlo estimates of the likelihood (though this is to verify that their ABC-MCMC algorithm with a single dataset generation performs correctly). However, I stress again that nowhere (that I can find) is any mention of a joint target distribution mentioned. At best, therefore, the article is very ambiguous as to the nature/target of the algorithm. And of course, this is the point of our paper.

Also, even if it were the case that Marjoram et al (2003) explicitly stated a joint distribution target (they do not), this would still not mitigate our point that some ABC algorithms are valid on both marginal and joint space targets, whereas others are only valid with joint space targets (though all are practically unbiased).

Your second comment is “I fail to understand the argument that the weight used in Sisson, Fan and Tanaka (2007) would become in practice unbiased through association with the equivalent sampler targeting [the joint sampler].” Of course you *should* fail to understand this, as a) its not the point we’re making, and b) if it were the point, it would be incorrect!

The point that we’re making is that SMC samplers on marginal space (using Monte Carlo estimates) are in practice unbiased through association with the equivalent sampler targeting joint space. You have commented that this argument is “formally correct” for MCMC samplers, so clearly this must also extend to SMC samplers, as the argument is identical!

Your confusion arises as the Sisson et al (2007) algorithm is clearly biased. However (and we don’t say this explicitly in the paper, as its not the focus of the article) the clear implication from our article, is that this bias is *not* due to a ratio of unbiased likelihood estimates in the weight computation. The bias comes from a different source, and I belive that you have a recent paper discussing this.

Hopefully this clarifies the above points, and allows some appreciation of the contribution of our article.

]]>