the Poisson transform

In obvious connection with an earlier post on the “estimation” of normalising constants, Simon Barthelmé and Nicolas Chopin just arXived a paper on The Poisson transform for unormalised statistical models. Obvious connection because I heard of the Guttmann and Hyvärinen (2012) paper when Simon came to CREST to give a BiP talk on this paper a few weeks ago. (A connected talk he gave in Banff is available as a BIRS video.)

Without getting too much into details, the neat idea therein is to turn the observed likelihood

$\sum_{i=1}^n f(x_i|\theta) - n \log \int \exp f(x|\theta) \text{d}x$

into a joint likelihood

$\sum_{i=1}^n[f(x_i|\theta)+\nu]-n\int\exp[f(x|\theta)+\nu]\text{d}x$

which is the likelihood of a Poisson point process with intensity function

$\exp\{ f(x|\theta) + \nu +\log n\}$

This is an alternative model in that the original likelihood does not appear as a marginal of the above. Only the modes coincide, with the conditional mode in ν providing the normalising constant. In practice, the above Poisson process likelihood is unavailable and Guttmann and Hyvärinen (2012) offer an approximation by means of their logistic regression.

Unavailable likelihoods inevitably make me think of ABC. Would ABC solutions be of interest there? In particular, could the Poisson point process be simulated with no further approximation? Since the “true” likelihood is not preserved by this representation, similar questions to those found in ABC arise, like a measure of departure from the “true” posterior. Looking forward the Bayesian version! (Marginalia: Siméon Poisson died in Sceaux, which seemed to have attracted many mathematicians at the time, since Cauchy also spent part of his life there…)

This entry was posted on June 19, 2014 at 12:14 am and is filed under Books, Kids, pictures, Statistics, University life with tags Banff, Cauchy, logistic regression, Paris, Poisson point process, Sceaux, Siméon Poisson, untractable normalizing constant. You can follow any responses to this entry through the RSS 2.0 feed. You can leave a response, or trackback from your own site.

One Response to “the Poisson transform”

Dan Simpson Says:
June 19, 2014 at 3:27 pm

It’s pretty easy to simulate from a Poisson process, so that bit’s fine. But it’s probably going to be too high-dimensional for ABC (I’m not 100% on the dimension of \nu here).

But, I’m not sure why you’d bother. The “approximate likelihood” is pretty easy to compute (I wouldn’t use logistic regression – it’s a low dimensional integral: use Gauss quadrature) and the resulting posterior satisfies pretty straightforward perturbation bounds w.r.t. this integration error. (This is even true for things like log-Gaussian Cox processes)

Reply

Xi'an's Og