Correlated Poissons
A graduate student came to see me the other day with a bivariate Poisson distribution and a question about using EM in this framework. The problem boils down to adding one correlation parameter and an extra term in the likelihood
Both terms involving sums are easy to deal with, using latent variables as in mixture models. The subtractions are trickier, as the negative parts cannot appear in a conditional distribution. Even though the problem can be handled by a direct numerical maximisation or by an almost standard Metropolis-within-Gibbs sampler, my suggestion regarding EM per se was to proceed by conditional EM, one parameter at a time. For instance, when considering conditional on both Poisson parameters, depending on whether
or not, one can consider either
and turn
thus producing a Beta-like target function in after completion, or turn
to produce a Beta-like target function in after completion. In the end, this is a rather pedestrian exercise and I am still frustrated at missing the trick to handle the subtractions directly, however it was nonetheless a nice question!
March 2, 2011 at 3:35 pm
Actually, the bivariate Poisson regression has been programmed in the bivpois package, in R (as far as I remember, it was using that EM algorithm you mention). But for some reason, it cannot be installed anymore
http://cran.r-project.org/web/packages/bivpois/
“Package ‘bivpois’ was removed from the CRAN repository”
anyone knows why ? are there any problem with that package ?
March 6, 2011 at 10:28 pm
I’ve been told that packages can drop out of CRAN when a new version of R is released. The CRAN people run their suite of tests, and a package fails to pass, then it is moved from the repository to the archive. It is the responsibility of the package maintainer, if any, to get the package back into the repository.
Archived packages can still installed with a little work.