Computing evidence

Yesterday, I gave this talk in the Model Assessment working group seminar at SAMSI, in connection with the Sequential Monte Carlo program that SAMSI runs this year. The format was quite nice as the two-hour schedule allowed for a lot of questions and interruptions (as well as my experimenting with smart board writing!). The talk is based on several papers written with Jean-Michel Marin this year and on the nested sampling paper with Nicolas Chopin discussed there a few days ago. (This will also be the topic of my advanced graduate course at CREST next February.) The methods that generated the most comments were

  1. reverse importance sampling, à la Gelfand & Dey (1994), which is one very elegant method, even though it may be prone to misbehaviour as it relates to harmonic means (see Radford Neal’s point). (Interestingly [?], googling on that term leads to links to Ò Ruanaidh & Fitzgerald’s (1996) book.)
  2. bridge sampling, à la Gelman & Meng (1998), especially for its curious connection with mixture sampling and defensive sampling.
  3. Chib’s (1995) marginal likelihood estimator for latent variable models, both because of the label switching difficulty (that was maybe lost on part of the audience) and because of the direct permutation fix.
  4. nested sampling, for both its formal simplicity and not-so-simple implementation.

The part about cross-model methods did not seem so interesting to the audience, maybe because it is mostly negative. The overall sobering conclusion, however, was that most of those methods were likely to fail in large dimensions, which is true when using (as we do) importance functions derived from nonparametric principles.

2 Responses to “Computing evidence”

  1. […] is achieved or when a maximum 10⁵ iterations are reached. The R program I wrote while visiting SAMSI had more options, but it was also horrendously slow! The CPU time reported by the authors is far […]

  2. […] filled, I decided to feed it to the simulated annealing R program I wrote while visiting SAMSI last year. The R program reached the exact (and only) solution in about 6000 iterations, as shown (?) on the […]

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )


Connecting to %s

This site uses Akismet to reduce spam. Learn how your comment data is processed.