Jaynes’ re-read

Following the two past PhD courses on JeffreysTheory of Probability and KeynesTreatise On Probability, I will propose next year a reading course at CREST on Jaynes’s Probability Theory.

Jeffreys and Jaynes share a lot in common as physicists who both significantly contributed to Bayesian statistical theory and as writers of books with almost identical titles and with very ambitious and similar scopes. It is thus no surprise that Jaynes dedicates his book to Jeffreys. There are also differences, the most obvious one being that Jeffreys published his foundational book before his 50th birthday, while Jaynes’ book came out more than ten years after his death (under the scholarly supervision of Larry Bretthorst). The time difference between both books is not that revelant, however, in that Jaynes’s Probability Theory is what Persi Diaconis call “wonderfully out of date” in his review. (Meaning “Jaynes’s focus on basic philosophical issues [rather than on computational techniques] is timeless“, with the conclusion that  “this is the best introduction to Bayesian statistics that I know”!)

I plan to cover in the lectures what I consider to be the most significant aspects of Jaynes’s work. The corpus of work corresponding to the logical foundations of probability theory and the opposition of Jaynes to (Feller’s) measure theory, Bourbakism, Kolmogorov’s axioms, (Feller’s) countable additivity, de Finetti’s principles, and other probabilistic paradoxes will not be adressed, even though a second course by a probabilist colleague of mine at Dauphine may follow this one. The lectures will focus on

  1. the meaning and motivation of prior distributions (Chapter 6), culminating in the definition of the entropy principle (Chapter 11)
  2. the rules of hypothesis testing (Chapter 4) and the central role of evidence (Chapters 9 and 18)
  3. the special case of transformation groups (Chapter 12) and the debate about marginalisation paradoxes (Chapter 15)
  4. Bayesian estimation (Chapter 6) and the criticisms on decision theory (Chapters 13 and 14)
  5. Model comparison (Chapter 20) and the pathologies of orthodox methods (Chapters 16 and 17)

The dates of the course are already set: March 21, 24, 28, 31 and April 04 [2011]…

8 Responses to “Jaynes’ re-read”

  1. […] in the end update those profitably. (The most obvious missing part is in my opinion the absence of E.T Jaynes and the MaxEnt community, which would deserve a chapter on its own.) Maybe ISBA could consider […]

  2. […] at CREST this year will be about some chapters of Jaynes’ Probability Theory. As announced earlier. The dates of the course are set as March 21 (11am), 24, 28, 31 and April 04 (2pm) at ENSAE […]

  3. […] the Search for Certainty is not that artificial: Toffoli also opposes von Mises and de Finetti to Jaynes, making maximum entropy the foundational principle. He however objects to von Mises’ […]

  4. I’m also very interested in these lectures but have no means of attending. Access to slides and possible forum discussions etc. would be much appreciated!

    Lars
    Stockholm, Sweden

  5. I hope you’re planning to post course material to this blog. I wish I could take part in the course…

  6. Matthieu Says:

    Dear Prof. Robert,

    Is the course open to all students? And is it accessible to non-statistics students?
    I have notions of applied Bayesian statistics (à la Gelman-style), but am not familiar with decision theory.
    Thanking you in advance,
    yours sincerely
    Matthieu

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s