In the family of symmetric Dirichlet mixture priors there are interesting non-informative choices, such as the NSB prior. See also http://www.nowozin.net/sebastian/blog/estimating-discrete-entropy-part-3.html for some consequences of these prior choices in the context of the entropy estimation problem.

]]>