from here to infinity

“Introducing a sparsity prior avoids overfitting the number of clusters not only for finite mixtures, but also (somewhat unexpectedly) for Dirichlet process mixtures which are known to overfit the number of clusters.”

On my way back from Clermont-Ferrand, in an old train that reminded me of my previous ride on that line that took place in… 1975!, I read a fairly interesting paper published in Advances in Data Analysis and Classification by [my Viennese friends] Sylvia Früwirth-Schnatter and Gertrud Malsiner-Walli, where they describe how sparse finite mixtures and Dirichlet process mixtures can achieve similar results when clustering a given dataset. Provided the hyperparameters in both approaches are calibrated accordingly. In both cases these hyperparameters (scale of the Dirichlet process mixture versus scale of the Dirichlet prior on the weights) are endowed with Gamma priors, both depending on the number of components in the finite mixture. Another interesting feature of the paper is to witness how close the related MCMC algorithms are when exploiting the stick-breaking representation of the Dirichlet process mixture. With a resolution of the label switching difficulties via a point process representation and k-mean clustering in the parameter space. [The title of the paper is inspired from Ian Stewart’s book.]

17 equations that changed the World (#2)

(continuation of the book review)

“If you placed your finger at that point, the two halves of the string would still be able to vibrate in the sin 2x pattern, but not in the sin x one. This explains the Pythagorean discovery that a string half as long produced a note one octave higher.” (p.143)

The following chapters are all about Physics: the wave equation, Fourier’s transform and the heat equation, Navier-Stokes’ equation(s), Maxwell’s equation(s)—as in  The universe in zero word—, the second law of thermodynamics, E=mc² (of course!), and Schrödinger’s equation. I won’t go so much into details for those chapters, even though they are remarkably written. For instance, the chapter on waves made me understand the notion of harmonics in a much more intuitive and lasting way than previous readings. (This chapter 8 also mentions the “English mathematician Harold Jeffreys“, while Jeffreys was primarily a geophysicist. And a Bayesian statistician with major impact on the field, his Theory of Probability arguably being the first modern Bayesian book. Interestingly, Jeffreys also was the first one to find approximations to the Schrödinger’s equation, however he is not mentioned in this later chapter.) Chapter 9 mentions the heat equation but is truly about Fourier’s transform which he uses as a tool and later became a universal technique. It also covers Lebesgue’s integration theory, wavelets, and JPEG compression. Chapter 10 on Navier-Stokes’ equation also mentions climate sciences, where it takes a (reasonable) stand. Chapter 11 on Maxwell’s equations is a short introduction to electromagnetism, with radio the obvious illustration. (Maybe not the best chapter in the book.)

17 equations that changed the World (#1)

I do not know if it is a coincidence or if publishers were competing for the same audience: after reviewing The universe in zero word: The story of mathematics as told through equations, in this post (and in CHANCE, to appear in 25(3)!), I noticed Ian Stewart’s 17 equations That Changed the World, published in 2011, and I bought a copy to check the differences between both books.

I am quite glad I did so, as I tremendously enjoyed this book, both for its style and its contents, both entertaining and highly informative. This does not come as a big surprise, given Stewart’s earlier books and their record, however this new selection and discussion of equations is clearly superior to The universe in zero word! Maybe because it goes much further in its mathematical complexity, hence is more likely to appeal to the mathematically inclined (to borrow from my earlier review). For one thing, it does not shy away from inserting mathematical formulae and small proofs into the text, disregarding the risk of cutting many halves of the audience (I know, I know, high powers of (1/2)…!) For another, 17 equations That Changed the World uses the equation under display to extend the presentation much much further than The universe in zero word. It is also much more partisan (in an overall good way) in its interpretations and reflections about the World.

In opposition with The universe in zero word, formulas are well-presented, each character in the formula being explained in layman terms. (Once again, the printer could have used better fonts and the LaTeX word processor.) The (U.K. edition, see tomorrow!) cover is rather ugly, though, when compared with the beautiful cover of The universe in zero word. But this is a minor quibble! Overall, it makes for an enjoyable, serious and thought-provoking read that I once again undertook mostly in transports (planes and métros).