and it only gets worse [verbatim]

“Increasing export capacity from the Freeport LNG project is critical to spreading freedom gas throughout the world by giving America’s allies a diverse and affordable source of clean energy” M. Menezes, US Secretary of Energy

“NASA should NOT be talking about going to the Moon – We did that 50 years ago. They should be focused on the much bigger things we are doing, including Mars (of which the Moon is a part)” DT,, 7 June

“I just met with the Queen of England (U.K.) [sic], the Prince of Whales [re-sic]” DT, 13 June

“[Sarah Sanders] is going to be leaving the service of her country and she’s going to be going  (…) She’s a very special person, a very, very fine woman, she has been so great, she has such heart, she’s strong but with great, great heart, and I want to thank you for an outstanding job.” DT, 13 June

“…when I asked, ‘How many will die?’ ‘150 people, sir’, was the answer from a General. 10 minutes before the strike I stopped it, not … proportionate to shooting down an unmanned drone.” DT, 21 June

“The reason we have tragedies like that on the border is because that father didn’t wait to go through the asylum process in the legal fashion and decided to cross the river and not only died but his daughter died tragically as well,” K. Cuccinelli, head of US Immigration and Citizenship Services, 28 June

“If Japan is attacked, we will fight World War III. But if we’re attacked, Japan doesn’t have to help us at all. They can watch it on a Sony television.” DT, 24 June

information maximising neural networks summaries

After missing the blood moon eclipse last night, I had a meeting today at the Paris observatory (IAP), where we discussed an ABC proposal made by Tom Charnock, Guilhem Lavaux, and Benjamin Wandelt from this institute.

“We introduce a simulation-based machine learning technique that trains artificial neural networks to find non-linear functionals of data that maximise Fisher information : information maximising neural networks.” T. Charnock et al., 2018

The paper is centred on the determination of “optimal” summary statistics. With the goal of finding “transformation which maps the data to compressed summaries whilst conserving Fisher information [of the original data]”. Which sounds like looking for an efficient summary and hence impossible in non-exponential cases. As seen from the description in (2.1), the assumed distribution of the summary is Normal, with mean μ(θ) and covariance matrix C(θ) that are implicit transforms of the parameter θ. In that respect, the approach looks similar to the synthetic likelihood proposal of Wood (2010). From which an unusual form of Fisher information can be derived, as μ(θ)’C(θ)⁻¹μ(θ)… A neural net is trained to optimise this information criterion at a given (so-called fiducial) value of θ, in terms of a set of summaries of the same dimension as the data. Which means the information contained in the whole data (likelihood) is not necessarily recovered, linking with this comment from Edward Ionides (in a set of lectures at Wharton).

“Even summary statistics derived by careful scientific or statistical reasoning have been found surprisingly uninformative compared to the whole data likelihood in both scientific investigations (Shrestha et al., 2011) and simulation experiments (Fasiolo et al., 2016)” E. Ionides, slides, 2017

The maximal Fisher information obtained in this manner is then used in a subsequent ABC step as the natural metric for the distance between the observed and simulated data. (Begging the question as to why being maximal is necessarily optimal.) Another question is about the choice of the fiducial parameter, which choice should be tested by for instance iterating the algorithm a few steps. But having to run simulations for a single value of the parameter is certainly a great selling point!

a week at the lake (#6)

art brut

moonlight