By a great coincidence, I happened to be in Banff the same weekend as Salman Rushdie was giving a talk at the Banff Centre on his latest book! And got the news early enough to book a seat. The amphitheatre was unsurprisingly full and Salman Rushdie was interviewed by Eleanor Wachtel, first about the book and what led to its creation, especially the influence of his parents, and then second about his life and career, with an obvious focus on Khomeini’s fatwa. (The whole interview is podcasted on CBC.) Rushdie was witty and funny, even about the darkest moments, and discussed how in his youth no one would have imagined that religion would become such a central issue, defining and reducing people rather than being a part of them that would need no discussion. And how his family was de facto atheist, if not in words. The interview spent too little time on Rusdhie’s stand on freedom of expression, although he briefly spoke about the growing threats to this freedom, including those made in the name of religious freedom. (As we were reminded yesterday by the Warwick student union decision to bar Maryam Namazie from speaking on campus.) The experience was quite a treat, adding to the many bonuses of spending this weekend in Banff. Although I must admit I was fighting jetlag that late at night and hence must have dozed at points… (As an aside, I was rather surprised to see no security or police around the Banff Centre theatre, but of course this does not mean there was none. And this is Banff, not New York City or London.)
Archive for University of Warwick
This “week in Warwick” was not chosen at random as I was aware there is a workshop on non-reversible MCMC going on. (Even though CRiSM sponsored so many workshops in September that almost any week would have worked for the above sentence!) It has always been kind of a mystery to me that non-reversibility could make a massive difference in practice, even though I am quite aware that it does. And I can grasp some of the theoretical arguments why it does. So it was quite rewarding to sit in this Warwick amphitheatre and learn about overdamped Langevin algorithms and other non-reversible diffusions, to see results where convergence times moved from n to √n, and to grasp some of the appeal of lifting albeit in finite state spaces. Plus, the cartoon presentation of Hamiltonian Monte Carlo by Michael Betancourt was a great moment, not only because of the satellite bursting into flames on the screen but also because it gave a very welcome intuition about why reversibility was inefficient and HMC appealing. So I am grateful to my two colleagues, Joris Bierkens and Gareth Roberts, for organising this exciting workshop, with a most profitable scheduling favouring long and few talks. My next visit to Warwick will also coincide with a workshop on intractable likelihood, next November. This time part of the new Alan Turing Institute programme.
At the last (European) AISTATS 2014, I agreed to be the program co-chair for AISTATS 2016, along with Arthur Gretton from the Gatsby Unit, at UCL. (AISTATS stands for Artificial Intelligence and Statistics.) Thanks to Arthur’s efforts and dedication, as the organisation of an AISTATS meeting is far more complex than any conference I have organised so far!, the meeting is taking shape. First, it will take place in Cadiz, Andalucía, Spain, on May 9-11, 2016. (A place more related to the conference palm tree logo than the previous location in Reykjavik, even though I would be the last one to complain it took place in Iceland!)
Second, the call for submissions is now open. The process is similar to other machine learning conferences in that papers are first submitted for the conference proceedings, then undergo a severe and tight reviewing process, with a response period for the authors to respond to the reviewers’ comments, and that only the accepted papers can be presented as posters, some of which are selected for an additional oral presentation. The major dates for submitting to AISTATS 2016 are
|Proceedings track paper submission deadline||23:59UTC Oct 9, 2015|
|Proceedings track initial reviews available||Nov 16, 2015|
|Proceedings track author feedback deadline||Nov 23, 2015|
|Proceedings track paper decision notifications||Dec 20, 2015|
I was quite impressed by the quality and intensity of the AISTATS 2014 conference, which is why I accepted so readily being program co-chair, and hence predict an equally rewarding AISTATS 2016, thus encouraging all interested ‘Og’s readers to consider submitting a paper there! Even though I confess it will make a rather busy first semester for 2016, between MCMSki V in January, the CIRM Statistics month in February, the CRiSM workshop on Eatimating constants in April, AISTATS 2016 thus in May, and ISBA 2016 in June…
My first session today was Markov Chain Monte Carlo for Contemporary Statistical Applications with a heap of interesting directions in MCMC research! Now, without any possible bias (!), I would definitely nominate Murray Pollock (incidentally from Warwick) as the winner for best slides, funniest presentation, and most enjoyable accent! More seriously, the scalable Langevin algorithm he developed with Paul Fearnhead, Adam Johansen, and Gareth Roberts, is quite impressive in avoiding computing costly likelihoods. With of course caveats on which targets it applies to. Murali Haran showed a new proposal to handle high dimension random effect models by a projection trick that reduces the dimension. Natesh Pillai introduced us (or at least me!) to a spectral clustering that allowed for an automated partition of the target space, itself the starting point to his parallel MCMC algorithm. Quite exciting, even though I do not perceive partitions as an ideal solution to this problem. The final talk in the session was Galin Jones’ presentation of consistency results and conditions for multivariate quantities which is a surprisingly unexplored domain. MCMC is still alive and running!
The second MCMC session of the morning, Monte Carlo Methods Facing New Challenges in Statistics and Science, was equally diverse, with Lynn Kuo’s talk on the HAWK approach, where we discovered that harmonic mean estimators are still in use, e.g., in MrBayes software employed in phylogenetic inference. The proposal to replace this awful estimator that should never be seen again (!) was rather closely related to an earlier solution of us for marginal likelihood approximation, based there on a partition of the whole space rather than an HPD region in our case… Then, Michael Betancourt brilliantly acted as a proxy for Andrew to present the STAN language, with a flashy trailer he most recently designed. Featuring Andrew as the sole actor. And with great arguments for using it, including the potential to run expectation propagation (as a way of life). In fine, Faming Liang proposed a bootstrap subsampling version of the Metropolis-Hastings algorithm, where the likelihood acknowledging the resulting bias in the limiting distribution.
My first afternoon session was another entry on Statistical Phylogenetics, somewhat continued from yesterday’s session. Making me realised I had not seen a single talk on ABC for the entire meeting! The issues discussed in the session were linked with aligning sequences and comparing many trees. Again in settings where likelihoods can be computed more or less explicitly. Without any expertise in the matter, I wondered at a construction that would turn all trees, like into realizations of a continuous model. For instance by growing one branch at a time while removing the MRCA root… And maybe using a particle like method to grow trees. As an aside, Vladimir Minin told me yesterday night about genetic mutations that could switch on and off phenotypes repeatedly across generations… For instance the ability to glow in the dark for species of deep sea fish.
When stating that I did not see a single talk about ABC, I omitted Steve Fienberg’s Fisher Lecture R.A. Fisher and the Statistical ABCs, keeping the morceau de choix for the end! Even though of course Steve did not mention the algorithm! A was for asymptotics, or ancilarity, B for Bayesian (or biducial??), C for causation (or cuffiency???)… Among other germs, I appreciated that Steve mentioned my great-grand father Darmois in connection with exponential families! And the connection with Jon Wellner’s LeCam Lecture from a few days ago. And reminding us that Savage was a Fisher lecturer himself. And that Fisher introduced fiducial distributions quite early. And for defending the Bayesian perspective. Steve also set some challenges like asymptotics for networks, Bayesian model assessment (I liked the notion of stepping out of the model), and randomization when experimenting with networks. And for big data issues. And for personalized medicine, building on his cancer treatment. No trace of the ABC algorithm, obviously, but a wonderful Fisher’s lecture, also most obviously!! Bravo, Steve, keep thriving!!!
While I discussed on the ‘Og in the past the difference I saw between estimating an unknown parameter from a distribution and evaluating a normalising constant, evaluating such constants and hence handling [properly] doubly intractable models is obviously of the utmost importance! For this reason, Nial Friel, Helen Ogden and myself have put together a CRiSM workshop on the topic (with the tongue-in-cheek title of Estimating constants!), to be held at the University of Warwick next April 20-22.
The CRiSM workshop will focus on computational methods for approximating challenging normalising constants found in Monte Carlo, likelihood and Bayesian models. Such methods may be used in a wide range of problems: to compute intractable likelihoods, to find the evidence in Bayesian model selection, and to compute the partition function in Physics. The meeting will bring together different communities working on these related problems, some of which have developed original if little advertised solutions. It will also highlight the novel challenges associated with large data and highly complex models. Besides a dozen invited talks, the schedule will highlight two afternoon poster sessions with speed (2-5mn) oral presentations called ‘Elevator’ talks.
While 2016 is going to be quite busy with all kinds of meetings (MCMSkv, ISBA 2016, the CIRM Statistics month, AISTATS 2016, …), this should be an exciting two-day workshop, given the on-going activity in this area, and I thus suggest interested readers to mark the dates in their diary. I will obviously keep you posted about registration and accommodation when those entries are available.