Archive for SuSTain

high-dimensional stochastic simulation and optimisation in image processing [day #3]

Posted in pictures, Statistics, Travel, University life with tags , , , , , , , , , , , , on August 31, 2014 by xi'an

Last and maybe most exciting day of the “High-dimensional Stochastic Simulation and Optimisation in Image Processing” in Bristol as it was exclusively about simulation (MCMC) methods. Except my own talk on ABC. And Peter Green’s on consistency of Bayesian inference in non-regular models. The talks today were indeed about using convex optimisation devices to speed up MCMC algorithms with tools that were entirely new to me, like the Moreau transform discussed by Marcelo Pereyra. Or using auxiliary variables à la RJMCMC to bypass expensive Choleski decompositions. Or optimisation steps from one dual space to the original space for the same reason. Or using pseudo-gradients on partly differentiable functions in the talk by Sylvain Lecorff on a paper commented earlier in the ‘Og. I particularly liked the notion of Moreau regularisation that leads to more efficient Langevin algorithms when the target is not regular enough. Actually, the discretised diffusion itself may be geometrically ergodic without the corrective step of the Metropolis-Hastings acceptance. This obviously begs the question of an extension to Hamiltonian Monte Carlo. And to multimodal targets, possibly requiring as many normalisation factors as there are modes. So, in fine, a highly informative workshop, with the perfect size and the perfect crowd (which happened to be predominantly French, albeit from a community I did not have the opportunity to practice previously). Massive kudos to Marcello for putting this workshop together, esp. on a week where family major happy events should have kept him at home!

As the workshop ended up in mid-afternoon, I had plenty of time for a long run with Florence Forbes down to the Avon river and back up among the deers of Ashton Court, avoiding most of the rain, all of the mountain bikes on a bike trail that sounded like trail running practice, and building enough of an appetite for the South Indian cooking of the nearby Thali Café. Brilliant!

high-dimensional stochastic simulation and optimisation in image processing [day #2]

Posted in pictures, Statistics, Travel, Uncategorized, University life, Wines with tags , , , , , , on August 30, 2014 by xi'an

After a nice morning run down Leigh Woods and on the muddy banks of the Avon river, I attended a morning session on hyperspectral image non-linear modelling. Topic about which I knew nothing beforehand. Hyperspectral images are 3-D images made of several wavelengths to improve their classification as a mixture of several elements. The non-linearity is due to the multiple reflections from the ground as well as imperfections in the data collection. I found this new setting of clear interest, from using mixtures to exploring Gaussian processes and Hamiltonian Monte Carlo techniques on constrained spaces… Not to mention the “debate” about using Bayesian inference versus optimisation. It was overall a day of discovery as I am unaware of the image processing community (being the outlier in this workshop!) and of their techniques. The problems mostly qualify as partly linear high-dimension inverse problems, with rather standard if sometimes hybrid MCMC solutions. (The day ended even more nicely with another long run in the fields of Ashton Court and a conference diner by the river…)

 

high-dimensional stochastic simulation and optimisation in image processing [day #1]

Posted in pictures, Statistics, Travel, Uncategorized, University life, Wines with tags , , , , , , , , , , , on August 29, 2014 by xi'an

Even though I flew through Birmingham (and had to endure the fundamental randomness of trains in Britain), I managed to reach the “High-dimensional Stochastic Simulation and Optimisation in Image Processing” conference location (in Goldney Hall Orangery) in due time to attend the (second) talk by Christophe Andrieu. He started with an explanation of the notion of controlled Markov chain, which reminded me of our early and famous-if-unpublished paper on controlled MCMC. (The label “controlled” was inspired by Peter Green who pointed out to us the different meanings of controlled in French [meaning checked or monitored] and in English . We use it here in the English sense, obviously.) The main focus of the talk was on the stability of controlled Markov chains. With of course connections with out controlled MCMC of old, for instance the case of the coerced acceptance probability. Which happened to be not that stable! With the central tool being Lyapounov functions. (Making me wonder whether or not it would make sense to envision the meta-problem of adaptively estimating the adequate Lyapounov function from the MCMC outcome.)

As I had difficulties following the details of the convex optimisation talks in the afternoon, I eloped to work on my own and returned to the posters & wine session, where the small number of posters allowed for the proper amount of interaction with the speakers! Talking about the relevance of variational Bayes approximations and of possible tools to assess it, about the use of new metrics for MALA and of possible extensions to Hamiltonian Monte Carlo, about Bayesian modellings of fMRI and of possible applications of ABC in this framework. (No memorable wine to make the ‘Og!) Then a quick if reasonably hot curry and it was already bed-time after a rather long and well-filled day!z

workshop a Padua

Posted in pictures, Running, Statistics, Travel, University life with tags , , , , , , , , on October 5, 2012 by xi'an

I am invited to a (closed) workshop in Padua/Padova next March, “Recent advances in statistical inference: theory and case studies”, which is an exciting opportunity to discuss about recent advances in Bayesian methodology and likelihood inference, to meet with friends and to be back in this beautiful city where I met George Casella for the last time. (Keeping this vivid image of watching George running around the Prato della Valle as my bus was leaving the city towards Venezia airport.)

The workshop is organised in my favourite way, which is “to have a moderate number of invited talks at the workshop, to allow good time for presentation and discussion”. With discussants, which seems a vanishing structure in conferences where the length of the talks is getting shorter and shorter. When in Bristol last week, I realised how much I gained from a slower conference pace with fewer and longer talks, more time for discussion in between, and a well-scheduled poster session. Maybe old age speaking! Furthermore, part of the workshop takes place in the fabulous Caffè Pedrocchi, where we had dinner two years ago… Terrific (and exclusive, as the workshop is by invitation only!)

structure and uncertainty, Bristol, Sept. 27

Posted in pictures, Running, Statistics, Travel, University life with tags , , , , , , , , , , , , on September 28, 2012 by xi'an

The last sessions at the SuSTain workshop. were equally riveting but I alas had to leave early to get a noon flight—as it happens, while I expected to get home early enough to work, run, cook, and do maths with my daughter, my taxi got stuck in an endless traffic jam and I only had time for the maths!—, hence missing the talks by Chris Holmes—second time after Kyoto!—, Sofia Massa, and Arnoldo Frigessi… I am glad I managed to get Michael Newton’s and Forrest Crawford’s talks, though, as Michael presented a highly pedagogical entry to computational concepts related to system biology (a potential candidate for an MCMSki IV talk?) and Forrest discussed some birth-and-death processes, including the Yule process, that allowed for closed form expressions of their Laplace transform via continued fractions. (Continued fractions, one of my favourite mathematical objects!!! Rarely appearing in statistics, though…) I have to check on Forrest’s recent papers to understand how widely this approach applies to philogenetic trees, but this opens a fairly interesting alternative to ABC!

This was a highly enjoyable meeting, first and foremost due to the quality of the talks and of their scheduling, but also by the pleasure of seeing again many friends of many years—notice how I carefully avoided using “old friends”!—, by the relaxed and open atmosphere of the workshop—in the terrific location of Goldney Hall—and of course of unofficially celebrating Peter Green’s deeds and contributions to the field, the profession, and the statistics group in Bristol! Deeds and contributions so far, as I am sure he will keep contributing in many ways in the coming years and decades, as already shown by his committed involvement in the very recent creation of BayesComp. I thus most gladly join the other participants of this workshop both to thank him most sincerely for those many and multifaceted contributions and to wish him all the best for those coming decades!

As an aside, I also enjoyed being “back” in Bristol once again, as I do like the city, the surrounding Somerset countryside, the nearby South Wales, and the wide running possibilities (from the Downs to the Mendip Hills!). While I sampled many great hotels in Bristol and Clifton over the years, I now rank the Avon Gorges Hotel where I stayed this time quite high in the list, both for its convenient (running!) location and its top-quality facilities (incl. high-speed WiFi!)