Archive for École Normale de Cachan

Julyan’s talk on priors in Bayesian neural networks [cancelled!]

Posted in pictures, Statistics, Travel, University life with tags , , , , , , , , , , , , , on March 5, 2020 by xi'an

Next Friday, 13 March at 1:30p.m., Julyan Arbel, researcher at Inria Grenoble will give a All about that Bayes talk at CMLA, ENS Paris-Saclay (building D’Alembert, room Condorcet, Cachan, RER stop Bagneux) on

Understanding Priors in Bayesian Neural Networks at the Unit Level

We investigate deep Bayesian neural networks with Gaussian weight priors and a class of ReLU-like nonlinearities. Bayesian neural networks with Gaussian priors are well known to induce an L², “weight decay”, regularization. Our results characterize a more intricate regularization effect at the level of the unit activations. Our main result establishes that the induced prior distribution on the units before and after activation becomes increasingly heavy-tailed with the depth of the layer. We show that first layer units are Gaussian, second layer units are sub-exponential, and units in deeper layers are characterized by sub-Weibull distributions. Our results provide new theoretical insight on deep Bayesian neural networks, which we corroborate with simulation experiments.

 

Abel Prize goes to Yves Meyer

Posted in Books, pictures, University life with tags , , , , , , , , on March 21, 2017 by xi'an

  

Just heard the great news that the Abel Prize for 2017 goes to Yves Meyer! Yves Meyer is an emeritus professor at École Normale de Cachan and has produced fundamental contributions to number theory, operator theory and harmonic analysis. He is one of the originators of the theory of wavelets and multiresolution analysis. Among other recognitions and prizes, he was an invited speaker at the International Congress of Mathematicians in 1970 (Nice), in 1983 (Warsaw), and in 1990 (Kyoto), and was awarded the Gauß Prize in 2010. Congratulations and total respect to Yves Meyer!!!

meyer