This talk is part of the Institute of Applied Mathematics (IMS) Seminar series. SCOPE connects researchers and trainees with leading work in statistical sciences, biostatistics, and data science from Canada and beyond. Organized with CANSSI Ontario’s partner universities, the series features accomplished researchers advancing theory, methodology, and innovative applications across interdisciplinary challenges.
Abstract:
Markov Chain Monte Carlo (MCMC) is a powerful algorithmic framework for sampling from complex probability distributions. Standard MCMC methods struggle with high-dimensional distributions containing well-separated modes, becoming trapped in local regions. Replica-exchange/Parallel tempering (PT) addresses this by using intermediate annealing distributions to bridge a tractable reference (e.g., Gaussian) and an intractable target distribution. However, classical PT is inflexible, fragile, hard to tune, and prone to performance collapse on challenging inference tasks.
This talk introduces non-reversible parallel tempering (NRPT), which provably dominates classical PT algorithms. We show that NRPT undergoes a sharp algorithmic phase transition with increased parallelism, becoming robust, easy to tune, and scaling efficiently to GPUs. I will then demonstrate how to further accelerate PT using neural transports such as normalising flows and diffusions. We demonstrate this framework across a variety of examples in Bayesian inference and inference-time control for diffusion models.
Speaker's page: https://www.saifsyed.com/
Location: LSK 306
Event date: -
Speaker: Saifuddin Syed, Assistant Professor, UBC Department of Statistics