To join via Zoom: To join this seminar, please request Zoom connection details from headsec [at] stat.ubc.ca
Title: Bridging the Gap Between Deep Learning and Probabilistic Modeling
Abstract: Deep learning excels with large-scale unstructured data - common across many modern application domains - while probabilistic modeling offers the ability to encode prior knowledge and quantify uncertainty - necessary for safety-critical applications and downstream decision-making tasks. I will discuss examples from my research that bridge the gap between these two learning paradigms. The first half will show that insights from deep learning can improve the practicality of probabilistic models. I will discuss work that scales Gaussian process regression, a common probabilistic model, to datasets two orders of magnitude larger than previously reported. The second half will show that probabilistic methods can improve our understanding of deep learning. I will demonstrate that Gaussian process theory uncovers new insights about the effects of width and depth in neural networks. I will conclude with ongoing efforts to quantify neural network uncertainty, develop new inductive biases, and other work at the intersection of deep learning and probabilistic modeling.