Presentation:
Deep Machines That Know When They Do Not Know

Our minds make inferences that appear to go far beyond standard Machine Learning. Whereas people can learn richer representations and use them for a wider range of learning tasks, Machine Learning algorithms have been mainly employed in a stand-alone context, constructing a single function from a table of training examples. In this talk, I shall touch upon a view on Machine Learning, called probabilistic programming, that can help capturing these human learning aspects by combining high-level programming languages and probabilistic Machine Learning — the high-level language helps reducing the cost of modelling and probabilities help quantifying when a machine does not know something. Since probabilistic inference remains intractable, existing approaches leverage Deep Learning for inference. Instead of “going down the full neural road,” I shall argue to use probabilistic circuits such as sum-product networks, a deep but tractable architecture for probability distributions. This can speed up inference in probabilistic programs, as I shall illustrate for unsupervised science understanding, uncertain databases and even pave the way towards automating density estimation, making machine learning accessible to a broader audience of non-experts. 

This talk is based on joint works with many people such as Carsten Binnig, Zoubin Ghahramani, Andreas Koch, Alejandro Molina, Sriraam Natarajan, Robert Peharz, Constantin Rothkopf, Thomas Schneider, Patrick Schramwoski, Xiaoting Shao, Karl Stelzner, Martin Trapp, Isabel Valera, Antonio Vergari, and Fabrizio Ventola, among others.

Bio

Kristian Kersting is a Full Professor (W3) at the Computer Science Department of the TU Darmstadt University, Germany. He heads the Artificial Intelligence and Machine Learning (AIML) lab and is also a Deputy Director of the Centre for Cognitive Science. After receiving his Ph.D. from the University of Freiburg in 2006, he was with the MIT, Fraunhofer IAIS, the University of Bonn, and the TU Dortmund University. His main research interests are statistical relational Artificial Intelligence (AI), probabilistic programming, and deep probabilistic learning. Kristian has published over 170 peer-reviewed technical papers and co-authored a book on statistical relational AI.

Back to the Summer School 2020 overview