Non-parametric classification method| en.wikipedia.org
Neural network that learns efficient data encoding in an unsupervised manner| en.wikipedia.org
Mathematical statistics distance measure| en.wikipedia.org
Professor Naftali Tishby passed away in 2021. Hope the post can introduce his cool idea of information bottleneck to more people. Recently I watched the talk “Information Theory in Deep Learning” by Prof Naftali Tishby and found it very interesting. He presented how to apply the information theory to study the growth and transformation of deep neural networks during training. Using the Information Bottleneck (IB) method, he proposed a new learning bound for deep neural networks (DNN), as ...| lilianweng.github.io
Understanding Variational Autoencoders (VAEs) from two perspectives: deep learning and graphical models.| Jaan Altosaar