Estimating the rate-distortion function of real-world data, part 2
Your (beta-)VAE might be secretly estimating the rate-distortion function of your data.
Estimating the rate-distortion function of real-world data, part 1
What is the rate-distortion function, and why we may care about it.
The Ill-defined Problem of Maximum Likelihood Estimation
Why we use maximum likelihood for density estimation, when it breaks down (especially on real-world data), and what can be done about it.
Variational Autoencoder
Training a VAE on MNIST from scratch using Keras.
Restricted Boltzmann Machine and Contrastive Divergence
RBM training with CD from scratch on MNIST data.