Estimating the rate-distortion function of real-world data, part 2

Your (beta-)VAE might be secretly estimating the rate-distortion function of your data.

Estimating the rate-distortion function of real-world data, part 1

What is the rate-distortion function, and why we may care about it.

The Ill-defined Problem of Maximum Likelihood Estimation

Why we use maximum likelihood for density estimation, when it breaks down (especially on real-world data), and what can be done about it.

Variational Autoencoder

Training a VAE on MNIST from scratch using Keras.

Restricted Boltzmann Machine and Contrastive Divergence

RBM training with CD from scratch on MNIST data.