May 25 2018

Variational Autoencoder
Training a VAE on MNIST from scratch using Keras.

Aug 21 2017

Projections of Probability Distributions and the Reparameterization Trick
A brief review of M-projection, I-projection, REINFORCE, and the Reparameterization Trick.

Jul 21 2017

Restricted Boltzmann Machine and Contrastive Divergence
RBM training with CD from scratch on MNIST data.

Feb 01 2017

Gibbs Sampling in Pairwise Markov Networks
Discrete pairwise Markov networks are pretty straightforward to work with analytically. Let's use the canonical overcomplete representation, where the sufficient statistics functions are indicator functions …