Mar 02 2022

Estimating the rate-distortion function of real-world data, part 1
What is the rate-distortion function, and why we may care about it.

Oct 28 2021

The Ill-defined Problem of Maximum Likelihood Estimation
Why we use maximum likelihood for density estimation, when it breaks down (especially on real-world data), and what can be done about it.

Feb 07 2017

Linear Regression as Conditional Random Field
Classical linear regression simply uses a linear Gaussian model (CRF).

Feb 01 2017

Gibbs Sampling in Pairwise Markov Networks
Discrete pairwise Markov networks are pretty straightforward to work with analytically. Let's use the canonical overcomplete representation, where the sufficient statistics functions are indicator functions …