Processing math: 100%

Rylan Schaeffer

Logo
Resume
Research
Learning
Blog
Teaching
Jokes
Kernel Papers


“Our freedom to doubt was born of a struggle against authority in the early days of science. It was a very deep and strong struggle. Permit us to question - to doubt, that's all - not to be sure.“

15 April 2021

A sequential algorithm for fast fitting of Dirichlet process mixture models

by Nott, Zhang, Yau and Jasra (Journal of Computational and Graphical Statistics 2014)

Background

Previously, Wang and Dunson (2011) proposed a fast inference algorithm for Dirichlet process mixture models that could be applied in an online setting, fancifully called Sequential Updating and Greedy Search (SUGS). The authors actually didn’t intend for their algorithm to function online, recommending that to remove the dependency on observation order, one should average over random orderings of the observations. The way SUGS made inference easy was by taking the MAP of the latent cluster’s posterior, deterministically placing the observation at a single cluster.

Overview

Conceptual Notes

tags: mixture-models - dirichlet-process - bayesian-nonparametrics - clustering