Latent Dirichlet Allocation

Blei et al., 2003, Latent Dirichlet Allocation (Journal of Machine Learning Research)

Subscriber deck — free during early access

1 cards in “8 Discussion” · whole deck

8 Discussion

  1. What advantages of LDA as a generative model did Blei et al. stress, and what extensions did they suggest?
    Modularity and extensibility: LDA can be embedded in larger models (e.g. images with captions), unlike LSI. Extensions: other emission distributions (e.g. Gaussian), mixtures of Dirichlets, topics in a time series or conditioned on exogenous variables. Inference alternatives include expectation propagation and MCMC (Griffiths and Steyvers 2002).

Source