Natural Language Processing (Almost) from Scratch
Collobert et al., 2011, Natural Language Processing (Almost) from Scratch (Journal of Machine Learning Research)
Subscriber deck — free during early access
1 cards in “6.6 Word Representations” · whole deck
6.6 Word Representations
- How did the language model embeddings compare with Brown clusters?In the non-linear network they did at least as well as Brown cluster features on all tasks, and fine-tuning them helped further. In a convex (linear, CRF-like) setup with fixed representations the results were mixed, and non-convex was usually better for both.
- Collobert et al., 2011, Natural Language Processing (Almost) from Scratch (Journal of Machine Learning Research), §6.6, pp. 2524–2526
Source
- Ronan Collobert, Jason Weston, Léon Bottou, Michael Karlen, Koray Kavukcuoglu and Pavel Kuksa. 2011. Natural Language Processing (Almost) from Scratch. In Journal of Machine Learning Research, pp. 2493–2537. https://www.jmlr.org/papers/v12/collobert11a.html