A Neural Probabilistic Language Model
Bengio et al., 2003, A Neural Probabilistic Language Model (Journal of Machine Learning Research)
Subscriber deck — free during early access
1 cards in “4 Experimental Results” · whole deck
4 Experimental Results
- On which corpora was Bengio et al.’s neural LM evaluated?The Brown corpus (about 1.18M words: 800k train, 200k validation, 181k test; words with frequency ≤ 3 merged, \(|V| = 16{,}383\)) and AP News 1995–96 (about 14M training words, \(|V| = 17{,}964\) after lowercasing and mapping rare words, numbers and proper nouns to special symbols).
- Bengio et al., 2003, A Neural Probabilistic Language Model (Journal of Machine Learning Research), §4, p. 1147
Source
- Yoshua Bengio, Réjean Ducharme, Pascal Vincent and Christian Jauvin. 2003. A Neural Probabilistic Language Model. In Journal of Machine Learning Research, pp. 1137–1155. https://www.jmlr.org/papers/v3/bengio03a.html