learn.ifs.name

GloVe: Global Vectors for Word Representation

Pennington et al., 2014, GloVe (Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP))

Subscriber deck — free during early access

1 cards in “4.6 Model Analysis: Corpus Size” · whole deck

4.6 Model Analysis: Corpus Size

  1. How did corpus size affect GloVe’s analogy accuracy?
    Syntactic accuracy rose monotonically with corpus size. Semantic accuracy was higher with the smaller Wikipedia corpora than with the larger Gigaword news corpus, probably because many semantic analogies are about cities and countries, which Wikipedia covers comprehensively.
    • Pennington et al., 2014, GloVe (Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP)), §4.6, p. 1540

Source

  • Jeffrey Pennington, Richard Socher and Christopher D. Manning. 2014. GloVe: Global Vectors for Word Representation. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 1532–1543. doi:10.3115/v1/D14-1162 https://aclanthology.org/D14-1162/