learn.ifs.name

GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding

Wang et al., 2019, GLUE (7th International Conference on Learning Representations (ICLR 2019))

Subscriber deck — free during early access

1 cards in “3.1 Single-Sentence Tasks” · whole deck

3.1 Single-Sentence Tasks

  1. What is CoLA, and why is it scored with the Matthews correlation coefficient?
    The Corpus of Linguistic Acceptability: sentences from linguistics books and articles labelled grammatical or not. Its classes are unbalanced, and Matthews correlation (from −1 to 1, 0 for uninformed guessing) suits unbalanced binary classification.
    • Wang et al., 2019, GLUE (7th International Conference on Learning Representations (ICLR 2019)), §3.1

Source

  • Alex Wang, Amanpreet Singh, Julian Michael, Felix Hill, Omer Levy and Samuel R. Bowman. 2019. GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding. In 7th International Conference on Learning Representations (ICLR 2019). https://openreview.net/forum?id=rJ4km2R5t7