learn.ifs.name

GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding

Wang et al., 2019, GLUE (7th International Conference on Learning Representations (ICLR 2019))

Subscriber deck — free during early access

1 cards in “3.4 Evaluation” · whole deck

3.4 Evaluation

  1. How is a system’s GLUE score computed?
    Predictions on the test sets are uploaded to gluebenchmark.com; the score is the macro-average of per-task scores, where tasks with two metrics contribute their unweighted average.
    • Wang et al., 2019, GLUE (7th International Conference on Learning Representations (ICLR 2019)), §3.4

Source

  • Alex Wang, Amanpreet Singh, Julian Michael, Felix Hill, Omer Levy and Samuel R. Bowman. 2019. GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding. In 7th International Conference on Learning Representations (ICLR 2019). https://openreview.net/forum?id=rJ4km2R5t7