learn.ifs.name

GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding

Wang et al., 2019, GLUE (7th International Conference on Learning Representations (ICLR 2019))

Subscriber deck — free during early access

1 cards in “8 Conclusion” · whole deck

8 Conclusion

  1. What did the GLUE authors conclude about general-purpose NLU models in 2018?
    Joint training and transfer (attention plus ELMo) helped, but absolute performance remained low and models failed, often spectacularly, on many linguistic phenomena, so how to design general-purpose NLU models was still open.
    • Wang et al., 2019, GLUE (7th International Conference on Learning Representations (ICLR 2019)), §8

Source

  • Alex Wang, Amanpreet Singh, Julian Michael, Felix Hill, Omer Levy and Samuel R. Bowman. 2019. GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding. In 7th International Conference on Learning Representations (ICLR 2019). https://openreview.net/forum?id=rJ4km2R5t7