BERT Rediscovers the Classical NLP Pipeline
Tenney et al., 2019, BERT Rediscovers the Classical NLP Pipeline (Proceedings of the 57th Annual Meeting of ACL)
Subscriber deck — free during early access
1 cards in “5 Conclusion” · whole deck
5 Conclusion
- What do Tenney et al.’s results suggest about deep language models and linguistic abstraction?They can represent the syntactic and semantic abstractions traditionally thought necessary for language processing, in roughly pipeline order, and also model complex interactions between levels, using high-level information like predicate–argument relations to disambiguate low-level decisions like part of speech.
- Tenney et al., 2019, BERT Rediscovers the Classical NLP Pipeline (Proceedings of the 57th Annual Meeting of ACL), §5, p. 4597
Source
- Ian Tenney, Dipanjan Das and Ellie Pavlick. 2019. BERT Rediscovers the Classical NLP Pipeline. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp. 4593–4601. License: CC BY 4.0. Flashcards adapted from this work. doi:10.18653/v1/P19-1452 https://aclanthology.org/P19-1452/