Climbing towards NLU: On Meaning, Form, and Understanding in the Age of Data
Bender & Koller, 2020, Climbing towards NLU (Proceedings of the 58th Annual Meeting of ACL)
Subscriber deck — free during early access
1 cards in “5 More constrained thought experiments” · whole deck
5 More constrained thought experiments
- What are the Java and English thought experiments in Bender and Koller?Train any LM on all well-formed Java on GitHub, with no compiler, bytecode or input–output examples, then ask it to execute a program. Or train it on English text and, separately, unlabelled photos, then ask “How many dogs in the picture are jumping?”. Both tests are absurd because the training data lacks what meaning requires: execution or reference.
- Bender & Koller, 2020, Climbing towards NLU (Proceedings of the 58th Annual Meeting of ACL), §5, pp. 5189–5190
Source
- Emily M. Bender and Alexander Koller. 2020. Climbing towards NLU: On Meaning, Form, and Understanding in the Age of Data. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 5185–5198. License: CC BY 4.0. Flashcards adapted from this work. doi:10.18653/v1/2020.acl-main.463 https://aclanthology.org/2020.acl-main.463/