learn.ifs.name

Climbing towards NLU: On Meaning, Form, and Understanding in the Age of Data

Bender & Koller, 2020, Climbing towards NLU (Proceedings of the 58th Annual Meeting of ACL)

Subscriber deck — free during early access

2 cards in “1 Introduction” · whole deck

1 Introduction

  1. What is the central thesis of Bender and Koller (2020)?
    A system trained only on linguistic form has a priori no way to learn meaning, so claims that large language models “understand” language or capture “meaning” are overclaims; clarity about form versus meaning will guide the field towards better science of natural language understanding.
    • Bender & Koller, 2020, Climbing towards NLU (Proceedings of the 58th Annual Meeting of ACL), §1, p. 5185
  2. How do Bender and Koller define a language model?
    Any system trained only on string prediction, over characters, words or sentences, sequentially or not.
    • Bender & Koller, 2020, Climbing towards NLU (Proceedings of the 58th Annual Meeting of ACL), §1, p. 5185

Source