On the Dangers of Stochastic Parrots: Can Language Models Be Too Big?
Bender et al., 2021, On the Dangers of Stochastic Parrots (Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency (FAccT ’21))
Subscriber deck — free during early access
1 cards in “4.4 Curation, Documentation & Accountability” · whole deck
4.4 Curation, Documentation & Accountability
- What is documentation debt, and how do Bender et al. propose to avoid it?Building data sets so large and undocumented that they can’t be documented post hoc, so harms persist without recourse. Budget for curation and documentation from the start of a project and collect only as much data as can be thoroughly documented.
- Bender et al., 2021, On the Dangers of Stochastic Parrots (Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency (FAccT ’21)), §4.4, p. 615
Source
- Emily M. Bender, Timnit Gebru, Angelina McMillan-Major and Shmargaret Shmitchell. 2021. On the Dangers of Stochastic Parrots: Can Language Models Be Too Big?. In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency (FAccT ’21), pp. 610–623. License: CC BY 4.0. Flashcards adapted from this work. doi:10.1145/3442188.3445922