SQuAD: 100,000+ Questions for Machine Comprehension of Text

Rajpurkar et al., 2016, SQuAD (Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing (EMNLP))

Subscriber deck — free during early access

1 cards in “5 Methods” · whole deck

5 Methods

  1. How were candidate answers generated for the SQuAD baselines, and what ceiling does that impose?
    Only constituents of the sentence’s constituency parse, not all \(O(L^2)\) spans. Ignoring punctuation and articles, 77.3% of correct answers are constituents, an effective ceiling for these methods.
    • Rajpurkar et al., 2016, SQuAD (Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing (EMNLP)), §5, pp. 2387–2388

Source

  • Pranav Rajpurkar, Jian Zhang, Konstantin Lopyrev and Percy Liang. 2016. SQuAD: 100,000+ Questions for Machine Comprehension of Text. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 2383–2392. License: CC BY 4.0. Flashcards adapted from this work. doi:10.18653/v1/D16-1264 https://aclanthology.org/D16-1264/