Coreference Resolution and Entity Linking

24.9 Winograd Schema problems

1. What is Winograd’s classic example of hard coreference?
   “The city council denied the demonstrators a permit because they feared/advocated violence.” They is the council with feared and the demonstrators with advocated, requiring causal reasoning and world knowledge.
   • Jurafsky & Martin, Speech and Language Processing, 3rd ed. draft, ch. 24, §24.9, p. 563
2. What are the characteristics of Winograd Schema problems?
   Two parties; a pronoun that prefers one but could grammatically refer to either; a question asking which; changing one word flips the answer (“The trophy didn’t fit into the suitcase because it was too large/small”).
   • Jurafsky & Martin, Speech and Language Processing, 3rd ed. draft, ch. 24, §24.9, pp. 563–564
3. What happened to the Winograd Schema Challenge with pretrained language models?
   A large share of the problems became solvable by fine-tuned pretrained LMs, which encode much world knowledge, so harder datasets were proposed (e.g. KnowRef).
   • Jurafsky & Martin, Speech and Language Processing, 3rd ed. draft, ch. 24, §24.9, p. 564