Word Association Norms, Mutual Information, and Lexicography

Church & Hanks, 1990, Word Association Norms, Mutual Information, and Lexicography (Computational Linguistics)

Subscriber deck — free during early access

1 cards in “7 Preprocessing with a parser” · whole deck

7 Preprocessing with a parser

  1. How did Hindle use a parser to find verb–object associations?
    Parse the corpus into subject–verb–object triples and compute mutual information between verbs and objects across triples, e.g. \(I(drink/V, beer/O) = \log_2 \frac{29N}{660 \times 195} \approx 9.9\). This reveals what you can drink (martinis, champagne, beer, coffee…) or do to a telephone (sit by, disconnect, answer, hang up…).

Source

  • Kenneth Ward Church and Patrick Hanks. 1990. Word Association Norms, Mutual Information, and Lexicography. In Computational Linguistics, pp. 22–29. https://aclanthology.org/J90-1003/