Word Association Norms, Mutual Information, and Lexicography

Church & Hanks, 1990, Word Association Norms, Mutual Information, and Lexicography (Computational Linguistics)

Subscriber deck — free during early access

1 cards in “6 Preprocessing with a part of speech tagger” · whole deck

6 Preprocessing with a part of speech tagger

Why tag the corpus before measuring associations with to?
To separate the preposition to from the infinitive marker. Verbs associated with to/IN include alluding, adhere, amounted, revert, relegated; with to/TO obligated, trying, compelled, enables, supposed, intends.
- Church & Hanks, 1990, Word Association Norms, Mutual Information, and Lexicography (Computational Linguistics), §6, p. 25

Source

Kenneth Ward Church and Patrick Hanks. 1990. Word Association Norms, Mutual Information, and Lexicography. In Computational Linguistics, pp. 22–29. https://aclanthology.org/J90-1003/