Word Association Norms, Mutual Information, and Lexicography

Church & Hanks, 1990, Word Association Norms, Mutual Information, and Lexicography (Computational Linguistics)

Subscriber deck — free during early access

2 cards in “2 Practical applications” · whole deck

2 Practical applications

  1. What applications did Church and Hanks foresee for word association statistics?
    Constraining language models for speech recognition and OCR, disambiguating parses (noun compounds, conjunctions, PP attachment), text retrieval, and helping computational linguists and lexicographers find lexico-syntactic facts and conventional usage.
  2. How could association scores help an OCR system unsure between farm and form?
    Farm is far more likely in “federal _ credit” and form in “some _ of”. Part-of-speech constraints wouldn’t help, since both are common nouns.

Source

  • Kenneth Ward Church and Patrick Hanks. 1990. Word Association Norms, Mutual Information, and Lexicography. In Computational Linguistics, pp. 22–29. https://aclanthology.org/J90-1003/