Sequence Labeling for Parts of Speech and Named Entities

Jurafsky & Martin, Speech and Language Processing, 3rd ed. draft, ch. 18

17 cards in “18.1 English word classes” · whole deck

18.1 English word classes

  1. Are parts of speech defined semantically?
    Not primarily: although classes have semantic tendencies, they are defined by grammatical relationships with neighboring words and by morphological properties of their affixes.
  2. What tagset does Universal Dependencies use?
    17 tags: open class ADJ, ADV, NOUN, VERB, PROPN, INTJ; closed class ADP, AUX, CCONJ, DET, NUM, PART, PRON, SCONJ; other PUNCT, SYM, X. Features can add finer distinctions (number, case…).
    openclosedother
    NOUN VERB ADJ ADV PROPN INTJADP AUX CCONJ DET NUM PART PRON SCONJPUNCT SYM X
  3. What is the difference between closed and open word classes?
    Closed classes (prepositions, determiners…) have relatively fixed membership, mostly short, frequent function words with grammatical uses. Open classes (nouns, verbs, adjectives, adverbs, interjections) constantly gain new members (iPhone, to fax).
  4. What are function words?
    Closed-class words like of, it, and, you: very short, frequent, and often structuring the grammar.
  5. What grammatical properties characterize English nouns?
    They can occur with determiners (a goat), take possessives (IBM’s revenue), and may be plural (goats). Common nouns include concrete terms, abstractions and verb-like terms (his pacing).
  6. What is the difference between count nouns and mass nouns?
    Count nouns have singular and plural and can be counted (one goat, two goats). Mass nouns denote something conceptualized as a homogeneous group and aren’t counted (snow, salt, communism; *two snows).
  7. Do all languages distinguish nouns, verbs and adjectives?
    Not necessarily: some argue Riau Indonesian and Tongan don’t distinguish nouns and verbs; in Korean, words corresponding to English adjectives behave as a subclass of verbs (“to be beautiful”).
  8. What are the main kinds of adverbs?
    Locative/directional (home, here), degree (extremely, very), manner (slowly, delicately), and temporal (yesterday, Monday). Adverbs modify verbs, other adverbs and whole verb phrases.
  9. What are interjections?
    A small open class: exclamations (oh, alas, um), greetings (hello), and question responses (yes, uh-huh).
  10. What relations can English prepositions express?
    Spatial or temporal relations, literal (on it, before then) or metaphorical (on time, beside herself), and others like marking the agent (written by Shakespeare).
  11. What is a particle, and what is a phrasal verb?
    A particle resembles a preposition or adverb but combines with a verb, often with an extended meaning (turned the paper over). A verb plus particle acting as a unit is a phrasal verb, often non-compositional (turn down = reject, rule out = eliminate).
  12. What are determiners and articles?
    Determiners (this, that) can mark the start of a noun phrase; articles (a, an, the) are frequent determiners marking discourse properties of the noun.
  13. What is the difference between coordinating and subordinating conjunctions? What is a complementizer?
    Coordinating conjunctions (and, or, but) join elements of equal status. Subordinating conjunctions join a main clause with an embedded one. Those linking a verb to its clausal argument, like that in “I thought that you might like some milk”, are complementizers.
  14. What kinds of pronouns are there?
    Personal (you, she, it), possessive (my, their: possession or abstract relation), and wh-pronouns (what, who), used in questions or as complementizers.
  15. What do auxiliary verbs mark? Give English examples.
    Semantic features of the main verb: tense, aspect (completed?), polarity (negated?) and mood (necessary, possible, desired). English: the copula be, do, have, and modals like can, may, must.
  16. What is the Penn Treebank tagset?
    An English-specific tagset (36 core tags) used for many syntactically annotated corpora; unlike UD it distinguishes verb tenses and participles (VBD, VBN, VBG, VBZ…) and has a tag for existential there (EX).
  17. How are the words of a multiword proper name like London Journal of Medicine tagged?
    Each component noun is tagged as a proper noun (PROPN/NNP), even journal and medicine.

Source