Accurate Unlexicalized Parsing

Klein & Manning, 2003, Accurate Unlexicalized Parsing (Proceedings of the 41st Annual Meeting of ACL)

Subscriber deck — free during early access

2 cards in “3 External vs. Internal Annotation” · whole deck

3 External vs. Internal Annotation

  1. What is the difference between external and internal annotation, in Klein and Manning’s terms?
    External annotation (marked ^X) records a feature of a node’s environment that influences its expansion, like parent annotation. Internal annotation (marked -X) records a feature of the node’s hidden contents that influences its distribution, like head lexicalization (a radical case).
  2. What do UNARY-INTERNAL, UNARY-DT and UNARY-RB do?
    UNARY-INTERNAL marks nodes with a single child, so unary rewrites are confined to contexts where they occur (+0.55 F1 alone). Marking only-child tags captures distributional distinctions the Penn tags conflate: demonstratives (that, those) vs determiners (the, a), and e.g. as well vs also.

Source

  • Dan Klein and Christopher D. Manning. 2003. Accurate Unlexicalized Parsing. In Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics, pp. 423–430. https://aclanthology.org/P03-1054/