Accurate Unlexicalized Parsing
Klein & Manning, 2003, Accurate Unlexicalized Parsing (Proceedings of the 41st Annual Meeting of ACL)
Subscriber deck — free during early access
1 cards in “6 Annotations Already in the Treebank” · whole deck
6 Annotations Already in the Treebank
- Do the Penn Treebank’s own function tags (e.g. PP-LOC, ADVP-TMP) help a PCFG?Mostly not: keeping them dropped the raw grammar from 72.62 to 71.49 F1, and the markovized baseline from 77.77 to 72.87. But selected ones help: TMP-NP keeps -TMP on NPs and pushes it down to the head tag (so “CNN last night” isn’t parsed as a compound), and GAPPED-S marks S nodes with empty subjects.
- Klein & Manning, 2003, Accurate Unlexicalized Parsing (Proceedings of the 41st Annual Meeting of ACL), §6, pp. 428–429
Source
- Dan Klein and Christopher D. Manning. 2003. Accurate Unlexicalized Parsing. In Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics, pp. 423–430. https://aclanthology.org/P03-1054/