Neural Machine Translation of Rare Words with Subword Units
Sennrich et al., 2016, Neural Machine Translation of Rare Words with Subword Units (Proceedings of the 54th Annual Meeting of ACL (Volume 1: Long Papers))
Subscriber deck — free during early access
2 cards in “3 Subword Translation” · whole deck
3 Subword Translation
- Which kinds of words are “transparent”, translatable through units smaller than words?Named entities (copied or transliterated, e.g. Barack Obama in Russian or Japanese script), cognates and loanwords (claustrophobia → German Klaustrophobie), and morphologically complex words such as compounds (solar system → Sonnen|system).
- Sennrich et al., 2016, Neural Machine Translation of Rare Words with Subword Units (Proceedings of the 54th Annual Meeting of ACL (Volume 1: Long Papers)), §3, pp. 1716–1717
- What did Sennrich et al. find when analyzing 100 rare German tokens?Most were potentially translatable from English through smaller units: 56 compounds, 21 names, 6 loanwords, 5 cases of transparent affixation, 1 number and 1 computer language identifier.
- Sennrich et al., 2016, Neural Machine Translation of Rare Words with Subword Units (Proceedings of the 54th Annual Meeting of ACL (Volume 1: Long Papers)), §3, pp. 1716–1717
Source
- Rico Sennrich, Barry Haddow and Alexandra Birch. 2016. Neural Machine Translation of Rare Words with Subword Units. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 1715–1725. License: CC BY 4.0. Flashcards adapted from this work. doi:10.18653/v1/P16-1162 https://aclanthology.org/P16-1162/