Sequence to Sequence Learning with Neural Networks
Sutskever et al., 2014, Sequence to Sequence Learning with Neural Networks (Advances in Neural Information Processing Systems 27 (NIPS 2014))
Subscriber deck — free during early access
1 cards in “3.8 Model Analysis” · whole deck
3.8 Model Analysis
- What did PCA projections of seq2seq sentence vectors show?Phrases cluster by meaning, which is sensitive to word order (“John admires Mary” vs “Mary admires John” land apart) but fairly invariant to active vs passive voice (“I gave her a card in the garden” near “In the garden, I gave her a card” and “She was given a card by me”), something a bag-of-words model couldn’t capture.
- Sutskever et al., 2014, Sequence to Sequence Learning with Neural Networks (Advances in Neural Information Processing Systems 27 (NIPS 2014)), §3.8
Source
- Ilya Sutskever, Oriol Vinyals and Quoc V. Le. 2014. Sequence to Sequence Learning with Neural Networks. In Advances in Neural Information Processing Systems 27 (NIPS 2014). https://papers.nips.cc/paper/2014/hash/5a18e133cbf9f257297f410bb7eca942-Abstract.html