Long Short-Term Memory
Hochreiter & Schmidhuber, 1997, Long Short-Term Memory (Neural Computation)
Subscriber deck — free during early access
1 cards in “6.2 Advantages of LSTM” · whole deck
6.2 Advantages of LSTM
- What advantages of LSTM did its authors list?Bridging very long time lags; handling noise, distributed representations and continuous values; no a priori finite number of states (unlike finite automata or HMMs); good generalization; no need for parameter fine-tuning; and O(1) update complexity per weight and time step while being local in space and time.
- Hochreiter & Schmidhuber, 1997, Long Short-Term Memory (Neural Computation), §6.2
Source
- Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long Short-Term Memory. In Neural Computation, pp. 1735–1780. doi:10.1162/neco.1997.9.8.1735