Long Short-Term Memory

Hochreiter & Schmidhuber, 1997, Long Short-Term Memory (Neural Computation)

Subscriber deck — free during early access

1 cards in “7 Conclusion” · whole deck

7 Conclusion

What is the core idea of LSTM in one sentence?
Each memory cell’s internal architecture guarantees constant error flow within its CEC (given truncated backprop), and multiplicative input and output gates learn to open and close access to that error flow, protecting the stored content and the rest of the network.
- Hochreiter & Schmidhuber, 1997, Long Short-Term Memory (Neural Computation), §7

Source

Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long Short-Term Memory. In Neural Computation, pp. 1735–1780. doi:10.1162/neco.1997.9.8.1735