RNNs and LSTMs

Introduction

1. How do recurrent neural networks represent time differently from feedforward and transformer networks?
   They process the sequence one item at a time and carry the prior context in recurrent connections, without a fixed-size window, so decisions can depend on information from hundreds of words back.
   • Jurafsky & Martin, Speech and Language Processing, 3rd ed. draft, ch. 14, Introduction, p. 302