https://www.cs.toronto.edu/~hinton/csc2535/notes/lec10new.pdf
Distributed hidden state that allows
them to store a lot of information
about the past efficiently.
Non-linear dynamics that allows
them to update their hidden state in
complicated ways.
RNN的哲学是过去指导现在。
![Recurrent neural networks are very powerful, because they combine two properties Recurrent neural networks are very powerful, because they combine two properties](https://image.shishitao.com:8440/aHR0cHM6Ly9iYnNtYXguaWthZmFuLmNvbS9zdGF0aWMvTDNCeWIzaDVMMmgwZEhCekwybHRZV2RsY3pJd01UY3VZMjVpYkc5bmN5NWpiMjB2WW14dlp5OHhNREEyTlRBM0x6SXdNVGN4TVM4eE1EQTJOVEEzTFRJd01UY3hNVEEyTURFd05qSXhOekV5TFRrNE5UQTJPRGsxTUM1d2JtYz0uanBn.jpg?w=700&webp=1)