A tutorial on training recurrent neural networks

时间:2021-08-11 02:46:26
【文件属性】:

文件名称:A tutorial on training recurrent neural networks

文件大小:1.35MB

文件格式:PDF

更新时间:2021-08-11 02:46:26

recurrent  neural  networks

Abstract: This tutorial is a worked-out version of a 5-hour course originally held at AIS in September/October 2002. It has two distinct components. First, it contains a mathematically-oriented crash course on traditional training methods for recurrent neural networks, covering back-propagation through time (BPTT), real-time recurrent learning (RTRL), and extended Kalman filtering approaches (EKF). This material is covered in Sections 2 – 5. The remaining sections 1 and 6 – 9 are much more gentle, more detailed, and illustrated with simple examples. They are intended to be useful as a stand-alone tutorial for the echo state network (ESN) approach to recurrent neural network training.


网友评论