This paper concerns dynamic neural networks for signal processing: architectural issues are considered but the paper focuses on learning algorithms that work on-line. Locally recurrent neural networks, namely MLP with IIR synapses and generalization of Local Feedback Multi-Layered Networks (LF MLN), are compared to more traditional neural networks, i.e. static MLP with input and/or output buffer (TDNN), FIR MLP and fully recurrent neural networks: simulations results are provided to compare locally recurrent neural networks with TDNN and FIR MLP. Moreover, we propose a new learning algorithm, based on the Back Propagation Through Time and called Causal Back Propagation Through Time (CBPTT), that is faster and more stable than the algorithm previously used for IIR MLP. The algorithm that we propose includes as particular cases the following algorithms: Wan's Temporal Back Propagation, Back Propagation for Sequences (BPS) and Back-Tsoi algorithm
Causal back propagation through time for locally recurrent neural networks / Campolucci, P; Uncini, Aurelio; Piazza, F.. - 3:(1996), pp. 531-534. [10.1109/ISCAS.1996.541650]
Causal back propagation through time for locally recurrent neural networks
UNCINI, Aurelio;
1996
Abstract
This paper concerns dynamic neural networks for signal processing: architectural issues are considered but the paper focuses on learning algorithms that work on-line. Locally recurrent neural networks, namely MLP with IIR synapses and generalization of Local Feedback Multi-Layered Networks (LF MLN), are compared to more traditional neural networks, i.e. static MLP with input and/or output buffer (TDNN), FIR MLP and fully recurrent neural networks: simulations results are provided to compare locally recurrent neural networks with TDNN and FIR MLP. Moreover, we propose a new learning algorithm, based on the Back Propagation Through Time and called Causal Back Propagation Through Time (CBPTT), that is faster and more stable than the algorithm previously used for IIR MLP. The algorithm that we propose includes as particular cases the following algorithms: Wan's Temporal Back Propagation, Back Propagation for Sequences (BPS) and Back-Tsoi algorithmI documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.