A new training algorithm is presented as a faster alternative to the backpropagation method. The new approach is based on the solution of a linear system at each step of the learning phase. The squared error at the output of each layer before the nonlinearity is minimised on the entire set of the learning patterns by a block Least squares algorithm. The optimal weights for each layer are then computed by using the Singular Value Decomposition technique. The simulation results have shown considerable improvements from the point of view of both the accuracy and the speed of convergence.
LS-based training algorithm for neural networks / DI CLAUDIO, Elio; Parisi, Raffaele; Orlandi, Gianni. - STAMPA. - (1993), pp. 23-29. (Intervento presentato al convegno 1993 IEEE Workshop on Neural Networks for Signal Processing tenutosi a Linthicum Height - Baltimore - USA nel Sept. 7-9, 1993).
LS-based training algorithm for neural networks
DI CLAUDIO, Elio;PARISI, Raffaele;ORLANDI, Gianni
1993
Abstract
A new training algorithm is presented as a faster alternative to the backpropagation method. The new approach is based on the solution of a linear system at each step of the learning phase. The squared error at the output of each layer before the nonlinearity is minimised on the entire set of the learning patterns by a block Least squares algorithm. The optimal weights for each layer are then computed by using the Singular Value Decomposition technique. The simulation results have shown considerable improvements from the point of view of both the accuracy and the speed of convergence.I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.