In this work we study of the dynamics of large-size random neural networks. Different methods have been developed to analyze their behavior, and most of them rely on heuristic methods based on Gaussian assumptions regarding the fluctuations in the limit of infinite sizes. These approaches, however, do not justify the underlying assumptions systematically. Furthermore, they are incapable of deriving in general the stability of the derived mean-field equations, and they are not amenable to analysis of finite-size corrections. Here we present a systematic method based on path integrals which overcomes these limitations. We apply the method to a large nonlinear rate-based neural network with random asymmetric connectivity matrix. We derive the dynamic mean field (DMF) equations for the system and the Lyapunov exponent of the system. Although the main results are well known, here we present the detailed calculation of the spectrum of fluctuations around the mean-field equations from which we derive the general stability conditions for the DMF states. The methods presented here can be applied to neural networks with more complex dynamics and architectures. In addition, the theory can be used to compute systematic finite-size corrections to the mean-field equations.

Path integral approach to random neural networks / Crisanti, A.; Sompolinksy, H.. - In: PHYSICAL REVIEW. E. - ISSN 2470-0045. - 98:6(2018). [10.1103/PhysRevE.98.062120]

Path integral approach to random neural networks

Crisanti, A.
Primo
;
2018

Abstract

In this work we study of the dynamics of large-size random neural networks. Different methods have been developed to analyze their behavior, and most of them rely on heuristic methods based on Gaussian assumptions regarding the fluctuations in the limit of infinite sizes. These approaches, however, do not justify the underlying assumptions systematically. Furthermore, they are incapable of deriving in general the stability of the derived mean-field equations, and they are not amenable to analysis of finite-size corrections. Here we present a systematic method based on path integrals which overcomes these limitations. We apply the method to a large nonlinear rate-based neural network with random asymmetric connectivity matrix. We derive the dynamic mean field (DMF) equations for the system and the Lyapunov exponent of the system. Although the main results are well known, here we present the detailed calculation of the spectrum of fluctuations around the mean-field equations from which we derive the general stability conditions for the DMF states. The methods presented here can be applied to neural networks with more complex dynamics and architectures. In addition, the theory can be used to compute systematic finite-size corrections to the mean-field equations.
2018
Path Integral; Neural Networks; Statistical Field Theory;
01 Pubblicazione su rivista::01a Articolo in rivista
Path integral approach to random neural networks / Crisanti, A.; Sompolinksy, H.. - In: PHYSICAL REVIEW. E. - ISSN 2470-0045. - 98:6(2018). [10.1103/PhysRevE.98.062120]
File allegati a questo prodotto
File Dimensione Formato  
Crisanti_Path integral_2018.pdf

solo gestori archivio

Tipologia: Versione editoriale (versione pubblicata con il layout dell'editore)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 498 kB
Formato Adobe PDF
498 kB Adobe PDF   Contatta l'autore

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/1212288
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 53
  • ???jsp.display-item.citation.isi??? 43
social impact