In this paper we adapt the broken replica interpolation technique (developed by Francesco Guerra to deal with the Sherrington-Kirkpatrick model, namely a pairwise mean-field spin-glass whose couplings are i.i.d. standard Gaussian variables) in order to work also with the Hopfield model (i.e. a pairwise mean-field neural-network whose couplings are drawn according to Hebb's learning rule): This is accomplished by grafting Guerra's telescopic averages on the transport equation technique, recently developed by some of the authors. As an overture, we apply the technique to solve the Sherrington-Kirkpatrick model with i.i.d. Gaussian couplings centered at J 0 and with finite variance J; the mean J 0 provides a ferromagnetic contribution to be detected in a noisy environment tuned by J, hence making this model a natural test-case to be investigated before addressing the Hopfield model. For both the models, an explicit expression of their quenched free energy in terms of their natural order parameters is obtained at the Kth step (K arbitrary, but finite) of replica-symmetry-breaking. In particular, for the Hopfield model, by assuming that the overlaps respect Parisi's decomposition (following the ziqqurat ansatz) and that the Mattis magnetization is self-Averaging, we recover previous results obtained via replica-Trick by Amit, Crisanti and Gutfreund (1RSB) and by Steffan and Kühn (2RSB).

Replica symmetry breaking in neural networks: A few steps toward rigorous results / Agliari, E.; Albanese, L.; Barra, A.; Ottaviani, G.. - In: JOURNAL OF PHYSICS. A, MATHEMATICAL AND THEORETICAL. - ISSN 1751-8113. - 53:41(2020), p. 415005. [10.1088/1751-8121/abaf2c]

Replica symmetry breaking in neural networks: A few steps toward rigorous results

Agliari E.;
2020

Abstract

In this paper we adapt the broken replica interpolation technique (developed by Francesco Guerra to deal with the Sherrington-Kirkpatrick model, namely a pairwise mean-field spin-glass whose couplings are i.i.d. standard Gaussian variables) in order to work also with the Hopfield model (i.e. a pairwise mean-field neural-network whose couplings are drawn according to Hebb's learning rule): This is accomplished by grafting Guerra's telescopic averages on the transport equation technique, recently developed by some of the authors. As an overture, we apply the technique to solve the Sherrington-Kirkpatrick model with i.i.d. Gaussian couplings centered at J 0 and with finite variance J; the mean J 0 provides a ferromagnetic contribution to be detected in a noisy environment tuned by J, hence making this model a natural test-case to be investigated before addressing the Hopfield model. For both the models, an explicit expression of their quenched free energy in terms of their natural order parameters is obtained at the Kth step (K arbitrary, but finite) of replica-symmetry-breaking. In particular, for the Hopfield model, by assuming that the overlaps respect Parisi's decomposition (following the ziqqurat ansatz) and that the Mattis magnetization is self-Averaging, we recover previous results obtained via replica-Trick by Amit, Crisanti and Gutfreund (1RSB) and by Steffan and Kühn (2RSB).
2020
disordered systems; Hopfield model; replica symmetry breaking; rigorous methods; statistical mechanics
01 Pubblicazione su rivista::01a Articolo in rivista
Replica symmetry breaking in neural networks: A few steps toward rigorous results / Agliari, E.; Albanese, L.; Barra, A.; Ottaviani, G.. - In: JOURNAL OF PHYSICS. A, MATHEMATICAL AND THEORETICAL. - ISSN 1751-8113. - 53:41(2020), p. 415005. [10.1088/1751-8121/abaf2c]
File allegati a questo prodotto
File Dimensione Formato  
Agliari_Replica-symmetry_2020.pdf

solo gestori archivio

Tipologia: Versione editoriale (versione pubblicata con il layout dell'editore)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 826.69 kB
Formato Adobe PDF
826.69 kB Adobe PDF   Contatta l'autore

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/1449429
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 13
  • ???jsp.display-item.citation.isi??? 13
social impact