By leveraging tools from the statistical mechanics of complex systems, in these short notes we extend the architecture of a neural network for hetero-associative memory (called three-directional associative memories, TAM) to explore supervised and unsupervised learning protocols. In particular, by providing entropic-heterogeneous datasets to its various layers, we predict and quantify a new emergent phenomenon -- that we term {\em layer's cooperativeness} -- where the interplay of dataset entropies across network's layers enhances their retrieval capabilities Beyond those they would have without reciprocal influence. Naively we would expect layers trained with less informative datasets to develop smaller retrieval regions compared to those pertaining to layers that experienced more information: this does not happen and all the retrieval regions settle to the same amplitude, allowing for optimal retrieval performance globally. This cooperative dynamics marks a significant advancement in understanding emergent computational capabilities within disordered systems.
Beyond disorder. Unveiling cooperativeness in multidirectional associative memories / Alessandrelli, Andrea; Barra, Adriano; Ladiana, Andrea; Lepre, Andrea; Ricci-Tersenghi, Federico. - (2025), pp. 1-7. ( International Conference on Learning Representations (ICLR 2025) – Workshop “New Frontiers in Associative Memories (NFAM 2025)” Singapore ) [10.48550/ARXIV.2503.04454].
Beyond disorder. Unveiling cooperativeness in multidirectional associative memories
Alessandrelli, Andrea
;Barra, Adriano;Ladiana, Andrea;Lepre, Andrea;Ricci-Tersenghi, Federico
2025
Abstract
By leveraging tools from the statistical mechanics of complex systems, in these short notes we extend the architecture of a neural network for hetero-associative memory (called three-directional associative memories, TAM) to explore supervised and unsupervised learning protocols. In particular, by providing entropic-heterogeneous datasets to its various layers, we predict and quantify a new emergent phenomenon -- that we term {\em layer's cooperativeness} -- where the interplay of dataset entropies across network's layers enhances their retrieval capabilities Beyond those they would have without reciprocal influence. Naively we would expect layers trained with less informative datasets to develop smaller retrieval regions compared to those pertaining to layers that experienced more information: this does not happen and all the retrieval regions settle to the same amplitude, allowing for optimal retrieval performance globally. This cooperative dynamics marks a significant advancement in understanding emergent computational capabilities within disordered systems.| File | Dimensione | Formato | |
|---|---|---|---|
|
Alessandrelli_Beyond-disorder_2025.pdf
solo gestori archivio
Note: Atto di convegno in volume
Tipologia:
Documento in Post-print (versione successiva alla peer review e accettata per la pubblicazione)
Licenza:
Tutti i diritti riservati (All rights reserved)
Dimensione
687.85 kB
Formato
Adobe PDF
|
687.85 kB | Adobe PDF | Contatta l'autore |
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.


