The recent interest in federated learning has initiated the investigation for efficient models deployable in scenarios with strict communication and computational constraints. Furthermore, the inherent privacy concerns in decentralized and federated learning call for efficient distribution of information in a network of interconnected agents. Therefore, we propose a novel distributed classification solution that is based on shallow randomized networks equipped with a compression mechanism that is used for sharing the local model in the federated context. We make extensive use of hyperdimensional computing both in the local network model and in the compressed communication protocol, which is enabled by the binding and the superposition operations. Accuracy, precision, and stability of our proposed approach are demonstrated on a collection of datasets with several network topologies and for different data partitioning schemes.

Few-shot Federated Learning in Randomized Neural Networks via Hyperdimensional Computing / Rosato, A.; Panella, M.; Osipov, E.; Kleyko, D.. - 2022-:(2022), pp. 1-8. (Intervento presentato al convegno 2022 International Joint Conference on Neural Networks, IJCNN 2022 tenutosi a Padova, Italy) [10.1109/IJCNN55064.2022.9892007].

Few-shot Federated Learning in Randomized Neural Networks via Hyperdimensional Computing

Rosato A.
;
Panella M.;
2022

Abstract

The recent interest in federated learning has initiated the investigation for efficient models deployable in scenarios with strict communication and computational constraints. Furthermore, the inherent privacy concerns in decentralized and federated learning call for efficient distribution of information in a network of interconnected agents. Therefore, we propose a novel distributed classification solution that is based on shallow randomized networks equipped with a compression mechanism that is used for sharing the local model in the federated context. We make extensive use of hyperdimensional computing both in the local network model and in the compressed communication protocol, which is enabled by the binding and the superposition operations. Accuracy, precision, and stability of our proposed approach are demonstrated on a collection of datasets with several network topologies and for different data partitioning schemes.
2022
2022 International Joint Conference on Neural Networks, IJCNN 2022
few-shot federated learning; randomized neural networks; hyperdimensional computing
04 Pubblicazione in atti di convegno::04b Atto di convegno in volume
Few-shot Federated Learning in Randomized Neural Networks via Hyperdimensional Computing / Rosato, A.; Panella, M.; Osipov, E.; Kleyko, D.. - 2022-:(2022), pp. 1-8. (Intervento presentato al convegno 2022 International Joint Conference on Neural Networks, IJCNN 2022 tenutosi a Padova, Italy) [10.1109/IJCNN55064.2022.9892007].
File allegati a questo prodotto
File Dimensione Formato  
Rosato_Few-shot_2022.pdf

solo gestori archivio

Tipologia: Versione editoriale (versione pubblicata con il layout dell'editore)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 2.18 MB
Formato Adobe PDF
2.18 MB Adobe PDF   Contatta l'autore

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/1658032
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 2
  • ???jsp.display-item.citation.isi??? 0
social impact