A heterogeneous information network (heterogeneous graph) federated learning plays a crucial role in enabling multi-party collaboration in the IoT system. However, due to differences in business and data, the local models of each participant are heterogeneous and unable to achieve federated aggregation. Furthermore, the non-independent and identically distributed (non-IID) coupling topology structure among participants severely impacts the performance of federated learning. Given the lack of appropriate solutions to these issues, this study proposes a novel heterogeneous graph federated learning framework (HGFL+) based on self-simulation and meta-model aggregation, which includes the following two innovative techniques: (1) The missing coupling supplement module simulates new neighbor nodes on its original heterogeneous graph, and constructs associated edges using multiple encoder-decoder structures, thereby achieving the supplement of missing neighbors with better results than external generative methods. (2) The heterogeneous model aggregation algorithm realizes the fusion of multi-party heterogeneous graph information through mapping, splitting, aggregating, and recombining multiple stages based on the meta-model (the largest basic model unit among participants). We theoretically analyzed the applicability and effectiveness of HGFL+, demonstrating the generalization boundary of HGFL+. Meanwhile, multi-dimensional empirical verification of classification performance, convergence effect, time overhead, model size, and application extension (model, task, domain) validates the effectiveness of the proposed method.

Self-simulation and Meta-Model Aggregation Based Heterogeneous Graph Coupled Federated Learning / Yan, C.; Lu, X.; Lio, P.; Hui, P.; He, D.. - In: IEEE INTERNET OF THINGS JOURNAL. - ISSN 2327-4662. - (2024). [10.1109/JIOT.2024.3462724]

Self-simulation and Meta-Model Aggregation Based Heterogeneous Graph Coupled Federated Learning

Lio P.;
2024

Abstract

A heterogeneous information network (heterogeneous graph) federated learning plays a crucial role in enabling multi-party collaboration in the IoT system. However, due to differences in business and data, the local models of each participant are heterogeneous and unable to achieve federated aggregation. Furthermore, the non-independent and identically distributed (non-IID) coupling topology structure among participants severely impacts the performance of federated learning. Given the lack of appropriate solutions to these issues, this study proposes a novel heterogeneous graph federated learning framework (HGFL+) based on self-simulation and meta-model aggregation, which includes the following two innovative techniques: (1) The missing coupling supplement module simulates new neighbor nodes on its original heterogeneous graph, and constructs associated edges using multiple encoder-decoder structures, thereby achieving the supplement of missing neighbors with better results than external generative methods. (2) The heterogeneous model aggregation algorithm realizes the fusion of multi-party heterogeneous graph information through mapping, splitting, aggregating, and recombining multiple stages based on the meta-model (the largest basic model unit among participants). We theoretically analyzed the applicability and effectiveness of HGFL+, demonstrating the generalization boundary of HGFL+. Meanwhile, multi-dimensional empirical verification of classification performance, convergence effect, time overhead, model size, and application extension (model, task, domain) validates the effectiveness of the proposed method.
2024
Coupled Heterogeneous Graphs; Federated Learning; Heterogeneous Model Aggregation; Missing Graph Completion
01 Pubblicazione su rivista::01a Articolo in rivista
Self-simulation and Meta-Model Aggregation Based Heterogeneous Graph Coupled Federated Learning / Yan, C.; Lu, X.; Lio, P.; Hui, P.; He, D.. - In: IEEE INTERNET OF THINGS JOURNAL. - ISSN 2327-4662. - (2024). [10.1109/JIOT.2024.3462724]
File allegati a questo prodotto
File Dimensione Formato  
Yan_Self-simulation_and_2024.pdf

solo gestori archivio

Tipologia: Versione editoriale (versione pubblicata con il layout dell'editore)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 9.09 MB
Formato Adobe PDF
9.09 MB Adobe PDF   Contatta l'autore

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/1723996
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
social impact