In this paper, we design, analyze the convergence properties, address the implementation aspects, and numerically test the performance of AFAFed. This is a novel Asynchronous Fair Adaptive Federated learning framework for stream-oriented IoT application environments, which are featured by time-varying operating conditions, heterogeneous resource-limited devices (i.e., coworkers), non-i.i.d. local training data and unreliable communication links. The key new of AFAFed is the synergic co-design of: (i) two sets of adaptively tuned tolerance thresholds and fairness coefficients at the coworkers and central server, respectively; and, (ii) a distributed adaptive mechanism, which allows each coworker to adaptively tune own communication rate. The convergence properties of AFAFed under (possibly) non-convex loss functions is guaranteed by a set of new analytical bounds, which formally unveil the impact on the resulting AFAFed convergence rate of a number of Federated Learning (FL) parameters, like, first and second moments of the per-coworker number of consecutive model updates, data skewness, communication packet-loss probability, and maximum/minimum values of the (adaptively tuned) mixing coefficient used for model aggregation. Extensive numerical tests show that AFAFed is capable to improve test accuracy by up to 20% and reduce training time by up to 50%, compared to state-of-the-art FL schemes, even under challenging learning scenarios featured by deep Machine Learning (ML) models, data skewness, coworker heterogeneity and unreliable communication.

AFAFed—Asynchronous Fair Adaptive Federated learning for IoT stream applications / Baccarelli, E.; Scarpiniti, M.; Momenzadeh, A.; Sarv Ahrabi, S.. - In: COMPUTER COMMUNICATIONS. - ISSN 0140-3664. - 195:(2022), pp. 376-402. [10.1016/j.comcom.2022.09.016]

AFAFed—Asynchronous Fair Adaptive Federated learning for IoT stream applications

Baccarelli E.;Scarpiniti M.
;
Momenzadeh A.;Sarv Ahrabi S.
2022

Abstract

In this paper, we design, analyze the convergence properties, address the implementation aspects, and numerically test the performance of AFAFed. This is a novel Asynchronous Fair Adaptive Federated learning framework for stream-oriented IoT application environments, which are featured by time-varying operating conditions, heterogeneous resource-limited devices (i.e., coworkers), non-i.i.d. local training data and unreliable communication links. The key new of AFAFed is the synergic co-design of: (i) two sets of adaptively tuned tolerance thresholds and fairness coefficients at the coworkers and central server, respectively; and, (ii) a distributed adaptive mechanism, which allows each coworker to adaptively tune own communication rate. The convergence properties of AFAFed under (possibly) non-convex loss functions is guaranteed by a set of new analytical bounds, which formally unveil the impact on the resulting AFAFed convergence rate of a number of Federated Learning (FL) parameters, like, first and second moments of the per-coworker number of consecutive model updates, data skewness, communication packet-loss probability, and maximum/minimum values of the (adaptively tuned) mixing coefficient used for model aggregation. Extensive numerical tests show that AFAFed is capable to improve test accuracy by up to 20% and reduce training time by up to 50%, compared to state-of-the-art FL schemes, even under challenging learning scenarios featured by deep Machine Learning (ML) models, data skewness, coworker heterogeneity and unreliable communication.
Adaptive asynchronous FL; Distributed ML; Heterogeneous fog computing ecosystems; Non-i.i.d. data; Personalization-vs.-generalization trade-off
01 Pubblicazione su rivista::01a Articolo in rivista
AFAFed—Asynchronous Fair Adaptive Federated learning for IoT stream applications / Baccarelli, E.; Scarpiniti, M.; Momenzadeh, A.; Sarv Ahrabi, S.. - In: COMPUTER COMMUNICATIONS. - ISSN 0140-3664. - 195:(2022), pp. 376-402. [10.1016/j.comcom.2022.09.016]
File allegati a questo prodotto
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11573/1655821
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
social impact