Reference : FedFog: Network-Aware Optimization of Federated Learning over Wireless Fog-Cloud System
Scientific journals : Article
Engineering, computing & technology : Electrical & electronics engineering
http://hdl.handle.net/10993/50798
FedFog: Network-Aware Optimization of Federated Learning over Wireless Fog-Cloud System
English
Nguyen, van Dinh mailto [University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > SigCom >]
Chatzinotas, Symeon mailto [University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > SigCom >]
Ottersten, Björn mailto [University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > >]
Duong, Trung Q. []
In press
IEEE Transactions on Wireless Communications
Institute of Electrical and Electronics Engineers
Yes (verified by ORBilu)
1536-1276
1558-2248
New York
NY
[en] Distributed learning ; edge intelligence ; federated learning
[en] Federated learning (FL) is capable of performing large distributed machine learning tasks across multiple edge users by periodically aggregating trained local parameters. To address key challenges of enabling FL over a wireless fogcloud system (e.g., non-i.i.d. data, users’ heterogeneity), we first propose an efficient FL algorithm based on Federated Averaging (called FedFog) to perform the local aggregation of gradient parameters at fog servers and global training update at the cloud. Next, we employ FedFog in wireless fog-cloud systems by investigating a novel network-aware FL optimization problem that strikes the balance between the global loss and completion time. An iterative algorithm is then developed to obtain a precise measurement of the system performance, which helps design an efficient stopping criteria to output an appropriate number of global rounds. To mitigate the straggler effect, we propose a flexible user aggregation strategy that trains fast users first to obtain a certain level of accuracy before allowing slow users to join the global training updates. Extensive numerical results using several real-world FL tasks are provided to verify the theoretical convergence of FedFog. We also show that the proposed co-design of FL and communication is essential to substantially improve resource utilization while achieving comparable accuracy of the learning model.
Interdisciplinary Centre for Security, Reliability and Trust (SnT) > SIGCOM
H2020
http://hdl.handle.net/10993/50798
H2020 ; 742648 - AGNOSTIC - Actively Enhanced Cognition based Framework for Design of Complex Systems

File(s) associated to this reference

Fulltext file(s):

FileCommentaryVersionSizeAccess
Open access
FedFog_TWC_Final.pdfAuthor preprint2.35 MBView/Open

Bookmark and Share SFX Query

All documents in ORBilu are protected by a user license.