[en] Today, Federated Learning (FL) stands out as the solution to addressing the challenges of distributed computing and empowering a wide range of edge devices with artificial intelligence capabilities. One variant of FL called semi-decentralized FL (SDFL) enables multiple server units to coordinate the learning task instead of relying on only one central server, hence preventing single-point failures. However, SDFL requires careful consideration regarding the coordination between server nodes, and dealing with the heterogeneous computing resources and data distributions across end devices (FL clients). Therefore, we propose TUNE-FL, an adapTive semi-synchronoUs semi-deceNtralizEd Federated Learning that addresses the clients' heterogeneity challenges. TUNE-FL alleviates these challenges by (i) ensuring consensus regardless of the network topology, and (ii) deploying an adaptive semi-synchronous mechanism for coordinating the learning process across all nodes while taking into consideration the heterogeneity presented by end devices. We evaluated TUNE-FL for the intrusion detection system (IDS) datasets and compared it with the three most representative baseline models. The experimental results demonstrate that TUNE-FL outperforms the baselines in accuracy while greatly reducing the duration of FL training by approximately 97 times.
Disciplines :
Computer science
Author, co-author :
Jmal, Houssem; UMR 6004, Nantes University, École Centrale Nantes, IMT Atlantique, CNRS, INRIA, Nantes, France
Piamrat, Kandaraj; UMR 6004, Nantes University, École Centrale Nantes, IMT Atlantique, CNRS, INRIA, Nantes, France
AOUEDI, Ons ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > SigCom
Q. Yang, Y. Liu, T. Chen, and Y. Tong, "Federated machine learning: Concept and applications, " 2019.
L. Yuan, Z. Wang, L. Sun, P. S. Yu, and C. G. Brinton, "Decentralized federated learning: A survey and perspective, " IEEE Internet of Things Journal, pp. 1-1, 2024.
M. Du, H. Zheng, X. Feng, Y. Chen, and T. Zhao, "Decentralized federated learning with markov chain based consensus for industrial iot networks, " IEEE Transactions on Industrial Informatics, vol. 19, no. 4, pp. 6006-6015, 2023.
J. Wu, S. Drew, F. Dong, Z. Zhu, and J. Zhou, "Topology-aware federated learning in edge computing: A comprehensive survey, " 2023.
Y. Sun, J. Shao, Y. Mao, J. H. Wang, and J. Zhang, "Semi-decentralized federated edge learning with data and device heterogeneity, " IEEE Transactions on Network and Service Management, vol. 20, no. 2, pp. 1487-1501, 2023.
C. Xu, Y. Qu, Y. Xiang, and L. Gao, "Asynchronous federated learning on heterogeneous devices: A survey, " 2023. [Online]. Available: Https: //arxiv. org/abs/2109. 04269
G. Xiong, G. Yan, S. Wang, and J. Li, "Straggler-resilient decentralized learning via adaptive asynchronous updates, " 2024. [Online]. Available: Https: //arxiv. org/abs/2306. 06559
F. P.-C. Lin, S. Hosseinalipour, S. S. Azam, C. G. Brinton, and N. Michelusi, "Semi-decentralized federated learning with cooperative d2d local model aggregations, " IEEE Journal on Selected Areas in Communications, vol. 39, no. 12, pp. 3851-3869, 2021.
F. Liang, Q. Yang, R. Liu, J. Wang, K. Sato, and J. Guo, "Semisynchronous federated learning protocol with dynamic aggregation in internet of vehicles, " IEEE Transactions on Vehicular Technology, vol. 71, no. 5, pp. 4677-4691, 2022.
T. Do, B. X. Nguyen, V. Pham, T. Tran, E. Tjiputra, Q. D. Tran, and A. Nguyen, "Reducing training time in cross-silo federated learning using multigraph topology, " 2023.
J. Wang, A. K. Sahu, Z. Yang, G. Joshi, and S. Kar, "Matcha: Speeding up decentralized sgd via matching decomposition sampling, " 2019.
M. Zhou, G. Liu, K. Lu, R. Mao, and H. Liao, "Accelerating the decentralized federated learning via manipulating edges, " in Proceedings of the ACM on Web Conference 2024, ser. WWW '24. New York, NY, USA: Association for Computing Machinery, 2024, p. 2945-2954. [Online]. Available: Https: //doi. org/10. 1145/3589334. 3645509
A. Rocha Neto, B. Soares, F. Barbalho, L. Santos, T. Batista, F. Delicato, and P. Pires, "Classifying smart iot devices for running machine learning algorithms, " 07 2018.
N. Moustafa and J. Slay, "Unsw-nb15: A comprehensive data set for network intrusion detection systems (unsw-nb15 network data set), " in 2015 Military Communications and Information Systems Conference (MilCIS), 2015, pp. 1-6.
I. Sharafaldin, A. H. Lashkari, and A. A. Ghorbani, "Toward generating a new intrusion detection dataset and intrusion traffic characterization, " in International Conference on Information Systems Security and Privacy, 2018. [Online]. Available: Https: //api. semanticscholar. org/CorpusID: 4707749
H. B. McMahan, E. Moore, D. Ramage, S. Hampson, and B. A. y Arcas, "Communication-efficient learning of deep networks from decentralized data, " 2023.
D. Stripelis, P. M. Thompson, and J. L. Ambite, "Semisynchronous federated learning for energy-efficient training and accelerated convergence in cross-silo settings, " ACM Trans. Intell. Syst. Technol., vol. 13, no. 5, jun 2022. [Online]. Available: Https: //doi. org/10. 1145/3524885
J. Sun, A. Li, L. Duan, S. Alam, X. Deng, X. Guo, H. Wang, M. Gorlatova, M. Zhang, H. Li, and Y. Chen, "Fedsea: A semiasynchronous federated learning framework for extremely heterogeneous devices, " in Proceedings of the 20th ACM Conference on Embedded Networked Sensor Systems, ser. SenSys '22. New York, NY, USA: Association for Computing Machinery, 2023, p. 106-119. [Online]. Available: Https: //doi. org/10. 1145/3560905. 3568538
