Reference : Federated Geometric Monte Carlo Clustering to Counter Non-IID Datasets
E-prints/Working papers : Already available on another site
Engineering, computing & technology : Computer science
Computational Sciences
Federated Geometric Monte Carlo Clustering to Counter Non-IID Datasets
Lucchetti, Federico mailto [University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > CritiX >]
Maria, Fernandes mailto [University of Oxford]
Lydia, Chen [Delft University of Technology]
Jérémie, Decouchant mailto [Delft University of Technology]
Marcus, Völp mailto [University of Luxembourg]
[en] Federated learning allows clients to collaboratively
train models on datasets that are acquired in different locations
and that cannot be exchanged because of their size or regulations.
Such collected data is increasingly non-independent and non-
identically distributed (non-IID), negatively affecting training
accuracy. Previous works tried to mitigate the effects of non-
IID datasets on training accuracy, focusing mainly on non-IID
labels, however practical datasets often also contain non-IID
features. To address both non-IID labels and features, we propose
FedGMCC1, a novel framework where a central server aggregates
client models that it can cluster together. FedGMCC clustering relies
on a Monte Carlo procedure that samples the output space of
client models, infers their position in the weight space on a loss
manifold and computes their geometric connection via an affine
curve parametrization. FedGMCC aggregates connected models
along their path connectivity to produce a richer global model,
incorporating knowledge of all connected client models. FedGMCC
outperforms FedAvg and FedProx in terms of convergence rates
on the EMNIST62 and a genomic sequence classification datasets
(by up to +63%). FedGMCC yields an improved accuracy (+4%)
on the genomic dataset with respect to CFL, in high non-IID
feature space settings and label incongruency.

File(s) associated to this reference

Fulltext file(s):

Open access
2204.11017.pdfPublisher postprint645.06 kBView/Open

Bookmark and Share SFX Query

All documents in ORBilu are protected by a user license.