Published October 3, 2022 | Version v1
Conference paper Open

Impact of Network Topology on the Convergence of Decentralized Federated Learning Systems

  • 1. Institute of Information Science and Technologies (ISTI), National Research Council (CNR), Pisa, Italy
  • 2. Institute of Informatics and Telematics (IIT), National Research Council (CNR), Pisa, Italy

Description

Federated learning is a popular framework that enables harvesting edge resources’ computational power to train a machine learning model distributively. However, it is not always feasible or profitable to have a centralized server that controls and synchronizes the training process. In this paper, we consider the problem of training a machine learning model over a network of nodes in a fully decentralized fashion. In particular, we look for empirical evidence on how sensitive is the training process for various network characteristics and communication parameters. We present the outcome of several simulations conducted with different network topologies, datasets, and machine learning models.

Files

Distributed_FL.pdf

Files (557.6 kB)

Name Size Download all
md5:eebce805e678a065ae62d0911e058e2d
557.6 kB Preview Download

Additional details

Funding

TEACHING – A computing toolkit for building efficient autonomous applications leveraging humanistic intelligence 871385
European Commission