Published December 9, 2022 | Version v1
Journal article Open

Analysis and evaluation of synchronous and asynchronous FLchain

  • 1. Centro Tecnológico de Telecomunicaciones de Cataluña (CTTC)

Description

Motivated by the heterogeneous nature of devices participating in large-scale federated learning (FL) optimization, we focus on an asynchronous server-less FL solution empowered by blockchain technology. In contrast to mostly adopted FL approaches, which assume synchronous operation, we advocate an asynchronous method whereby model aggregation is done as clients submit their local updates. The asynchronous setting fits well with the federated optimization idea in practical large-scale settings with heterogeneous clients. Thus, it potentially leads to higher efficiency in terms of communication overhead and idle periods. To evaluate the learning completion delay of BC-enabled FL, namely FLchain, we provide an analytical model based on batch service queue theory. Furthermore, we provide simulation results to assess the performance of both synchronous and asynchronous mechanisms. Important aspects involved in the BC-enabled FL optimization, such as the network size, link capacity, or user requirements, are put together and analyzed. As our results show, the synchronous setting leads to higher prediction accuracy than the asynchronous case. Nevertheless, asynchronous federated optimization provides much lower latency in many cases, thus becoming an appealing solution for FL when dealing with large datasets, tough timing constraints (e.g., near-real-time applications), or highly varying training data. © 2022 Elsevier B.V.

Notes

This work was funded by the IN CERCA grant from the Secretaria d'Universitats i Recerca del departament d'Empresa i Coneixement de la Generalitat de Catalunya, and partially from the Spanish grant PID2020-113832RB-C22(ORIGIN)/MCIN/AEI/10.13039/5011000110 , by the grant CHIST-ERA-20-SICT-004, by the Spanish grant PCI2021-122043-2A/AEI/10.13039/501100011033 .

Files

2112.07938.pdf

Files (9.7 MB)

Name Size Download all
md5:e0c06f9a7eb12c829d89bd8d36735e4e
9.7 MB Preview Download