Neural network quantization in federated learning at the edge
Creators
- 1. CNR-iSTI
- 2. University of Pisa
- 3. CNR-ISTI
- 4. "Sapienza", University of Rome
- 5. ONE LOGIC GmbH
Description
The massive amount of data collected in the Internet of Things (IoT) asks for effective, intelligent analytics. A recent trend supporting the use of Artificial Intelligence (AI) solutions in IoT domains is to move the computation closer to the data, i.e., from cloud-based services to edge devices. Federated learning (FL) is the primary approach adopted in this scenario to train AI-based solutions. In this work, we investigate the introduction of quantization techniques in FL to improve the efficiency of data exchange between edge servers and a cloud node. We focus on learning recurrent neural network models fed by edge data producers using the most widely adopted neural networks for time-series prediction. Experiments on public datasets show that the proposed quantization techniques in FL reduce up to 19× the volume of data exchanged between each edge server and a cloud node, with a minimal impact of around 5% on the test loss of the final model.
Files
is_federated_learning_quantization_in_mec.pdf
Files
(1.1 MB)
Name | Size | Download all |
---|---|---|
md5:7f9c5c720f59e1f55a9edab5feb61d52
|
1.1 MB | Preview Download |