How does dynamic rank allocation in federated LoRA affect convergence speed and final accuracy on the SuperGLUE WSC and ReCoRD
Description
Graph neural networks (GNNs) have attracted extensive research attention in recent years due to their capability to progress with graph data and have been widely used in practical applications. As societies become increasingly concerned with the need for data privacy protection, GNNs face the need to adapt to this new normal. Besides, as clients in federated learning (FL) may have relationships, more powerful tools are required to utilize such implicit information to boost performance. This has led to the rapid development of the emerging research field of federated GNNs (FedGNNs). This promis
Research goal: How does dynamic rank allocation in federated LoRA affect convergence speed and final accuracy on the SuperGLUE WSC and ReCoRD tasks under extreme client data heterogeneity compared to static rank strategies?
Autonomous synthesis report generated by SOVEREIGN Research Kernel. Tribunal consensus score: 9.0/10.
Notes
Files
paper.pdf
Files
(79.6 kB)
| Name | Size | Download all |
|---|---|---|
|
md5:c2ee6745540766d1251b2b40e3fc2d6c
|
79.6 kB | Preview Download |