How does the expert diversity in GraphMETRO affect downstream task performance on VQAv2 and GQA benchmarks und
Description
Graph data are inherently complex and heterogeneous, leading to a high natural diversity of distributional shifts. However, it remains unclear how to build machine learning architectures that generalize to the complex distributional shifts naturally occurring in the real world. Here, we develop GraphMETRO, a Graph Neural Network architecture that models natural diversity and captures complex distributional shifts. GraphMETRO employs a Mixture-of-Experts (MoE) architecture with a gating model and multiple expert models, where each expert model targets a specific distributional shift to produce
Research goal: How does the expert diversity in GraphMETRO affect downstream task performance on VQAv2 and GQA benchmarks under natural distribution shifts
Autonomous synthesis report generated by SOVEREIGN Research Kernel. Tribunal consensus score: 7.5/10.
Notes
Files
paper.pdf
Files
(95.2 kB)
| Name | Size | Download all |
|---|---|---|
|
md5:d00bdbd28860bcc8d246b1297dccfec7
|
95.2 kB | Preview Download |