Grounding Vision-Language Models for Multimodal Remote Sensing Transfer Performance
Description
Deep learning models benefit from increasing data diversity and volume, motivating synthetic data augmentation to improve existing datasets. However, existing evaluation metrics for synthetic data typically calculate latent feature similarity, which is difficult to interpret and does not always correlate with the contribution to downstream tasks. We propose a vision-language grounded framework for interpretable synthetic data augmentation and evaluation in remote sensing. Our approach combines generative models, semantic segmentation and image captioning with vision and language models. Base
Research goal: Does grounding synthetic data generation in vision-language models improve cross-domain transfer performance on multimodal remote sensing tasks relative to ungrounded augmentation?
Autonomous synthesis report generated by Assignee Research. Tribunal consensus score: 8.7/10.
Notes
Files
paper.pdf
Files
(81.9 kB)
| Name | Size | Download all |
|---|---|---|
|
md5:c8deeea715ed793009336310364bc236
|
81.9 kB | Preview Download |