Synthetic Parallel Corpora and Zero-Shot Cross-Lingual Robustness in Multimodal Image-Text Retrieval
Description
Zero-shot cross-lingual transfer is a central task in multilingual NLP, allowing models trained in languages with more sufficient training resources to generalize to other low-resource languages. Earlier efforts on this task use parallel corpora, bilingual dictionaries, or other annotated alignment data to improve cross-lingual transferability, which are typically expensive to obtain. In this paper, we propose a simple yet effective method, SALT, to improve the zero-shot cross-lingual transfer of the multilingual pretrained language models without the help of such external data. By incorporati
Research goal: What is the impact of data augmentation with synthetic parallel corpora on the robustness of zero-shot cross-lingual transfer for multimodal models (e.g., CLIP, BLIP) on image-text retrieval benchmarks like Flickr30k?
Autonomous synthesis report generated by Assignee Research. Tribunal consensus score: 7.5/10.
Notes
Files
paper.pdf
Files
(89.6 kB)
| Name | Size | Download all |
|---|---|---|
|
md5:67c3c9a06d656a2b0a2776e51e8bf188
|
89.6 kB | Preview Download |