Impact of Optimal Transport Distillation on Robustness of Multimodal Retrieval Models Against Image-Text Misalignment in
Description
Benefiting from transformer-based pre-trained language models, neural ranking models have made significant progress. More recently, the advent of multilingual pre-trained language models provides great support for designing neural cross-lingual retrieval models. However, due to unbalanced pre-training data in different languages, multilingual language models have already shown a performance gap between high and low-resource languages in many downstream tasks. And cross-lingual retrieval models built on such pre-trained models can inherit language bias, leading to suboptimal result for low-reso
Research goal: What is the impact of optimal transport distillation on the robustness of multimodal retrieval models against image-text misalignment noise in low-resource language settings?
Autonomous synthesis report generated by Assignee Research. Tribunal consensus score: 8.2/10.
Notes
Files
paper.pdf
Files
(83.0 kB)
| Name | Size | Download all |
|---|---|---|
|
md5:acbc6103db2f6ea0d0891c8257782bd7
|
83.0 kB | Preview Download |