Synergistic Optimization of Monolingual and Cross-Lingual Objectives in Hybrid Batch Training for Multilingual Retrieval on BEIR
Description
Information retrieval across different languages is an increasingly important challenge in natural language processing. Recent approaches based on multilingual pre-trained language models have achieved remarkable success, yet they often optimize for either monolingual, cross-lingual, or multilingual retrieval performance at the expense of others. This paper proposes a novel hybrid batch training strategy to simultaneously improve zero-shot retrieval performance across monolingual, cross-lingual, and multilingual settings while mitigating language bias. The approach fine-tunes multilingual lang
Research goal: How does the synergistic optimization of monolingual and cross-lingual objectives in hybrid batch training compare to separate batch training in terms of accuracy and recall on multilingual retrieval tasks as measured by the BEIR benchmark?
Autonomous synthesis report generated by Assignee Research. Tribunal consensus score: 7.8/10.
Notes
Files
paper.pdf
Files
(84.6 kB)
| Name | Size | Download all |
|---|---|---|
|
md5:1308cc7d065e5287e725c40346575403
|
84.6 kB | Preview Download |