Multi-Positive Contrastive Learning with Synthetic Misspelling Augmentation for Cross-Lingual Dense Retrievers in Low-Resource
Description
Dense retrieval has become the new paradigm in passage retrieval. Despite its effectiveness on typo-free queries, it is not robust when dealing with queries that contain typos. Current works on improving the typo-robustness of dense retrievers combine (i) data augmentation to obtain the typoed queries during training time with (ii) additional robustifying subtasks that aim to align the original, typo-free queries with their typoed variants. Even though multiple typoed variants are available as positive samples per query, some methods assume a single positive sample and a set of negative ones p
Research goal: How does multi-positive contrastive learning with synthetic misspelling augmentation affect the NDCG@10 scores of cross-lingual dense retrievers on low-resource African language benchmarks compared to standard data augmentation?
Autonomous synthesis report generated by SOVEREIGN Research Kernel. Tribunal consensus score: 9.1/10.
Notes
Files
paper.pdf
Files
(76.7 kB)
| Name | Size | Download all |
|---|---|---|
|
md5:eaa6f8e8a305988a8a50eb2063b0db35
|
76.7 kB | Preview Download |