Comparative Analysis of Debiasing Techniques and Unsupervised Methods for French-German Multilingual Sentence Embedding Alignment
Description
This paper presents miCSE, a mutual information-based contrastive learning framework that significantly advances the state-of-the-art in few-shot sentence embedding.The proposed approach imposes alignment between the attention pattern of different views during contrastive learning. Learning sentence embeddings with miCSE entails enforcing the structural consistency across augmented views for every sentence, making contrastive self-supervised learning more sample efficient. As a result, the proposed approach shows strong performance in the few-shot learning domain. While it achieves superior re
Research goal: How does the alignment quality of multilingual sentence embeddings for French and German compare when debiasing techniques are applied versus unsupervised alignment methods like VecMap or MUSE?
Autonomous synthesis report generated by SOVEREIGN Research Kernel. Tribunal consensus score: 8.3/10.
Notes
Files
paper.pdf
Files
(75.4 kB)
| Name | Size | Download all |
|---|---|---|
|
md5:85ba4c08a0e5059b198b560790526c08
|
75.4 kB | Preview Download |