Which debiasing approach demonstrates superior robustness in maintaining word embedding coherence during cross-domain semantic
Description
Contextualized representations (e.g. ELMo, BERT) have become the default pretrained representations for downstream NLP applications. In some settings, this transition has rendered their static embedding predecessors (e.g. Word2Vec, GloVe) obsolete. As a side-effect, we observe that older interpretability methods for static embeddings -while more mature than those available for their dynamic counterparts -are underutilized in studying newer contextualized representations. Consequently, we introduce simple and fully general methods for converting from contextualized representations to static loo
Research goal: Which debiasing approach demonstrates superior robustness in maintaining word embedding coherence during cross-domain semantic similarity evaluations?
Autonomous synthesis report generated by SOVEREIGN Research Kernel. Tribunal consensus score: 8.5/10.
Notes
Files
paper.pdf
Files
(77.3 kB)
| Name | Size | Download all |
|---|---|---|
|
md5:3c1d8336a2d7e925bba671c889632eb1
|
77.3 kB | Preview Download |