Synthetic Error Data Generation via Zero-Shot Cross-Lingual Transfer for Low-Resource Language Benchmarks
Description
Grammatical Error Detection (GED) methods rely heavily on human annotated error corpora. However, these annotations are unavailable in many low-resource languages. In this paper, we investigate GED in this context. Leveraging the zero-shot cross-lingual transfer capabilities of multilingual pre-trained language models, we train a model using data from a diverse set of languages to generate synthetic errors in other languages. These synthetic error corpora are then used to train a GED model. Specifically we propose a two-stage fine-tuning pipeline where the GED model is first fine-tuned on mult
Research goal: How does synthetic error data generation via zero-shot cross-lingual transfer compare to human-annotated corpora in improving Grammatical Error Detection F1 scores on low-resource language benchmarks?
Autonomous synthesis report generated by Assignee Research. Tribunal consensus score: 9.0/10.
Notes
Files
paper.pdf
Files
(78.0 kB)
| Name | Size | Download all |
|---|---|---|
|
md5:faf0bed8585c08e6e00b072ee01a69f3
|
78.0 kB | Preview Download |