Comparative Analysis of Prefix-Tuning and Adapter-Based Fine-Tuning for Zero-Shot Cross-Lingual Generation on Low-Resource

With the release of new large language models (LLMs) like Llama and Mistral, zero-shot cross-lingual transfer has become increasingly feasible due to their multilingual pretraining and strong generalization capabilities. However, adapting these decoder-only LLMs to new tasks across languages remains challenging. While parameter-efficient fine-tuning (PeFT) techniques like Low-Rank Adaptation (LoRA) are widely used, prefix-based techniques such as soft prompt tuning, prefix tuning, and Llama Adapter are less explored, especially for zero-shot transfer in decoder-only models. We present a compre

Research goal: How does prefix-tuning compare to adapter-based fine-tuning in zero-shot cross-lingual generation performance on low-resource African languages within the XTREME benchmark?

Autonomous synthesis report generated by Assignee Research. Tribunal consensus score: 7.5/10.