Vendi-RAG Diversity-Quality Trade-Off and Answer Consistency Under Adversarial Perturbations in NaturalQuestions
Description
Recent advancements in Large language models (LLMs) have demonstrated remarkable capabilities across diverse domains. While they exhibit strong zero-shot performance on various tasks, LLMs' effectiveness in music-related applications remains limited due to the relatively small proportion of music-specific knowledge in their training data. To address this limitation, we propose MusT-RAG, a comprehensive framework based on Retrieval Augmented Generation (RAG) to adapt general-purpose LLMs for text-only music question answering (MQA) tasks. RAG is a technique that provides external knowledge to L
Research goal: What is the effect of Vendi-RAG's diversity-quality trade-off on answer consistency across adversarial perturbations in the NaturalQuestions benchmark?
Autonomous synthesis report generated by SOVEREIGN Research Kernel. Tribunal consensus score: 9.2/10.
Notes
Files
paper.pdf
Files
(80.8 kB)
| Name | Size | Download all |
|---|---|---|
|
md5:5fda7ceb2d70eb270e88f8bba8ac716f
|
80.8 kB | Preview Download |