Retrieval Diversity and Inference Efficiency Trade-offs in RAG Models on ANLI

This report synthesises findings from 10 peer-reviewed papers addressing the following research question: What is the trade-off between retrieval diversity weighting and inference efficiency in RAG models when evaluated on the ANLI benchmark. Large decoder-only language models (LMs) can be largely improved in terms of perplexity by retrieval (e.g., RETRO), but its impact on text generation quality and downstream task accuracy is unclear. Thus, it is still an open question: shall we pretrain large autoregressive LMs. 9 claims were extracted from source literature; 9 were independently verified against retrieved documents. An automated multi-reviewer quality assessment produced a score of 9.0/10. This report is a machine-generated literature synthesis and does not constitute original research.

Research goal: What is the trade-off between retrieval diversity weighting and inference efficiency in RAG models when evaluated on the ANLI benchmark?

Autonomous literature synthesis. Automated review score: 9.0/10. Full text and citation available at Assignee Research.