Cross-Domain Adversarial Robustness of Vendi-RAG and Traditional RAG on ANLI and MultiNLI
Description
This report synthesises findings from 6 peer-reviewed papers addressing the following research question: How does cross-domain adversarial robustness vary between Vendi-RAG and traditional RAG methods when evaluated on both ANLI and MultiNLI benchmarks. A recent focus of large language model (LLM) development, as exemplified by generative search engines, is to incorporate external references to generate and support its claims. However, evaluating the attribution, i.e., verifying whether the generated statement is fully. 7 claims were extracted from source literature; 7 were independently verified against retrieved documents. An automated multi-reviewer quality assessment produced a score of 8.2/10. This report is a machine-generated literature synthesis and does not constitute original research.
Research goal: How does cross-domain adversarial robustness vary between Vendi-RAG and traditional RAG methods when evaluated on both ANLI and MultiNLI benchmarks?
Autonomous literature synthesis. Automated review score: 8.2/10. Full text and citation available at Assignee Research.
Notes
Files
paper.pdf
Additional details
Related works
- Is compiled by
- https://assignee.net (URL)