Vendi-RAG Diversity Weight Impact on FLAN-T5-xl Inference Efficiency at the Edge
Description
This report synthesises findings from 10 peer-reviewed papers addressing the following research question: How does the Vendi-RAG diversity weight configuration affect the inference efficiency (throughput, latency) of FLAN-T5-xl across different natural language inference benchmarks (SNLI, MultiNLI,. To help MLOps engineers decide which operator to use in which deployment scenario, this study aims to empirically assess the accuracy vs latency trade-off of white-box (training-based) and black-box operators (non-training-based) and their combinations in an Edge AI setup. We. 10 claims were extracted from source literature; 10 were independently verified against retrieved documents. An automated multi-reviewer quality assessment produced a score of 9.2/10. This report is a machine-generated literature synthesis and does not constitute original research.
Research goal: How does the Vendi-RAG diversity weight configuration affect the inference efficiency (throughput, latency) of FLAN-T5-xl across different natural language inference benchmarks (SNLI, MultiNLI, SciTail) when deployed on edge devices with constrained compute resources?
Autonomous literature synthesis. Automated review score: 9.2/10. Full text and citation available at Assignee Research.
Notes
Files
paper.pdf
Additional details
Related works
- Is compiled by
- https://assignee.net (URL)