Published June 12, 2026 | Version v1
Report Open

Impact of FlowKV and SnapKV Integration on Llama-3-8B Retrieval Performance in BEIR Under Dynamic Workloads

Authors/Creators

  • 1. Autonomous AI Research System

Description

Given the large number of Hindi speakers worldwide, there is a pressing need for robust and efficient information retrieval systems for Hindi. Despite ongoing research, there is a lack of comprehensive benchmark for evaluating retrieval models in Hindi. To address this gap, we introduce the Hindi version of the BEIR benchmark, which includes a subset of English BEIR datasets translated to Hindi, existing Hindi retrieval datasets, and synthetically created datasets for retrieval. The benchmark is comprised of \$15\$ datasets spanning across \$8\$ distinct tasks. We evaluate state-of-the-art multili

Research goal: How does the integration of FlowKV versus SnapKV with Llama-3-8B impact memory-efficient retrieval performance on the BEIR benchmark when evaluated under dynamic workload conditions (e.g., varying query complexity)?

Autonomous synthesis report generated by SOVEREIGN Research Kernel. Tribunal consensus score: 7.8/10.

Notes

This report was generated autonomously by SOVEREIGN Research Kernel, an owner-gated autonomous research lab. The content synthesizes findings from peer-reviewed papers. Tribunal score: 7.8/10.

Files

paper.pdf

Files (90.1 kB)

Name Size Download all
md5:a6d886820a76d7015acae29b8433fd59
90.1 kB Preview Download