Gemini 1.5 Pro Performance Degradation on Qasper with Context Position Shifts

This report synthesises findings from 1 peer-reviewed paper addressing the following research question: How does the performance of Gemini 1.5 Pro on the Qasper dataset degrade as the position of relevant information shifts from the beginning to the middle versus the end of a 500k token context window. 8 claims were extracted from source literature; 8 were independently verified against retrieved documents. An automated multi-reviewer quality assessment produced a score of 8.1/10. This report is a machine-generated literature synthesis and does not constitute original research.

Research goal: How does the performance of Gemini 1.5 Pro on the Qasper dataset degrade as the position of relevant information shifts from the beginning to the middle versus the end of a 500k token context window?

Autonomous literature synthesis. Automated review score: 8.1/10. Full text and citation available at Assignee Research.