Published January 16, 2026 | Version V2

REASONS: REtrieval and Automated citationS Of scieNtific Sentences

Description

The dataset spans 12 scientific domains, comprising 10 in computer science and 2 in biology. In total, REASONS contains 19,904 source papers, of which 3,944 satisfy IEEE formatting constraints, yielding 12,723 sentence-level citation instances.  The dataset exhibits a pronounced long-tail structure. Computer Vision is the most heavily represented domain, contributing 5,488 papers and 3,437 cited sentences, while specialized domains such as Biomolecules and Quantum Computing contribute substantially fewer papers 119 and 421, respectively) and citation instances 27 and 456. Mid-sized domains such as Robotics, Graphics, Information Retrieval, Artificial Intelligence, and Natural Language Processing collectively form the head of the distribution. This structure is intentional rather than a limitation. It enables controlled comparison between well-represented domains with relatively standardized terminology and specialized domains that exhibit sparse coverage, domain-specific vocabulary, and irregular citation practices. These contrasts reveal when models abstain versus when they confidently misattribute.

Files

REASONS.zip

Files (8.7 MB)

Name Size
md5:2a22b088f5ada4adf934db311698cddc
8.7 MB Preview Download

Additional details

Additional titles

Alternative title (En)
Abstention vs. Hallucination: Benchmarking LLM Source Attribution for Sentence-level Scientific Citations

Funding

University of Maryland, Baltimore County
U.S. National Science Foundation
#2335967

Dates

Updated
2025-04-25