Published November 10, 2026 | Version v1.3

Data for "Can Large Language Models Review the Scientific Literature? A Test Against a 102-Article Benchmark"

  • 1. The University of Manchester
  • 2. University of Washington

Description

Data, prompts, raw tool outputs and figure data for a study testing whether AI tools can carry out the steps of a scientific literature review, against a published, manually constructed review of the Spanish plume literature (102 articles; Schultz et al. 2025, Monthly Weather Review). The study covers four steps: finding the articles, interpreting them, synthesizing across them, and proposing future work. Each experiment folder holds its locked prompt, the original tool outputs, and clean per-article tables. Scripts redraw every figure and recompute the reported numbers. Publisher-hosted article PDFs and the benchmark's full database are not included.

Files

abx40/spanish-plume-llm-literature-review-v1.3.zip

Files (2.1 MB)

Name Size
md5:c03b28eac15e2d1ebc2a938db4e6f3f8
2.1 MB Preview Download

Additional details

Related works

Is derived from
10.48420/28022981 (DOI)
References
10.1175/MWR-D-24-0139.1 (DOI)