Published November 10, 2026
| Version v1.3
Dataset
Open
Data for "Can Large Language Models Review the Scientific Literature? A Test Against a 102-Article Benchmark"
Authors/Creators
- 1. The University of Manchester
- 2. University of Washington
Description
Data, prompts, raw tool outputs and figure data for a study testing whether AI tools can carry out the steps of a scientific literature review, against a published, manually constructed review of the Spanish plume literature (102 articles; Schultz et al. 2025, Monthly Weather Review). The study covers four steps: finding the articles, interpreting them, synthesizing across them, and proposing future work. Each experiment folder holds its locked prompt, the original tool outputs, and clean per-article tables. Scripts redraw every figure and recompute the reported numbers. Publisher-hosted article PDFs and the benchmark's full database are not included.
Files
abx40/spanish-plume-llm-literature-review-v1.3.zip
Additional details
Related works
- Is derived from
- 10.48420/28022981 (DOI)
- References
- 10.1175/MWR-D-24-0139.1 (DOI)
Software
- Repository URL
- https://github.com/abx40/spanish-plume-llm-literature-review