Published June 7, 2026 | Version v2
Computational notebook Open

ESFlow: source code, sample data, and benchmark outputs

Authors/Creators

  • 1. ROR icon Pacific Northwest National Laboratory

Description

This Zenodo record is a frozen snapshot of ESFlow, a module-grounded agentic AI framework for Earth system model (ESM) analysis, together with the sample data and full per-model benchmark outputs required to reproduce the results reported in the companion manuscript: 

Zhou, T., Qian, Y., and Leung, L. R.: Can We Trust LLMs for Complex Earth System Model Analysis? Silent Failure and Evidence from Module-Grounded Benchmarking, submitted to Geoscientific Model Development (GMD), 2026.

The record contains two zip files:

  • esflow-gmd-v1.zip: the ESFlow framework, the 24-tool library for E3SM land-surface and hydrology analysis, the benchmark runner, the self-debug experiment runner, the structural grading pipeline, benchmark task definitions, reference workflows, and per-model benchmark outputs.
  • esflow_sample_data.zip: the sample data required to execute the reference workflows, including a representative subset of E3SM model output (land and river components), GRDC streamflow observations and basin polygons, and the ILAMB-derived observation files used in the benchmark workflows:
      - GPCCv2018 precipitation: esflow_sample_data/ilamb/pr/GPCCv2018/pr.nc
      - MODIS evapotranspiration: esflow_sample_data/ilamb/evspsbl/MODIS/et_0.5x0.5.nc
      - LORA runoff: esflow_sample_data/ilamb/mrro/LORA/LORA.nc

The ILAMB-derived files are archived here to provide a frozen reproducibility record; their original source paths and embedded dataset metadata should be used for provenance and licence information.

Reproduction instructions are provided in the repository README.md.

Disclaimer
This material was prepared as an account of work sponsored by an agency of the United States Government. Neither the United States Government nor the United States Department of Energy, nor Battelle, nor any of their employees, nor any jurisdiction or organization that has cooperated in the development of these materials, makes any warranty, express or implied, or assumes any legal liability or responsibility for the accuracy, completeness, or usefulness or any information, apparatus, product, software, or process disclosed, or represents that its use would not infringe privately owned rights.
 
Reference herein to any specific commercial product, process, or service by trade name, trademark, manufacturer, or otherwise does not necessarily constitute or imply its endorsement, recommendation, or favoring by the United States Government or any agency thereof, or Battelle Memorial Institute. The views and opinions of authors expressed herein do not necessarily state or reflect those of the United States Government or any agency thereof.

 
PACIFIC NORTHWEST NATIONAL LABORATORY
operated by
BATTELLE
for the
UNITED STATES DEPARTMENT OF ENERGY
under Contract DE-AC05-76RL01830

Files

esflow_sample_data.zip

Files (989.7 MB)

Name Size
md5:e4d27e1da997b4449a3d15b2357a827f
8.7 MB Preview Download
md5:2d65329025ad6021761c3b884c8611dd
981.0 MB Preview Download

Additional details

Dates

Submitted
2026-04-16

Software

Programming language
Python
Development Status
Active