Published November 26, 2025 | Version v1

AutumnBench Experiments

Authors/Creators

Description

This dataset includes log files from experiments testing whether the reasoning models' performance on AutumnBench depends on the prompt used. Each log file contains:

  • Actions JSON with all actions taken by the reasoning model
  • Thoughts (when available)
  • The scratchpad that the model can read from and write to
  • User and assistant messages
  • The full message history

Files

experiments.zip

Files (90.4 MB)

Name Size Download all
md5:9b1b73e849ce220d29ad6f3c43e758e9
90.4 MB Preview Download
md5:3c68da4c75b657608e808ed70a95eb67
2.6 kB Preview Download
md5:8cc6c390c7a1e1b7d86d208fdc48528c
3.9 kB Preview Download
md5:e4a61baefa0da8b5538200a37ba0cf58
1.9 kB Preview Download
md5:d38fd347218b181cefc7c83a61e47cae
4.2 kB Preview Download
md5:8cc6c390c7a1e1b7d86d208fdc48528c
3.9 kB Preview Download
md5:4c4270eab0b21ae2ef1028429e3e5a4c
3.4 kB Preview Download
md5:4068559d56bcd63404bdaee71002d6e6
3.7 kB Preview Download
md5:cff62d7443ee5cc24b64a35c8777cc45
3.0 kB Preview Download
md5:5ca3d0c9edee3a866b83522bd83cfed1
3.4 kB Preview Download