Pre-registration: replication of the STGF-MAS stage-2 planning study on a second model
Description
Pre-registration of the second-model replication of the STGF-MAS stage-2 planning study (TravelPlanner, NATURAL PLAN Trip and Meeting). Before any run on the full test sets, it fixes the cells (QQ: Qwen builds and executes; DQ⁺ / QD⁺: cross cells on TravelPlanner; a Qwen T = 0.7 cell on Trip), the hypotheses with their tests (paired McNemar, bootstrap CI, Holm correction), the decision rules for the paper and the scoring rules. The Russian protocol is authoritative; README_EN.md is an English summary.
Version 1.1 (12 November 2026) registers amendment 3 to the protocol before any model call of its cells on the test sets: cells with corrected execution of the hub modes, a control with equal conditions (the same candidate pool and the same numbers of checks and compactions), three draws of random hubs, a second-model control on Trip, LLM-Modulo at a non-zero temperature and verifier selection among chain-of-thought samples on TravelPlanner, with hypotheses H7, H3-F, H8 and H9 and their reading rules (§ 12 of the protocol; English translation in AMENDMENT3_en.md). README_EN.md also describes the QQ pilot correctly as the 54 P2 pilot tasks of the test sets (not separate development tasks) and adds the author's ORCID. The hypotheses, cells and decision rules of version 1.0 (DOI 10.5281/zenodo.23728319) are unchanged; their results are archived under DOI 10.5281/zenodo.23973003.
Files
AMENDMENT3_en.md
Files
(132.1 kB)
| Name | Size | |
|---|---|---|
|
md5:42b0d7144900adbc34258ce6c022a0bf
|
11.5 kB | Preview Download |
|
md5:7e14f1f3000a063657451e5d06a3295e
|
17.8 kB | Preview Download |
|
md5:222f81d2fa098854db8cded5902dfb65
|
21.7 kB | Preview Download |
|
md5:fb45e72af6cc628412a3dc455c76f1aa
|
2.0 kB | Preview Download |
|
md5:ab67a2a64b9a670aaadd4a970d484284
|
13.6 kB | Preview Download |
|
md5:134f158018f7aa2118186fc48d9b2dcf
|
65.5 kB | Preview Download |
Additional details
Related works
- Is supplemented by
- 10.5281/zenodo.23973003 (DOI)