Published November 12, 2026 | Version 1.1
Other Open

Pre-registration: replication of the STGF-MAS stage-2 planning study on a second model

Authors/Creators

  • 1. Independent Researcher, Almaty, Kazakhstan

Description

Pre-registration of the second-model replication of the STGF-MAS stage-2 planning study (TravelPlanner, NATURAL PLAN Trip and Meeting). Before any run on the full test sets, it fixes the cells (QQ: Qwen builds and executes; DQ⁺ / QD⁺: cross cells on TravelPlanner; a Qwen T = 0.7 cell on Trip), the hypotheses with their tests (paired McNemar, bootstrap CI, Holm correction), the decision rules for the paper and the scoring rules. The Russian protocol is authoritative; README_EN.md is an English summary.

Version 1.1 (12 November 2026) registers amendment 3 to the protocol before any model call of its cells on the test sets: cells with corrected execution of the hub modes, a control with equal conditions (the same candidate pool and the same numbers of checks and compactions), three draws of random hubs, a second-model control on Trip, LLM-Modulo at a non-zero temperature and verifier selection among chain-of-thought samples on TravelPlanner, with hypotheses H7, H3-F, H8 and H9 and their reading rules (§ 12 of the protocol; English translation in AMENDMENT3_en.md). README_EN.md also describes the QQ pilot correctly as the 54 P2 pilot tasks of the test sets (not separate development tasks) and adds the author's ORCID. The hypotheses, cells and decision rules of version 1.0 (DOI 10.5281/zenodo.23728319) are unchanged; their results are archived under DOI 10.5281/zenodo.23973003.

Files

AMENDMENT3_en.md

Files (132.1 kB)

Name Size
md5:42b0d7144900adbc34258ce6c022a0bf
11.5 kB Preview Download
md5:7e14f1f3000a063657451e5d06a3295e
17.8 kB Preview Download
md5:222f81d2fa098854db8cded5902dfb65
21.7 kB Preview Download
md5:fb45e72af6cc628412a3dc455c76f1aa
2.0 kB Preview Download
md5:ab67a2a64b9a670aaadd4a970d484284
13.6 kB Preview Download
md5:134f158018f7aa2118186fc48d9b2dcf
65.5 kB Preview Download

Additional details

Related works

Is supplemented by
10.5281/zenodo.23973003 (DOI)