SPECFORM: Software and frozen source inventory for a prospective randomized study of renderer format in LLM theory-to-program translation
Description
SPECFORM is the software and frozen source inventory accompanying a prospective, preregistered, randomized study of renderer format in large-language-model theory-to-program translation. The study tests whether presenting the same verbal theory as a structured intervention contract or as connected prose changes the executable program produced from it.
This release contains the registered scientific entry points and launcher; deterministic program parsing, compilation, probing, scoring, randomization, and support modules; provider-adapter code and public certificate material; the registered test suite; precommitment, assignment, and manifest evidence; and the frozen source inventory used by the experiment. Five necessary transitive local dependencies omitted from the historical 104-file inventory are included and explicitly disclosed in the release documentation.
The software supports inspection and reproducible execution of the deterministic experimental pipeline, including program validation, finite-difference response construction, registered endpoint calculation, negative controls, and exhaustive randomization inference. A SHA-256 manifest and a dependency-free release verifier are included so users can confirm the integrity and completeness of the archive before running scientific analyses.
The generated programs, response tensors, receipts, and experimental datasets are released separately to avoid duplicating the approximately 77 MB corpus within the software record:
https://doi.org/10.5281/zenodo.21876518
The accompanying study reports a NOT_SUPPORTED outcome for its full preregistered conjunction. This release preserves the complete implementation and negative results to support reproducibility, methodological audit, reuse, and future work on autoformalization, executable theory construction, representational sensitivity, and rigorous LLM experimentation.
Version 1.0.0. Released under the MIT License.
Files
SPECFORM-code-release-v1.0.0.zip
Additional details
Related works
- Is supplement to
- Dataset: 10.5281/zenodo.21876518 (DOI)