Published August 11, 2026 | Version 1.0.0

SPECFORM: Software and frozen source inventory for a prospective randomized study of renderer format in LLM theory-to-program translation

Authors/Creators

  • 1. EDMO icon American University of Beirut

Description

SPECFORM is the software and frozen source inventory accompanying a prospective, preregistered, randomized study of renderer format in large-language-model theory-to-program translation. The study tests whether presenting the same verbal theory as a structured intervention contract or as connected prose changes the executable program produced from it.

This release contains the registered scientific entry points and launcher; deterministic program parsing, compilation, probing, scoring, randomization, and support modules; provider-adapter code and public certificate material; the registered test suite; precommitment, assignment, and manifest evidence; and the frozen source inventory used by the experiment. Five necessary transitive local dependencies omitted from the historical 104-file inventory are included and explicitly disclosed in the release documentation.

The software supports inspection and reproducible execution of the deterministic experimental pipeline, including program validation, finite-difference response construction, registered endpoint calculation, negative controls, and exhaustive randomization inference. A SHA-256 manifest and a dependency-free release verifier are included so users can confirm the integrity and completeness of the archive before running scientific analyses.

The generated programs, response tensors, receipts, and experimental datasets are released separately to avoid duplicating the approximately 77 MB corpus within the software record:

https://doi.org/10.5281/zenodo.21876518

The accompanying study reports a NOT_SUPPORTED outcome for its full preregistered conjunction. This release preserves the complete implementation and negative results to support reproducibility, methodological audit, reuse, and future work on autoformalization, executable theory construction, representational sensitivity, and rigorous LLM experimentation.

Version 1.0.0. Released under the MIT License.

Files

SPECFORM-code-release-v1.0.0.zip

Files (2.5 MB)

Name Size
md5:15c89553ae012f84ee5140e3811a42a5
2.5 MB Preview Download

Additional details

Related works

Is supplement to
Dataset: 10.5281/zenodo.21876518 (DOI)