Published June 2, 2026
| Version v1.1
Software
Open
generative-structure/diagnostic-validity: v1.1 — robustness suite and public external-validation panel
Authors/Creators
Description
Replication package update accompanying the revised manuscript.
New since v1.0:
WP8 robustness and benchmark suite (src/wp8_.py, results/wp8_.csv):
- Gate sensitivity sweep (45 settings): qualitative conclusions stable.
- Out-of-distribution recovery: macro-F1 = 1.00 in-distribution, degrading honestly to 0.65-0.91 under magnitude shift, small N, contamination, and second-mechanism overlap.
- Interacting-mechanism signatures: all constituent signatures preserved.
- Broker-versus-naive benchmark on the synthetic suite.
Public external-validation panel (scripts/, results/external_panel_*.csv, docs/external_panel_provenance.md):
- Sixteen-extract mechanism-coverage panel through the identical pipeline, including the procurement and genome anchors plus fourteen additional public source-variable extracts (UCI Online Retail I/II, Bike Sharing, Household Power; NOAA GHCN-Daily; IRS SOI ZIP-code data).
- acquire_external_panel.py downloads public sources; build_external_panel.py runs the projection battery and broker, with nominal-identifier gating (unit-validity, Proposition 5).
- Activation taxonomy, broker-vs-naive, materiality-stress, and manifest outputs.
All public, programmatically reproducible; raw data git-ignored.
Files
generative-structure/diagnostic-validity-v1.1.zip
Files
(169.9 kB)
| Name | Size | Download all |
|---|---|---|
|
md5:fd338ad8b5dfe61a45242b061d7ee6cd
|
169.9 kB | Preview Download |
Additional details
Related works
- Is supplement to
- Software: https://github.com/generative-structure/diagnostic-validity/tree/v1.1 (URL)
Software
- Repository URL
- https://github.com/generative-structure/diagnostic-validity