Published June 2, 2026 | Version v1.1
Software Open

generative-structure/diagnostic-validity: v1.1 — robustness suite and public external-validation panel

Authors/Creators

Description

Replication package update accompanying the revised manuscript.

New since v1.0:

WP8 robustness and benchmark suite (src/wp8_.py, results/wp8_.csv):

  • Gate sensitivity sweep (45 settings): qualitative conclusions stable.
  • Out-of-distribution recovery: macro-F1 = 1.00 in-distribution, degrading honestly to 0.65-0.91 under magnitude shift, small N, contamination, and second-mechanism overlap.
  • Interacting-mechanism signatures: all constituent signatures preserved.
  • Broker-versus-naive benchmark on the synthetic suite.

Public external-validation panel (scripts/, results/external_panel_*.csv, docs/external_panel_provenance.md):

  • Sixteen-extract mechanism-coverage panel through the identical pipeline, including the procurement and genome anchors plus fourteen additional public source-variable extracts (UCI Online Retail I/II, Bike Sharing, Household Power; NOAA GHCN-Daily; IRS SOI ZIP-code data).
  • acquire_external_panel.py downloads public sources; build_external_panel.py runs the projection battery and broker, with nominal-identifier gating (unit-validity, Proposition 5).
  • Activation taxonomy, broker-vs-naive, materiality-stress, and manifest outputs.

All public, programmatically reproducible; raw data git-ignored.

Files

generative-structure/diagnostic-validity-v1.1.zip

Files (169.9 kB)

Name Size Download all
md5:fd338ad8b5dfe61a45242b061d7ee6cd
169.9 kB Preview Download

Additional details