CFC Cross-Model Benchmark v1: Four-Track Comparison Across 1,200 Primary Runs
Authors/Creators
Description
This record extends the CFC Cross-Model Benchmark v1 reporting package with a fourth completed 300-run comparison track. The frozen comparison basis contains 100 decision-closure variants (CM-V001–CM-V100), with three primary replications per variant. Across four completed tracks, 1,200 valid primary runs are summarized: Claude 296 PASS / 1 PARTIAL / 3 FAIL; Gemini 296 PASS / 0 PARTIAL / 4 FAIL; Google AI Mode 263 PASS / 9 PARTIAL / 28 FAIL; and GPT 300 PASS / 0 PARTIAL / 0 FAIL. GPT format compliance was 299 FULL / 1 PARTIAL / 0 FAIL.
The GPT result is explicitly classified as NON-INDEPENDENT / INTERNAL COMPARISON TRACK because GPT responses were evaluated within the ChatGPT/GPT environment. For the GPT track, all 300 exact execution prompts are preserved, while exact verbatim raw responses are currently recovered for 12/300 runs; the remaining 288 responses have not been reconstructed.
A notable qualitative difference in the prior three-track baseline concerns replication behavior: Claude and Gemini semantic anomalies were isolated 1/3 events, whereas Google AI Mode produced eight variants with semantic FAIL in at least 2/3 replications, including CM-V014, CM-V020, and CM-V096 at 3/3 FAIL.
This package is benchmark-specific and descriptive. It does not establish general model accuracy, production safety, independent external validation, or a causal intervention effect of CFC.
Files
CFC_CLAUDE_GEMINI_ANOMALY_SUMMARY.csv
Files
(1.2 MB)
| Name | Size | Download all |
|---|---|---|
|
md5:3a94f707da8c8f3876ed84594ab12ec8
|
921 Bytes | Preview Download |
|
md5:b1b41e4c43788cc9f7ebd75e07288526
|
391 Bytes | Preview Download |
|
md5:26bbd7c736dcb3963fda5b172f21aad4
|
8.1 kB | Preview Download |
|
md5:21e42202ff8987be457320e5b9f3537e
|
8.6 kB | Preview Download |
|
md5:d038dda86f702f587ea1735a042a5ea5
|
958 Bytes | Preview Download |
|
md5:788d2a47ef48a9465769331411e38152
|
49.7 kB | Preview Download |
|
md5:30b53fb6c423e991584ad975cafaa318
|
1.1 MB | Download |
|
md5:13430897de3c081695b1d7a35fd21bff
|
878 Bytes | Preview Download |
|
md5:cad9d34ebccc6f1dd034ac109100256e
|
1.8 kB | Preview Download |
|
md5:ff8dd73cb1f763d8ed064889564c4f55
|
1.0 kB | Preview Download |
|
md5:c47bfa37f38bf60719c32ff86cc88209
|
2.9 kB | Preview Download |
|
md5:3c457017a0f5688941a41429d0e5a4dc
|
2.9 kB | Preview Download |
|
md5:58c743ca2a3aff725cf4d4f06e456b03
|
1.4 kB | Preview Download |
|
md5:536d35ecb22f07aa8313e8f637116391
|
325 Bytes | Download |