Published August 30, 2026 | Version Four-track comparison package v1.0

CFC Cross-Model Benchmark v1: Four-Track Comparison Across 1,200 Primary Runs

Authors/Creators

Description

This record extends the CFC Cross-Model Benchmark v1 reporting package with a fourth completed 300-run comparison track. The frozen comparison basis contains 100 decision-closure variants (CM-V001–CM-V100), with three primary replications per variant. Across four completed tracks, 1,200 valid primary runs are summarized: Claude 296 PASS / 1 PARTIAL / 3 FAIL; Gemini 296 PASS / 0 PARTIAL / 4 FAIL; Google AI Mode 263 PASS / 9 PARTIAL / 28 FAIL; and GPT 300 PASS / 0 PARTIAL / 0 FAIL. GPT format compliance was 299 FULL / 1 PARTIAL / 0 FAIL.

The GPT result is explicitly classified as NON-INDEPENDENT / INTERNAL COMPARISON TRACK because GPT responses were evaluated within the ChatGPT/GPT environment. For the GPT track, all 300 exact execution prompts are preserved, while exact verbatim raw responses are currently recovered for 12/300 runs; the remaining 288 responses have not been reconstructed.

A notable qualitative difference in the prior three-track baseline concerns replication behavior: Claude and Gemini semantic anomalies were isolated 1/3 events, whereas Google AI Mode produced eight variants with semantic FAIL in at least 2/3 replications, including CM-V014, CM-V020, and CM-V096 at 3/3 FAIL.

This package is benchmark-specific and descriptive. It does not establish general model accuracy, production safety, independent external validation, or a causal intervention effect of CFC.

Files

CFC_CLAUDE_GEMINI_ANOMALY_SUMMARY.csv

Files (1.2 MB)

Name Size Download all
md5:3a94f707da8c8f3876ed84594ab12ec8
921 Bytes Preview Download
md5:b1b41e4c43788cc9f7ebd75e07288526
391 Bytes Preview Download
md5:26bbd7c736dcb3963fda5b172f21aad4
8.1 kB Preview Download
md5:21e42202ff8987be457320e5b9f3537e
8.6 kB Preview Download
md5:d038dda86f702f587ea1735a042a5ea5
958 Bytes Preview Download
md5:788d2a47ef48a9465769331411e38152
49.7 kB Preview Download
md5:30b53fb6c423e991584ad975cafaa318
1.1 MB Download
md5:13430897de3c081695b1d7a35fd21bff
878 Bytes Preview Download
md5:cad9d34ebccc6f1dd034ac109100256e
1.8 kB Preview Download
md5:ff8dd73cb1f763d8ed064889564c4f55
1.0 kB Preview Download
md5:c47bfa37f38bf60719c32ff86cc88209
2.9 kB Preview Download
md5:3c457017a0f5688941a41429d0e5a4dc
2.9 kB Preview Download
md5:58c743ca2a3aff725cf4d4f06e456b03
1.4 kB Preview Download
md5:536d35ecb22f07aa8313e8f637116391
325 Bytes Download