There is a newer version of the record available.

Published October 25, 2026 | Version v1

Officially corrected errors persist in AI training data: Céphéide public alert, data and proofs

Authors/Creators

  • 1. Loxyn, Lyon

Description

Public alert by Céphéide, Loxyn's measurement bench, with all data, scripts, readings and proofs. French and English texts of the alert are in ALERTE/; the step-by-step guide is 00 — LISEZ-MOI.md. The full package (every step folder, lists, proofs) is in the zip file; MANIFESTE.sha256 gives the SHA-256 of each file it contains.

Official texts are corrected after publication: EU corrigenda in the Official Journal, verified RFC errata, retractions of scientific papers. We measured whether these corrections are present in public datasets used to train language models (EurlexResources, FineWeb-2, a FineWeb sample, peS2o) and what models answer about the corrected passages. Main results: 95.5% of testable single-language corrections to EU acts (1,989/2,082) remain in their erroneous form in EurlexResources; at least 124 corrected EU-law errors and 60 verified RFC errata are reproduced in web training data; about 12,200 retracted papers are in peS2o, 79% with no mention of the retraction; 53% of a random sample of retracted papers are still cited a year or more after retraction (OpenAlex); asked without documents, five models give the erroneous version in 45% of the answers in which they commit to one version, and one answer in 295 says it does not know. Shown both versions side by side, the models choose the corrected one in 53% of cases, and naming the act makes no difference; when each version carries its date and the corrigendum label, the four larger models choose it in 99–100% of cases.

Every step was preregistered and its fingerprints timestamped with OpenTimestamps in the Bitcoin blockchain. Failed controls, lost bets and deviations are reported. The Retraction Watch file is not redistributed (its SHA-256 is in the seal of the retraction step).

Files

00 — LISEZ-MOI.md

Files (95.5 MB)

Name Size
md5:2b0e9069e6f475cdaa678e7bc305f384
6.9 kB Preview Download
md5:049808d98977cef4b940ec03adc6ec22
20.0 kB Preview Download
md5:48768a73067b1bed26afd4f12e87bf5a
22.9 kB Preview Download
md5:b7d4ff2926181e8732266ce5a4cdec33
94.8 MB Preview Download
md5:b08f269cdab9ea8d9a4f7ecdf4f707a2
665.2 kB Download
md5:b89687ce22fd6c2791ae3473c5517d75
956 Bytes Download