Officially corrected errors persist in AI training data: Céphéide public alert, data and proofs
Description
Public alert by Céphéide, Loxyn's measurement bench, with all data, scripts, readings and proofs. French and English texts of the alert are in ALERTE/; the step-by-step guide is 00 — LISEZ-MOI.md. The full package (every step folder, lists, proofs) is in the zip file; MANIFESTE.sha256 gives the SHA-256 of each file it contains.
Official texts are corrected after publication: EU corrigenda in the Official Journal, verified RFC errata, retractions of scientific papers. We measured whether these corrections are present in public datasets used to train language models (EurlexResources, FineWeb-2, a FineWeb sample, peS2o) and what models answer about the corrected passages. Main results: 95.5% of testable single-language corrections to EU acts (1,989/2,082) remain in their erroneous form in EurlexResources; at least 124 corrected EU-law errors and 60 verified RFC errata are reproduced in web training data; about 12,200 retracted papers are in peS2o, 79% with no mention of the retraction; 53% of a random sample of retracted papers are still cited a year or more after retraction (OpenAlex); asked without documents, five models give the erroneous version in 45% of the answers in which they commit to one version, and one answer in 295 says it does not know. Shown both versions side by side, the models choose the corrected one in 53% of cases, and naming the act makes no difference; when each version carries its date and the corrigendum label, the four larger models choose it in 99–100% of cases.
Every step was preregistered and its fingerprints timestamped with OpenTimestamps in the Bitcoin blockchain. Failed controls, lost bets and deviations are reported. The Retraction Watch file is not redistributed (its SHA-256 is in the seal of the retraction step).
Files
00 — LISEZ-MOI.md
Files
(95.5 MB)
| Name | Size | |
|---|---|---|
|
md5:2b0e9069e6f475cdaa678e7bc305f384
|
6.9 kB | Preview Download |
|
md5:049808d98977cef4b940ec03adc6ec22
|
20.0 kB | Preview Download |
|
md5:48768a73067b1bed26afd4f12e87bf5a
|
22.9 kB | Preview Download |
|
md5:b7d4ff2926181e8732266ce5a4cdec33
|
94.8 MB | Preview Download |
|
md5:b08f269cdab9ea8d9a4f7ecdf4f707a2
|
665.2 kB | Download |
|
md5:b89687ce22fd6c2791ae3473c5517d75
|
956 Bytes | Download |