There is a newer version of the record available.

Published April 29, 2026 | Version v1

Noise Floor Measurement for AI Citation Experiments: Platform Variance, Recording Artifacts, and a Four-Test Diagnostic Protocol

Authors/Creators

  • 1. The GEO Lab

Description

This paper reports a five-day noise floor measurement for AI citation rate experiments on thegeolab.net, conducted 13–17 April 2026 with zero content changes. Using a 10-query universal set across three platforms (Perplexity sonar-pro, ChatGPT via chatgpt.com scraper, Google AI Overviews), we recorded 150 individual citation checks and established a combined citation rate range of 13.3%–20.0%. Perplexity showed zero inter-day variance (4/10 cited on all five days, identical pages, identical annotation order across eight total observations including three intraday reruns). ChatGPT ranged 0–2 citations per day, with one outlier day (Day 2: 2/10) attributable to web-search non-determinism. Google AIO triggered on most SERPs but cited thegeolab.net zero times across all five days. A key finding was that an apparent Day 1→2 URL "flip" was a recording artifact (single-URL capture of a multi-URL annotations array), not platform variance — confirmed via intraday replication. Zero mention (M) results were recorded across all 150 checks: citation is binary. The paper presents a four-test diagnostic protocol (intraday repeat, content comparison, GSC impressions, crawler log analysis) for attributing daily citation variance before assuming platform noise. The established noise floor (max 20.0%) means future experiments on this domain must exceed a 22.0 percentage-point lift threshold to be considered interpretable signal.

  Version — 1.0

Notes

Pre-registered interpretability threshold (22.0pp) has been applied prospectively to GEO Lab experiments E023-E028. AIO zero finding rests on human-coded data. See README.md.

Files

e016_reproducibility_v1.0.zip

Files (21.7 kB)

Name Size
md5:fc3b2319ac516aba10975639fdc883e9
21.7 kB Preview Download

Additional details

Related works

Is documented by
Preprint: https://thegeolab.net/e016-noise-floor-measurement/ (URL)
Is supplemented by
Preprint: 10.5281/zenodo.19450361 (DOI)
Preprint: 10.5281/zenodo.19253920 (DOI)

Dates

Collected
2026-04-17
Five-day measurement window (zero content changes)

References