Published June 2, 2026 | Version v1

Rejection-Induced Confabulation Escalation — Pilot Study 2 (RICE-P2): Source-Request Framing and FCR Position Modulate URL Fabrication in Large Language Models

Authors/Creators

  • 1. Independent Researcher, Budapest, Hungary

Description

Source fabrication — the generation of plausible but nonexistent citations by large language models (LLMs) — poses a practical problem in information-seeking contexts. Prior work (RICE-P1) found that quality challenges do not escalate fabrication; the present study (RICE-P2) examines whether FCR position and source-request framing modulate fabrication rates. In a pre-registered 16-arm factorial experiment (N = 1,280 runs; 40 fictional entities; 2 platforms), we tested ChatGPT and Perplexity AI using automated content-based URL annotation as the primary endpoint (BSE@FCR: Bad Source Exposure at First Citation Request). Results revealed a near-total platform divergence: Perplexity produced bad sources in 100% of FCR-arm runs (600/600), ChatGPT in 15.7% (94/600; Fisher's exact p < 0.001). Among ChatGPT runs, fabrication increased with FCR delay (Mann-Whitney p = 0.010), SAFE framing eliminated fabrication entirely (BSE = 0%, p = 0.0004 vs. standard), QUOTA framing tripled fabrication rates (70% vs. 28%, p < 0.001), and a quality challenge immediately before the FCR suppressed fabrication by 80% (OR = 0.20, p = 0.003). Claim-mapping framing (CLAIMMAP) was null on BSE but reduced Perplexity's False Source Rate by 50-74%. Source fabrication is powerfully architecture-dependent and is modulated by prompt framing and conversational context at the moment of the source request.

Notes

Pre-registration: https://osf.io/tkepm/ (locked 2026-06-01). Data and code: https://github.com/glasseymour/rice-p2. Part of the RICE research programme on LLM source fabrication dynamics. Conceptual precursor: Per-Entity Bias Map (PEBM), DOI: 10.5281/zenodo.20419277. RICE-P1: DOI: 10.5281/zenodo.20474050.

Files

rice_p2_analysis_human_Table_S1.csv

Files (133.0 kB)

Name Size Download all
md5:b91a43a01cb4d7720d08a623412d0a66
1.8 kB Preview Download
md5:3f5bd560377c8b7a3009ec80a20dd6e1
57.7 kB Download
md5:bed0adf309891d821b57f7b74173b5ce
41.8 kB Preview Download
md5:432beb99be31f7cc6bcaf55583b30f5f
31.8 kB Preview Download

Additional details

Related works