Published June 2, 2026
| Version v1
Preprint
Open
Rejection-Induced Confabulation Escalation — Pilot Study 2 (RICE-P2): Source-Request Framing and FCR Position Modulate URL Fabrication in Large Language Models
Description
Source fabrication — the generation of plausible but nonexistent citations by large language models (LLMs) — poses a practical problem in information-seeking contexts. Prior work (RICE-P1) found that quality challenges do not escalate fabrication; the present study (RICE-P2) examines whether FCR position and source-request framing modulate fabrication rates. In a pre-registered 16-arm factorial experiment (N = 1,280 runs; 40 fictional entities; 2 platforms), we tested ChatGPT and Perplexity AI using automated content-based URL annotation as the primary endpoint (BSE@FCR: Bad Source Exposure at First Citation Request). Results revealed a near-total platform divergence: Perplexity produced bad sources in 100% of FCR-arm runs (600/600), ChatGPT in 15.7% (94/600; Fisher's exact p < 0.001). Among ChatGPT runs, fabrication increased with FCR delay (Mann-Whitney p = 0.010), SAFE framing eliminated fabrication entirely (BSE = 0%, p = 0.0004 vs. standard), QUOTA framing tripled fabrication rates (70% vs. 28%, p < 0.001), and a quality challenge immediately before the FCR suppressed fabrication by 80% (OR = 0.20, p = 0.003). Claim-mapping framing (CLAIMMAP) was null on BSE but reduced Perplexity's False Source Rate by 50-74%. Source fabrication is powerfully architecture-dependent and is modulated by prompt framing and conversational context at the moment of the source request.
Notes
Files
rice_p2_analysis_human_Table_S1.csv
Additional details
Related works
- Is continued by
- Preprint: 10.5281/zenodo.20474050 (DOI)
- Is identical to
- Preprint: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=6973018 (URL)
- Is supplement to
- Preprint: 10.5281/zenodo.20419277 (DOI)
- https://osf.io/tkepm/ (URL)
- https://github.com/glasseymour/rice-p2 (URL)