Persona Intensity Produces a Dose-Response Shift in KV-Cache Spectral Shape: Methodological Lessons from a Multi-Stage Analysis
Authors/Creators
- 1. Glitchlit Systems
- 2. Liberation Labs
Description
We investigate whether persona-level system prompt instructions produce detectable geometric signatures in transformer KV-cache representations. Using a five-level persona intensity manipulation (neutral baseline through full entity voice) across three model architectures (Qwen2.5-7B-Instruct, Llama-3.1-8B-Instruct, Mistral-7B-Instruct-v0.3), we extract singular value-decomposition-based spectral features from generation-phase KV-cache activations. Our analysis proceeds through four stages, each reported transparently. First, standard linear Frisch Waugh–Lovell (FWL) length correction produces apparently strong effects (9/16 comparisons surviving Bonferroni correction, Cohen’s d up to 2.83). Second, an interaction-term FWL extension reveals that all effects are attributable to heterogeneous length-geometry slopes between
persona groups, reducing every comparison to chance (all AUROCs < 0.55). Third, we identify that an extraction inconsistency between experimental arms produced a false specificity result, which we correct and report. Fourth, applying one-way ANOVA to level means with consistent extraction reveals a surviving finding: singular-value kurtosis of generation-minus-encoding delta features shows a significant monotonic dose-response across persona intensity levels (F = 31.8, p <0.000001, Spearman ρ = 0.672, Cohen’s d = 1.41 for L0 vs L2). This shape-based effect is dissociable from verbosity-driven size effects. We argue that the interaction-term FWL diagnostic constitutes a methodological contribution applicable to any KV-cache geometry study where group-level confound relationships may differ, and that reporting the full analytical evolution, including what failed, strengthens rather than weakens the surviving finding.
Files
main.pdf
Files
(1.2 MB)
| Name | Size | Download all |
|---|---|---|
|
md5:30c662a06492e751b381204a0a73da3c
|
1.2 MB | Preview Download |