Published June 19, 2026 | Version v2

Three Phases of Internal Processing in Transformer LLMs: Semantic Emergence, Layer Inflection Points, and Training Corpus Signatures

Authors/Creators

  • 1. NE-OS SpA, Chile

Description

We identify three universal phases of internal processing in transformer language models through systematic analysis of Qwen2.5-7B-Instruct: a Chaos Phase (L0-L8) dominated by training corpus tokens, an Organization Phase (L9-L23), and a Crystallization Phase where the correct token abruptly emerges. We distinguish false emergence (generic placeholders in hard queries) from real emergence, and show that emergence layer correlates negatively with final token probability.

Files

paper_three_phases.md

Files (20.4 kB)

Name Size Download all
md5:7477612b62b18828a59e16337fa72485
20.4 kB Preview Download