There is a newer version of the record available.

Published June 19, 2026 | Version v1

Three Phases of Internal Processing in Transformer LLMs: Semantic Emergence, Layer Inflection Points, and Training Corpus Signatures

Authors/Creators

  • 1. NE-OS SpA, Chile

Description

We identify three universal phases of internal processing in transformer language models through systematic analysis of Qwen2.5-7B-Instruct: a Chaos Phase (L0-L8) dominated by training corpus tokens, an Organization Phase (L9-L23), and a Crystallization Phase where the correct token abruptly emerges. We distinguish false emergence (generic placeholders in hard queries) from real emergence, and show that emergence layer correlates negatively with final token probability.

Files

paper_three_phases.md

Files (20.4 kB)

Name Size Download all
md5:92e8ed0376b6149837dbb48d716264fc
20.4 kB Preview Download