The Hidden Geometry of Transformer Weights: A Journey Inside the Black Box

An exploratory journey into a transformer model. We can see how it “breathes,” how it behaves, and where and how to manipulate it. A dedicated knowledge structure that maps the entire model to axes.
The canonical-basis realignment is lossless. The realigned model enables 2× geometric compression without calibration data.
The black box has a geometry. All it took was looking at it from the right angle.