Published June 22, 2026 | Version v1

Subspace Patching: A Conceptual Proposal for Circuit Decomposition in Transformer Residual Streams

Description

We propose Subspace Patching, a conceptual intervention framework for isolating functionally relevant subspaces within Transformer residual streams. The core hypothesis is that task-specific information is stored in linearly separable directions, allowing targeted manipulation without disrupting orthogonal computations. This position paper outlines the theoretical motivation, defines the proposed projection-based intervention at a high level, and discusses potential experimental designs. No empirical results are presented in this version; this serves as a foundational proposal for future implementation and evaluation.

Files

SubspacePatching PositionPaper.pdf

Files (3.4 kB)

Name Size Download all
md5:d9011bb3abfe80fda9978fe62ebea4e1
3.4 kB Preview Download

Additional details