Post-Shannon Information Theory

In this preliminary AI note, we present a unified perspective on structured source coding (SSC) and structured channel coding (SCC), forming a cohesive framework that extends classical Shannon theory. The central thesis is that atypical and error events possess internal geometric structure that can be exploited via clustering. This leads to a tunable refinement of rate–distortion and reliability tradeoffs. Classical Shannon theory emerges as a limiting case corresponding to vanishing structural resolution. Note: Structured Channel Coding notes are available upon request.