There is a newer version of the record available.

Published July 28, 2026 | Version v27

Semantic Identity Compression: Zero-Error Laws, Rate-Distortion, and Neurosymbolic Necessity

  • 1. EDMO icon McGill University

Description

When a semantic representation maps distinct identities to the same value, exact recovery requires auxiliary information. For a finite class set C and representation map π, the largest collision fiber A_π = maxᵤ|π⁻¹(u)| governs that cost. Because U = π(C) is determined by the encoder's input, this is the encoder-informed branch of Witsenhausen's zero-error side-information problem. On the induced cluster graph, the classical fixed-length law gives the one-shot budget ⌈log₂A_π⌉ and exact finite-block scaling; conditional prefix coding gives the pointwise budget ⌈log₂|π⁻¹(u)|⌉.

Beyond these classical specializations, optimal recoverable mass decomposes exactly across fibers for arbitrary finite sources. A fixed family of binary queries has minimum size d ≥ ⌈log₂A_π⌉, while adaptive depth can be strictly smaller. Inclusion-minimal distinguishing families are the bases of a matroid exactly when distinguishing is the corresponding spanning predicate; orthogonality alone fails by a finite counterexample.

Collision-freedom is unstable under open-world extension, and barrier-freedom is uncomputable for arbitrary future-generating code. Bits, queries, and distortion are three currencies for the same residual ambiguity; symbolic handles supply the missing identity information. Lean 4 checks the cited finite coding laws, query criteria, counterexamples, and reduction cores.

Files

paper1_jsait.pdf

Files (1.3 MB)

Name Size
md5:fdc95c171d44b95a168f9091e810410e
366.9 kB Preview Download
md5:9804b1fea6e277a70e3bb3424db7fbd0
728.2 kB Preview Download
md5:95d8779b18063786cc55c36a58eb9fc4
234.0 kB Preview Download

Additional details

Software

Programming language
Python
Development Status
Active