There is a newer version of the record available.

Published March 31, 2026 | Version v24

Semantic Identity Compression: Zero-Error Laws, Rate-Distortion, and Neurosymbolic Necessity

  • 1. EDMO icon McGill University

Description

Symbolic systems operate over precise identities: variables denote specific objects, pointers target precise memory locations, and database keys refer to singular records. Neural embeddings generalize by compressing away semantic detail, but this compression creates collision ambiguity: multiple distinct entities can share the same representation value. We characterize how much additional information must be supplied to recover precise identity from such representations.

The answer is controlled by a single combinatorial object: the collision-fiber geometry of the representation map π. Let A_π = maxᵤ|π⁻¹(u)| be the largest collision fiber. We prove a tight fixed-length converse L ≥ log₂A_π, an exact finite-block scaling law, a pointwise adaptive budget ⌈log₂|π⁻¹(u)|⌉, and an exact fiberwise rate-distortion law for arbitrary finite sources via recoverable-mass decomposition across representation fibers. The uniform single-block formula D^⋆(L) = max (0, 1 − 2ᴸ/a) appears as a closed-form special case when all mass lies on one collision block, where a = A_π is the collision block size. The same fiber geometry determines query complexity and canonical structure for distinguishing families.

Because this residual ambiguity is structural rather than representation-specific, symbolic identity mechanisms (handles, keys, pointers, nominal tags) are the necessary system-level complement to any non-injective semantic representation. All main results are machine-checked in Lean 4.

Files

paper1_jsait.pdf

Files (1.3 MB)

Name Size
md5:563e04d4edc7c2c51d58c64fff553470
344.2 kB Preview Download
md5:6216190221c87570041f8eb6ef1e43bb
720.4 kB Preview Download
md5:0382f87f7e6e20e4c1b3780f70140350
269.0 kB Preview Download

Additional details

Software

Programming language
Python
Development Status
Active