There is a newer version of the record available.

Published July 20, 2026 | Version v26

Semantic Identity Compression: Zero-Error Laws, Rate-Distortion, and Neurosymbolic Necessity

  • 1. EDMO icon McGill University

Description

Symbolic systems operate over precise identities: variables denote specific objects, pointers target precise memory locations, and database keys refer to singular records. Neural embeddings generalize by compressing away semantic detail, but this compression creates collision ambiguity: multiple distinct entities can share the same representation value. Exact identity recovery requires additional information precisely when representation fibers have size greater than one.

The residual cost is controlled by a single combinatorial object: the collision-fiber geometry of the representation map π. Let A_π = maxᵤ|π⁻¹(u)| be the largest collision fiber. The finite laws include a tight fixed-length converse L ≥ log₂A_π, an exact finite-block scaling law, a pointwise adaptive budget ⌈log₂|π⁻¹(u)|⌉, and an exact fiberwise rate-distortion law for arbitrary finite sources via recoverable-mass decomposition across representation fibers. The uniform single-block formula D^⋆(L) = max (0, 1 − 2ᴸ/a) appears as a closed-form special case when all mass lies on one collision block, where a = A_π is the collision block size. The same fiber geometry determines query complexity and canonical structure for distinguishing families.

Residual ambiguity depends only on the fiber structure of the representation. Symbolic identity mechanisms, including handles, keys, pointers, and nominal tags, supply the system-level complement required by any non-injective semantic representation. All main results are machine-checked in Lean 4.

Files

paper1_jsait.pdf

Files (1.3 MB)

Name Size
md5:021528688ef311f013c2941ea400143b
355.5 kB Preview Download
md5:221aa98fae76281a27e86976b384762d
707.1 kB Preview Download
md5:3d669ceafdcf7ccc86db2f0ed7a8d69b
234.5 kB Preview Download

Additional details

Software

Programming language
Python
Development Status
Active