There is a newer version of the record available.

Published March 16, 2026 | Version v21

Semantic Identity Compression: Exact Zero-Error Laws, Rate-Distortion, and Neurosymbolic Necessity

  • 1. EDMO icon McGill University

Description

Symbolic systems operate over exact identities: variables denote specific objects, pointers target precise memory locations, and database keys refer to singular records. Neural embeddings generalize by compressing away semantic detail, but this compression creates collision ambiguity: multiple distinct entities can share the same representation value. We characterize exactly how much additional information must be supplied to recover precise identity from such representations.

The answer is controlled by a single combinatorial object: the collision-fiber geometry of the representation map π. Let A_π = maxᵤ|π⁻¹(u)| be the largest collision fiber. We prove a tight fixed-length converse L ≥ log₂A_π, an exact finite-block scaling law, a pointwise adaptive budget ⌈log₂|π⁻¹(u)|⌉, and the rate-distortion tradeoff with an explicit distortion floor when identity bits are withheld. The same fiber geometry determines query complexity and canonical structure for distinguishing families.

Because this residual ambiguity is structural rather than representation-specific, symbolic identity mechanisms (handles, keys, pointers, nominal tags) are the necessary system-level complement to any non-injective semantic representation. All main results are machine-checked in Lean 4.

Files

paper1_jsait.pdf

Files (1.1 MB)

Name Size
md5:a1acce24e3e7e36712d1ac570b7c6294
361.0 kB Preview Download
md5:f65d32697a6f9ff33c6e53150d3306b1
788.4 kB Preview Download

Additional details

Dates

Available
2026-01-07
Initial publication

Software

Programming language
Python
Development Status
Active