Published November 29, 2025 | Version v1

Entropica: 1024-mode unitary evolution with Born-rule readout, trained on TinyStories in under 2 hours on a laptop GPU

Authors/Creators

Description

Entropica is the first generative language model whose forward pass is physically realizable as a passive linear-optical interferometer (zero electrical power during inference).  
A 1024-mode, 32-layer unitary network using only Reck-scheme MZI meshes and Born-rule readout learns coherent TinyStories-style generation in under 1.8 hours on a single laptop GPU.  
Model is ready for a full optical implementation path demonstrated with printed phase masks and a $30 laser pointer.  
All code, weights, and dataset generation scripts are public.

Files

Entropica - Zero-power optical language model.pdf

Files (326.4 kB)

Name Size Download all
md5:fb1c5584c2ff2fb41ff68d7abc766414
326.4 kB Preview Download

Additional details

Software

Repository URL
https://github.com/dwallener/EntropicaPublic
Programming language
Python
Development Status
Active