Published June 22, 2026 | Version v7

PsiQRH Fractal Attention: What We Built, What It Should Be, and Why It Could Be a Foundation

Authors/Creators

  • 1. Independent Researcher

Description

Complete analysis of the fractal attention mechanisms in the PsiQRH stack. WHAT WE BUILT: 1. RiemannAttention: Q·K^T + softmax O(n^2) — usado no modelo treinado 2. SpectralAttention: Q·K^T + FFT2 + F(k) + softmax — O(n^2 log n) 3. QuaternionSpectralAttention: Hamilton + FFT2 + softmax 4. KuramotoLayer: osciladores acoplados SEM softmax — O(n·steps) WHAT IT SHOULD BE: A atencao fractal substitui softmax por kernel de decaimento baseado em dimensao fractal D: kappa(r,D) = exp(-r^2/2sigma^2(D)). Isso permite: - Kernel local O(n·k) em vez de O(n^2) - FFT na sequencia O(n log n) em vez de FFT na matriz O(n^2 log n) - Normalizacao LOCAL (nao global como softmax) - Feedback adaptativo: D regula alpha que regula o kernel WHY IT DIDN'T WORK: - Subtreinamento 200x abaixo do ideal (3M vs 644M tokens) - Softmax NUNCA foi substituido no modelo treinado - Componentes geometricos: 0.02% dos parametros - Kuramoto, fractal, consciencia isolados em src/ — nunca integrados WHY IT COULD BE A FOUNDATION: - ParametricSurface: unica alternativa continua a embeddings discretos - SpectralFilter: conecta dimensao fractal a parametros de atencao - KuramotoLayer: unica implementacao que elimina softmax - 42 testes automatizados: tudo funciona, basta conectar e treinar em escala

Files

analise_matematica.md

Files (140.1 kB)

Name Size Download all
md5:59be4595746e399e812eb4aced940ac1
5.6 kB Preview Download
md5:9ed11071ad4da5d42e39cc1e91057c32
10.6 kB Preview Download
md5:e27f0d0968edf4ed26e548d4a1bd15cd
8.8 kB Download
md5:cc75e7068c8dbf16ebf88967374bc678
15.3 kB Download
md5:2c29a72c0b4e49c8b1babd85e88059c4
19.1 kB Preview Download
md5:3da72e15aeeab1cfdc600a7611892380
13.5 kB Preview Download
md5:c505b5f830d3527f28414a2e699c055a
15.1 kB Preview Download
md5:d61de2dfb2e2a029147e715b1b01ba7a
12.8 kB Preview Download
md5:66c942a5fb3de6944d076d370f2e714a
16.9 kB Download
md5:d640741fbab719248bdff3df9144cef0
22.4 kB Preview Download

Additional details