Published June 22, 2026
| Version v7
Report
Open
PsiQRH Fractal Attention: What We Built, What It Should Be, and Why It Could Be a Foundation
Description
Complete analysis of the fractal attention mechanisms in the PsiQRH stack.
WHAT WE BUILT:
1. RiemannAttention: Q·K^T + softmax O(n^2) — usado no modelo treinado
2. SpectralAttention: Q·K^T + FFT2 + F(k) + softmax — O(n^2 log n)
3. QuaternionSpectralAttention: Hamilton + FFT2 + softmax
4. KuramotoLayer: osciladores acoplados SEM softmax — O(n·steps)
WHAT IT SHOULD BE:
A atencao fractal substitui softmax por kernel de decaimento baseado em
dimensao fractal D: kappa(r,D) = exp(-r^2/2sigma^2(D)). Isso permite:
- Kernel local O(n·k) em vez de O(n^2)
- FFT na sequencia O(n log n) em vez de FFT na matriz O(n^2 log n)
- Normalizacao LOCAL (nao global como softmax)
- Feedback adaptativo: D regula alpha que regula o kernel
WHY IT DIDN'T WORK:
- Subtreinamento 200x abaixo do ideal (3M vs 644M tokens)
- Softmax NUNCA foi substituido no modelo treinado
- Componentes geometricos: 0.02% dos parametros
- Kuramoto, fractal, consciencia isolados em src/ — nunca integrados
WHY IT COULD BE A FOUNDATION:
- ParametricSurface: unica alternativa continua a embeddings discretos
- SpectralFilter: conecta dimensao fractal a parametros de atencao
- KuramotoLayer: unica implementacao que elimina softmax
- 42 testes automatizados: tudo funciona, basta conectar e treinar em escala
Files
analise_matematica.md
Files
(140.1 kB)
| Name | Size | Download all |
|---|---|---|
|
md5:59be4595746e399e812eb4aced940ac1
|
5.6 kB | Preview Download |
|
md5:9ed11071ad4da5d42e39cc1e91057c32
|
10.6 kB | Preview Download |
|
md5:e27f0d0968edf4ed26e548d4a1bd15cd
|
8.8 kB | Download |
|
md5:cc75e7068c8dbf16ebf88967374bc678
|
15.3 kB | Download |
|
md5:2c29a72c0b4e49c8b1babd85e88059c4
|
19.1 kB | Preview Download |
|
md5:3da72e15aeeab1cfdc600a7611892380
|
13.5 kB | Preview Download |
|
md5:c505b5f830d3527f28414a2e699c055a
|
15.1 kB | Preview Download |
|
md5:d61de2dfb2e2a029147e715b1b01ba7a
|
12.8 kB | Preview Download |
|
md5:66c942a5fb3de6944d076d370f2e714a
|
16.9 kB | Download |
|
md5:d640741fbab719248bdff3df9144cef0
|
22.4 kB | Preview Download |
Additional details
Related works
- Is supplement to
- 10.5281/zenodo.20771308 (DOI)
- 10.5281/zenodo.20798225 (DOI)
- 10.5281/zenodo.20798599 (DOI)