Lux: Explicit Parameterization of Deep Neural Networks in Julia

LuxLib LuxLib-v1.6.2

Diff since LuxLib-v1.6.1

Merged pull requests:

• feat: don't unroll Recurrence (#1209) (@avik-pal)
• feat: compile hypernet with reactant (#1227) (@avik-pal)
• feat: show how to use model explorer (#1228) (@avik-pal)
• Fix small typo in docs: "to compiler models" => "to compile models" (#1229) (@Dale-Black)
• CompatHelper: bump compat for MKL in [weakdeps] to 0.8 for package LuxLib, (keep existing compat) (#1231) (@github-actions[bot])
• chore: bump crate-ci/typos from 1.29.4 to 1.29.5 (#1232) (@dependabot[bot])
• feat: high-level implementations for Positional Embeddings (#1237) (@avik-pal)
• chore: bump crate-ci/typos from 1.29.5 to 1.29.7 (#1239) (@dependabot[bot])
• Update LUX.jl/examples/SimpleRNN/main.jl (#1240) (@aligurbu)
• feat: distinct recurrent initializer option for recurrent layers (#1242) (@MartinuzziFrancesco)
• fix: adapt to upcoming reactant changes (#1246) (@avik-pal)
• chore: bump crate-ci/typos from 1.29.7 to 1.29.9 (#1248) (@dependabot[bot])
• docs: update to new DocumenterVitepress Improvements (#1250) (@avik-pal)
• feat: relax conditions (#1252) (@avik-pal)
• chore: bump crate-ci/typos from 1.29.9 to 1.30.0 (#1253) (@dependabot[bot])
• feat: allow specifying sharding in ReactantDevice (#1254) (@avik-pal)
• refactor: use runic for formatting (#1255) (@avik-pal)
• Add way to silence gpu warning (#1256) (@IanButterworth)
• feat: tracing stateful layers (#1257) (@avik-pal)
• chore: bump crate-ci/typos from 1.30.0 to 1.30.1 (#1258) (@dependabot[bot])
• Docs: Update autodiff.md to correct typos (#1259) (@sinhtrung)
• Update OptimizationIntegration/main.jl comment to match link title (#1261) (@sinhtrung)
• test: mark a test as broken (#1263) (@avik-pal)
• refactor: cleanup dependencies (Hwloc + CpuId) (#1264) (@avik-pal)

Closed issues:

• Lux.jl model visualizer (#1214)
• Allow different initializers for input and hidden in recurrent layers (#1241)
• Relax MLDataDevices.combine_devices for ReactantDevice and CPUDevice (#1244)
• AutoEnzyme() errors on training dense layer (#1249)
• New Reactant Release breaks ConcreteRNG (#1251)
• Example from Training Lux Models using Optimization.jl not working in CPU (#1260)