Lux: Explicit Parameterization of Deep Neural Networks in Julia

LuxLib LuxLib-v1.3.11

Diff since LuxLib-v1.3.10

Merged pull requests:

• Update exporting_to_jax.md (#1107) (@wsmoses)
• CompatHelper: bump compat for LossFunctions in [weakdeps] to 1, (keep existing compat) (#1108) (@github-actions[bot])
• Add TrainState docstring with Optimisers API (#1110) (@abhro)
• Fix markdown list in docstring (#1111) (@abhro)
• chore: bump crate-ci/typos from 1.27.3 to 1.28.1 (#1113) (@dependabot[bot])
• fix: handle debug leafs with dispatch (#1115) (@avik-pal)
• test: allow the latest AMDGPU to be installed (#1116) (@avik-pal)
• test: add unsafe_free to skip list (#1117) (@avik-pal)
• fix: use the correct dispatches for device overloads (#1118) (@avik-pal)
• test: try fixing enzyme test (#1119) (@avik-pal)
• ci(github-actions): use julia-actions/cache (#1122) (@avik-pal)
• test: re-enable flux testing (#1123) (@avik-pal)
• chore: bump minimum Reactant version (#1125) (@avik-pal)
• fix: try fixing cuda install in tests (#1126) (@avik-pal)
• docs: run partial dataset only on CI (#1128) (@avik-pal)
• chore: bump crate-ci/typos from 1.28.1 to 1.28.2 (#1130) (@dependabot[bot])
• fix: preserve object when device is same (#1133) (@avik-pal)
• fix: use functors for testing wrapped arrays (#1134) (@avik-pal)
• fix: remove old patches around reactant bug (#1135) (@avik-pal)
• CompatHelper: bump compat for Flux in [weakdeps] to 0.16, (keep existing compat) (#1136) (@github-actions[bot])
• chore: bump crate-ci/typos from 1.28.2 to 1.28.3 (#1137) (@dependabot[bot])
• fix: update to new reactant changes (#1140) (@avik-pal)
• chore: bump crate-ci/typos from 1.28.3 to 1.28.4 (#1144) (@dependabot[bot])
• don't declare implicitly exported functions public (#1147) (@simeonschaub)
• use return_type instead of _return_type (#1148) (@simeonschaub)

Closed issues:

• Immutable Arrays (#8)
• Downstream Compat Updates (#880)
• Enzyme 0.13 fails with batched matrix multiply (#1024)
• getkeypath and layer_map not fully working with model with Parallel layers (#1068)
• Re-enable Flux compatibility testing (#1070)
• [AMDGPU CI] Circular dependencies disabling precompilation (#1095)
• LuxTestUtils.Constant clashes with DifferentiationInterface.Constant (#1103)
• Error in trying to use Optimization.jl for LSTM training based on Lux.jl (#1114)
• Documentation Build Stalls (#1120)
• CUDA Test CI is broken (#1121)
• [MLDataDevices] devices don't preserve identity (#1129)
• Problem with Lux & SymbolicsLuxExt (#1132)
• How to implement a detach operation similar to Pytorch? (#1138)
• Unexpected handling of LR Schedulers in TrainState (#1143)
• Directly construct Optimiser state on Reactant buffers (#1145)
• (AbstractDevice)(x) should respect Adapt.adapt_structure (#1149)