[Diff since v0.5.57](v0.5.57...v0.5.58)

**Merged pull requests:**
- CompatHelper: bump compat for AMDGPU in [weakdeps] to 0.9, (keep existing compat) (#717) (@github-actions[bot])
- Makes `name` concrete types (#723) (@avik-pal)
- CompatHelper: add new compat entry for StaticArrays at version 1 for package docs, (keep existing compat) (#724) (@github-actions[bot])
- CompatHelper: add new compat entry for KernelAbstractions at version 0.9 for package docs, (keep existing compat) (#725) (@github-actions[bot])
- Bump crate-ci/typos from 1.22.7 to 1.22.9 (#726) (@dependabot[bot])
- Performance Pitfalls and How to Catch them (#727) (@avik-pal)
- CompatHelper: bump compat for DynamicExpressions in [weakdeps] to 0.18, (keep existing compat) (#728) (@github-actions[bot])
- CompatHelper: bump compat for DynamicExpressions to 0.18 for package SymbolicOptimalControl, (keep existing compat) (#729) (@github-actions[bot])
- Store the optimizer in TrainState (#731) (@avik-pal)
- Simply `show` implementations and make them round-trippable (#732) (@avik-pal)
- Try removing the type assert with this (#734) (@avik-pal)
- Add enzyme support for loss functions from LossFunctions.jl (#736) (@avik-pal)
- Mark cartersian index tests on cuda broken for now (#737) (@avik-pal)
- Run CI on pre (#739) (@avik-pal)
- Revert bee2de7-1188db7 (#740) (@avik-pal)
- Use shorthand syntax of @concrete (#741) (@avik-pal)
- Check status of broken tests (#742) (@avik-pal)

**Closed issues:**
- Auto detect and warn against performance pitfalls (#699)
- Inference using `NN :: Chain` inside a GPU kernel (#720)
- custom `show` is often not valid julia syntax to reconstruct (#730)

[Diff since v0.5.56](v0.5.56...v0.5.57)

**Merged pull requests:**
- Try wider docs (#721) (@avik-pal)
- Compiled ReverseDiff for training on CPU (#722) (@avik-pal)

**Closed issues:**
- Add a compiled tape version for ReverseDiff (#642)

[Diff since v0.5.55](v0.5.55...v0.5.56)

**Merged pull requests:**
- Loss functions module (#704) (@avik-pal)
- Try to improve coverage (#718) (@avik-pal)

**Closed issues:**
- Documentation Request: Have a section about Loss Functions (#517)

[Diff since v0.5.54](v0.5.54...v0.5.55)

**Merged pull requests:**
- Add `ReverseSequence()` docs (#706) (@NeroBlackstone)
- Run doctests in the test CI + Lazy install test dependencies (#710) (@avik-pal)
- Bump crate-ci/typos from 1.22.3 to 1.22.7 (#711) (@dependabot[bot])
- Mark unexported symbols as public (#712) (@avik-pal)
- Install packages before loading (#713) (@avik-pal)
- Extend training API and update examples (#714) (@avik-pal)
- Try fixing AMDGPU test stalling (#716) (@avik-pal)

**Closed issues:**
- Add documentation about how to partial tests. (#701)
- Feature request: 1D CNN, i.e. keras.layer.Conv1d (#709)
- AMDGPU CI stalls (#715)

[Diff since v0.5.53](v0.5.53...v0.5.54)

**Merged pull requests:**
- Test ComponentArrays with Enzyme (#653) (@avik-pal)
- Update DocumenterVitepress compat in docs (#654) (@asinghvi17)
- Minor optimizations (#681) (@avik-pal)
- CompatHelper: bump compat for Turing to 0.33 for package BayesianNN, (keep existing compat) (#688) (@github-actions[bot])
- Newer public functions (#690) (@avik-pal)
- Update Boltz API Docs (#691) (@avik-pal)
- Bump crate-ci/typos from 1.21.0 to 1.22.3 (#693) (@dependabot[bot])
- More API updates (#696) (@avik-pal)
- Add ReverseSequence (#698) (@NeroBlackstone)
- Training ConvMixer on CIFAR10 in 10mins (#700) (@avik-pal)
- Add activation functions doc reference (Rebase #694) (#702) (@avik-pal)
- Clean up the CI scripts (#703) (@avik-pal)
- Add test guide documentation (#705) (@NeroBlackstone)

**Closed issues:**
- Different activation functions in one layer (#680)
- Support for inactive arguments in DifferentiationInterface (#685)
- Predefined loss functions (#689)
- Static Type Parameters not accessible inside `@compact` (#692)

[Diff since v0.5.52](v0.5.52...v0.5.53)

**Merged pull requests:**
- Update & Rewrite the DDIM example (#661) (@avik-pal)
- Add Cartesian Embedding methods (#670) (@ldeso)
- More principled rewrite of layer_map (#671) (@avik-pal)
- Clean up the code for debug mode (#674) (@avik-pal)
- CompatHelper: add new compat entry for TensorBoardLogger at version 0.1 for package DDIM, (keep existing compat) (#676) (@github-actions[bot])
- CompatHelper: add new compat entry for CairoMakie at version 0.12 for package DDIM, (keep existing compat) (#677) (@github-actions[bot])
- Remove rrule for merge (#679) (@avik-pal)

**Closed issues:**
- Rewrite `@layer_map` to use KeyPath from Functors (#615)
- `rrule` for `Base.merge` defined in `ChainRulesCore` (#678)

[Diff since v0.5.51](v0.5.51...v0.5.52)

**Merged pull requests:**
- Bump julia-actions/julia-format from 2 to 3 (#660) (@dependabot[bot])
- Quality of Life Improvements (#666) (@avik-pal)
- CompatHelper: bump compat for SymbolicUtils to 2 for package SymbolicOptimalControl, (keep existing compat) (#669) (@github-actions[bot])

**Closed issues:**
- Error for JVP by Enzyme (#628)
- Using `swish` as `Conv` activation function errors on the GPU (#662)
- Fast activation error (#663)
- Definition and implementation of 'Loss' in Linear Regression Tutorial "Julia & Lux for the Uninitiated" (#664)

[Diff since v0.5.50](v0.5.50...v0.5.51)

**Merged pull requests:**
- Use ArgCheck.jl for helpful error messages (#655) (@avik-pal)
- CompatHelper: bump compat for OptimizationOptimJL to 0.3 for package GravitationalWaveForm, (keep existing compat) (#656) (@github-actions[bot])
- CompatHelper: bump compat for OptimizationOptimJL to 0.3 for package SymbolicOptimalControl, (keep existing compat) (#657) (@github-actions[bot])
- CompatHelper: bump compat for Turing to 0.32 for package BayesianNN, (keep existing compat) (#658) (@github-actions[bot])
- Restore the rrule for merge (#659) (@avik-pal)

[Diff since v0.5.49](v0.5.49...v0.5.50)

**Merged pull requests:**
- Prevent infinite loop in Tracker (#652) (@avik-pal)

**Closed issues:**
- Simple MLP requires Enzyme runtimeActivity (#647)

[Diff since v0.5.48](v0.5.48...v0.5.49)

**Merged pull requests:**
- Patch a compact bug (#648) (@avik-pal)
- update makie (#649) (@avik-pal)
- Test on multiple os (#650) (@avik-pal)
- Fix DocumenterVitepress compat (#651) (@avik-pal)

**Closed issues:**
- Let @compact return the updated state  (#516)