Releases: lucidrains/self-reasoning-tokens-pytorch
Releases · lucidrains/self-reasoning-tokens-pytorch
0.0.4
Full Changelog: 0.0.3...0.0.4
0.0.2
offer a naive unoptimized attention w/ stop graddable queries, keys, … …values, and fix the self reasoning transformer to only stop grad keys and values for the reasoning tokens