Commits

Commits on Aug 7, 2024

1.7.5
lucidrains
committedAug 7, 2024
add the u-vit implementation with simple vit + register tokens
lucidrains
committedAug 7, 2024

Commits on Jul 20, 2024

attention re-use in lookup vit should use pre-softmax attention matrix
lucidrains
committedJul 20, 2024

Commits on Jul 19, 2024

when cross attending in look vit, make sure context tokens are normalized
lucidrains
committedJul 19, 2024
norm not needed when reusing attention in lookvit
lucidrains
committedJul 19, 2024
1.7.1
lucidrains
committedJul 19, 2024
add lookup vit, cite, document later
lucidrains
committedJul 19, 2024

Commits on Jun 11, 2024

fix t2t vit having two layernorms, and make final layernorm in distillation wrapper configurable, default to False for vit
lucidrains
committedJun 11, 2024

Commits on May 11, 2024

rotary needs to be done with full precision to be safe
lucidrains
committedMay 11, 2024

Commits on May 2, 2024

address #300
lucidrains
committedMay 2, 2024

Commits on Apr 18, 2024

address #306
lucidrains
committedApr 18, 2024

Commits on Apr 17, 2024

address #304
lucidrains
committedApr 17, 2024
Update setup.py (#303 )
soumya1729
committedApr 17, 2024

Commits on Dec 23, 2023

address #292
lucidrains
committedDec 23, 2023

Commits on Nov 15, 2023

share an idea that should be tried if it has not been
lucidrains
committedNov 15, 2023

Commits on Oct 25, 2023

allow channels to be customizable for cvt
lucidrains
committedOct 25, 2023

Commits on Oct 24, 2023

1.6.2
lucidrains
committedOct 24, 2023
Fix typo in LayerNorm (#285 )
l0wgear
committedOct 24, 2023

Commits on Oct 20, 2023

no longer needed with einops 0.7
lucidrains
committedOct 20, 2023

Commits on Oct 19, 2023

readme
lucidrains
committedOct 19, 2023

Commits on Oct 13, 2023

add xcit diagram
lucidrains
committedOct 13, 2023
add xcit (#284 )
lucidrains
committedOct 13, 2023

Commits on Oct 9, 2023

Update README.md (#283 )
EIFY
committedOct 9, 2023

Commits on Oct 6, 2023

give a learned bias to and from registers for maxvit + register token variant
lucidrains
committedOct 6, 2023
improvise a max vit with register tokens
lucidrains
committedOct 6, 2023

Commits on Oct 3, 2023

document in readme later
lucidrains
committedOct 3, 2023

Commits on Oct 1, 2023

fix pypi
lucidrains
committedOct 1, 2023
add simple vit with register tokens example, cite
lucidrains
committedOct 1, 2023

Commits on Sep 10, 2023

address #279
lucidrains
committedSep 10, 2023

Commits on Aug 14, 2023

just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point
lucidrains
committedAug 14, 2023
1.4.2
lucidrains
committedAug 14, 2023
add a simple vit with qknorm, since authors seem to be promoting the technique on twitter
lucidrains
committedAug 14, 2023

Commits on Aug 10, 2023

fix linear head in simple vit, thanks to @atkos
lucidrains
committedAug 10, 2023

Commits on Aug 9, 2023

address #274
lucidrains
committedAug 9, 2023

Commits on Jul 25, 2023

wrap up NaViT
lucidrains
committedJul 25, 2023