Commits

Commits on Jun 11, 2024

fix t2t vit having two layernorms, and make final layernorm in distillation wrapper configurable, default to False for vit
lucidrains
committedJun 11, 2024

Commits on May 11, 2024

rotary needs to be done with full precision to be safe
lucidrains
committedMay 11, 2024

Commits on May 2, 2024

address #300
lucidrains
committedMay 2, 2024

Commits on Apr 18, 2024

address #306
lucidrains
committedApr 18, 2024

Commits on Apr 17, 2024

address #304
lucidrains
committedApr 17, 2024

Commits on Dec 23, 2023

address #292
lucidrains
committedDec 23, 2023

Commits on Nov 15, 2023

share an idea that should be tried if it has not been
lucidrains
committedNov 15, 2023

Commits on Oct 25, 2023

allow channels to be customizable for cvt
lucidrains
committedOct 25, 2023

Commits on Oct 24, 2023

1.6.2
lucidrains
committedOct 24, 2023

Commits on Oct 20, 2023

no longer needed with einops 0.7
lucidrains
committedOct 20, 2023

Commits on Oct 19, 2023

readme
lucidrains
committedOct 19, 2023

Commits on Oct 13, 2023

add xcit diagram
lucidrains
committedOct 13, 2023
add xcit (#284 )
lucidrains
committedOct 13, 2023

Commits on Oct 6, 2023

give a learned bias to and from registers for maxvit + register token variant
lucidrains
committedOct 6, 2023
improvise a max vit with register tokens
lucidrains
committedOct 6, 2023

Commits on Oct 3, 2023

document in readme later
lucidrains
committedOct 3, 2023

Commits on Oct 1, 2023

fix pypi
lucidrains
committedOct 1, 2023
add simple vit with register tokens example, cite
lucidrains
committedOct 1, 2023

Commits on Sep 10, 2023

address #279
lucidrains
committedSep 10, 2023

Commits on Aug 14, 2023

just remove PreNorm wrapper from all ViTs, as it is unlikely to change at this point
lucidrains
committedAug 14, 2023
1.4.2
lucidrains
committedAug 14, 2023
add a simple vit with qknorm, since authors seem to be promoting the technique on twitter
lucidrains
committedAug 14, 2023

Commits on Aug 10, 2023

fix linear head in simple vit, thanks to @atkos
lucidrains
committedAug 10, 2023

Commits on Aug 9, 2023

address #274
lucidrains
committedAug 9, 2023

Commits on Jul 25, 2023

wrap up NaViT
lucidrains
committedJul 25, 2023

Commits on Jul 24, 2023

one can pass a callback to token_dropout_prob for NaViT that takes in height and width and calculate appropriate dropout rate
lucidrains
committedJul 24, 2023
add constant token dropout for NaViT
lucidrains
committedJul 24, 2023
release NaViT
lucidrains
committedJul 24, 2023
begin work on NaViT (#273 )
lucidrains
committedJul 24, 2023
1.2.5
lucidrains
committedJul 24, 2023

Commits on Jun 28, 2023

fix mpp
lucidrains
committedJun 28, 2023

Commits on May 20, 2023

address #266
lucidrains
committedMay 20, 2023

Commits on May 8, 2023

enforce latest einops
lucidrains
committedMay 8, 2023

Commits on Mar 19, 2023

fix tests
lucidrains
committedMar 19, 2023

Commits on Mar 18, 2023

add a version of simple vit using flash attention
lucidrains
committedMar 18, 2023