Skip to content

Tags: lucidrains/x-transformers

Tags

1.37.9

Toggle 1.37.9's commit message 
allow for sigmoid attention

1.37.8

Toggle 1.37.8's commit message 
small tweak

1.37.7

Toggle 1.37.7's commit message 
make l2 distance attention work with flash attention

1.37.6

Toggle 1.37.6's commit message 
offer l2 distance attention for starters and cite

1.37.5

Toggle 1.37.5's commit message 
offer l2 distance attention for starters and cite

1.37.4

Toggle 1.37.4's commit message 
make sure xl and nar can handle mixture of softmax

1.37.3

Toggle 1.37.3's commit message 
add sigsoftmax for good measure

1.37.2

Toggle 1.37.2's commit message 
add option to use mixture of softmax in TransformerWrapper + some cle…

…anup

1.37.1

Toggle 1.37.1's commit message 
add option to use mixture of softmax in TransformerWrapper + some cle…

…anup

1.37.0

Toggle 1.37.0's commit message 
add option to use mixture of softmax in TransformerWrapper + some cle…

…anup