Skip to content

Tags: kyegomez/zeta

Tags

2.3.7

Toggle 2.3.7's commit message
[FEAT]-[Module]: [return_loss_text]: Add [return_loss_text] function …

…for enhanced loss computation readability

[FEAT]-[Module]: [calc_z_loss]: Introduce [calc_z_loss] function to calculate Z loss in model training
[FEAT]-[Module]: [max_neg_value]: Implement [max_neg_value] function for negative value handling in computations
[FEAT]-[Module]: [TextTokenEmbedding]: Deploy [TextTokenEmbedding] for improved text token embedding functionality
[FEAT]-[Module]: [dropout_seq]: Add [dropout_seq] function for sequence dropout in neural network layers
[FEAT]-[Module]: [transformer_generate]: Introduce [transformer_generate] function for efficient transformer text generation
[FEAT]-[Module]: [vit_output_head]: Add [vit_output_head] for Vision Transformer model output handling
[FEAT]-[Module]: [patch_linear_flatten]: Implement [patch_linear_flatten] for streamlined linear patch flattening in ViT
[FEAT]-[Module]: [ScalableImgSelfAttention]: Introduce [ScalableImgSelfAttention] for scalable image self-attention mechanism
]

0.0.111

Toggle 0.0.111's commit message
zeta scale

0.0.11

Toggle 0.0.11's commit message
clean up

0.0.3

Toggle 0.0.3's commit message
attention export

0.0.2

Toggle 0.0.2's commit message
clean up

0.0.1

Toggle 0.0.1's commit message
push attention config