Tags: kyegomez/zeta
Tags
[FEAT]-[Module]: [return_loss_text]: Add [return_loss_text] function … …for enhanced loss computation readability [FEAT]-[Module]: [calc_z_loss]: Introduce [calc_z_loss] function to calculate Z loss in model training [FEAT]-[Module]: [max_neg_value]: Implement [max_neg_value] function for negative value handling in computations [FEAT]-[Module]: [TextTokenEmbedding]: Deploy [TextTokenEmbedding] for improved text token embedding functionality [FEAT]-[Module]: [dropout_seq]: Add [dropout_seq] function for sequence dropout in neural network layers [FEAT]-[Module]: [transformer_generate]: Introduce [transformer_generate] function for efficient transformer text generation [FEAT]-[Module]: [vit_output_head]: Add [vit_output_head] for Vision Transformer model output handling [FEAT]-[Module]: [patch_linear_flatten]: Implement [patch_linear_flatten] for streamlined linear patch flattening in ViT [FEAT]-[Module]: [ScalableImgSelfAttention]: Introduce [ScalableImgSelfAttention] for scalable image self-attention mechanism ]