gazelle93 / Transformer-Various-Positional-Encoding Star 18 Code Issues Pull requests This project aims to implement the Transformer Encoder blocks using various Positional Encoding methods. nlp natural-language-processing pytorch spacy transformer nltk gensim wordembeddings transformer-encoder t5 relative-positional-encoding relative-positional-representation Updated Nov 14, 2022 Python
asigalov61 / Morpheus Star 17 Code Issues Pull requests Discussions [DEPRECIATED] Symbolic MIDI Music AI implementation music music-player midi drums music-composition continuation artificial-intelligence music-generation inpainting accompaniment pytorch-implementation music-clip music-ai music-ai-architectures multi-instrumental multiple-embedding relative-positional-representation relative-global-attention rpr-rga language-music-pretraining Updated Jun 11, 2022 Python
gazelle93 / Attention-Various-Positional-Encoding Star 3 Code Issues Pull requests This project aims to implement the Scaled-Dot-Product Attention layer and the Multi-Head Attention layer using various Positional Encoding methods. nlp natural-language-processing pytorch spacy nltk gensim attention-mechanism wordembeddings multi-head-attention t5 relative-positional-encoding scaled-dot-product relative-positional-representation Updated Jun 27, 2022 Python