-
Updated
Jan 9, 2024 - Python
#
retnet
Here are 4 public repositories matching this topic...
This is the repo for the MixKABRN Neural Network (Mixture of Kolmogorov-Arnold Bit Retentive Networks), and an attempt at first adapting it for training on text, and later adjust it for other modalities.
ai
neural-network
model
architecture
moe
bitnet
mixture-of-experts
ai-models
llms
retnet
retentive-network
kolmogorov-arnold-networks
-
Updated
May 14, 2024 - Python
An implementation of "Retentive Network: A Successor to Transformer for Large Language Models"
-
Updated
Nov 2, 2023 - Python
Improve this page
Add a description, image, and links to the retnet topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the retnet topic, visit your repo's landing page and select "manage topics."