huu4ontocord
Follow
Stars
Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmind
32 times longer context window than vanilla Transformers and up to 4 times longer than memory efficient Transformers.
Implementation of the conditionally routed attention in the CoLT5 architecture, in Pytorch
Adversarial Training and SFT for Bot Safety Models
Exploring finetuning public checkpoints on filter 8K sequences on Pile
Experiments with generating opensource language model assistants
OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.
Mass-editing thousands of facts into a transformer memory (ICLR 2023)
RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference,…
Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch
NvTK (NvwaToolKit), is a systemmatic and easy-using deep learning software in single-cell genomics.
Document reading & preprocessing for PII Management
This repo provides the code for the ACL 2020 paper "Evidence-Aware Inferential Text Generation with Vector Quantised Variational AutoEncoder"
min(DALL·E) is a fast, minimal port of DALL·E Mini to PyTorch
PII Detection Code Developed by the AISC Community For BigScience Datasets
PII Processing code to detect and remediate PII in BigScience datasets. Reference implementation for the PII Hackathon
Tools for managing datasets for governance and training.
MTet: Multi-domain Translation for English and Vietnamese
Data Augmentation by Backtranslation (DAB) ヽ( •_-)ᕗ
Generate BERT vocabularies and pretraining examples from Wikipedias
56 language, 1 model Multilingual ASR
A simple way to demo Flask apps from your machine.
An easy-to-use PWA to monitor the user's wellness and learn about COVID-19.