Popular repositories Loading

1. LCKV LCKV Public

   Layer-Condensed KV cache w/ 10 times larger batch size, fewer params and less computation. Dramatic speed up with better task performance. Accepted to ACL 2024.

   Python 110 6

2. Conic10K Conic10K Public

   Conic10K: A large-scale dataset for closed-vocabulary math problem understanding. Accepted to EMNLP2023 Findings.

   Python 22 2

3. Probabilistic-Transformer Probabilistic-Transformer Public

   A probabilitic model for contextual word representation. Accepted to ACL2023 Findings.

   Python 14 2

4. tinyllama tinyllama Public

   A side project that follows all the acceleration tricks in tinyllama, with the minimal modification to the huggingface transformers code.

   Python 10

5. nni-slurm nni-slurm Public

   Forked from microsoft/nni

   A patch for NNI with slurm and W&B.

   Python 6

6. tinyllama-zh tinyllama-zh Public

   A side project that pretrains a tinyllama on Chinese corpora, with the minimal modification to the huggingface transformers code.

   Python 6 1