fix readme

labmlai · Apr 11, 2022 · ac43bfd · ac43bfd
1 parent c5f62a0
commit ac43bfd
Show file tree

Hide file tree

Showing 2 changed files with 4 additions and 5 deletions.
diff --git a/assets/annotated_gpt_neox_model.png b/assets/annotated_gpt_neox_model.png
diff --git a/readme.md b/readme.md
@@ -1,15 +1,14 @@
-# Simple Annotated implementation GPT-NeoX in PyTorch
+# Simple Annotated implementation of GPT-NeoX in PyTorch
 
 This is a simpler implementation of [GPT-NeoX](https://github.com/EleutherAI/gpt-neox) in PyTorch.
-We have taken out most of the optimizations in GPT-NeoX for simplicity.
-It can load the pre-trained parameters.
+We have taken out several optimizations in GPT-NeoX for simplicity.
 
 ### [Annotated implementation](https://lit.labml.ai/github/labmlai/neox/tree/main/src/neox/__init__.py)
 
 ### Sample usages
 
+* [Notebook to download checkpoints and test the model](https://github.com/labmlai/neox/tree/main/notebooks/download_and_evaluate.ipynb)
+ [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/labmlai//neox/tree/main/notebooks/download_and_evaluate.ipynb)
 * [Fine-tuning example](https://lit.labml.ai/github/labmlai/neox/tree/main/src/neox/samples/fine_tune_biases.py)
 * [Text generating on multi GPU](https://lit.labml.ai/github/labmlai/neox/tree/main/src/neox/samples/generating_pipe.html)
 * 🚧 [Text generating on a single GPU](https://lit.labml.ai/github/labmlai/neox/tree/main/src/neox/samples/generating_single_gpu.html)
-* [Notebook to download checkpoints and test the model](https://github.com/labmlai/neox/tree/main/notebooks/download_and_evaluate.ipynb)
- [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/labmlai//neox/tree/main/notebooks/download_and_evaluate.ipynb)