Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
BlinkDL authored Dec 28, 2023
1 parent e254e4c commit 6a702c2
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
### HOW TO TEST TRAINING RWKV-5 on MiniPile (1.5G tokens) ##

Use python 3.10 and cuda 11.7.1 / 11.7 (note torch2 + deepspeed has weird bugs and hurts model performance).
Use python 3.10 and cuda 11.7.1 / 11.7 (note torch2 + cuda12 has weird bugs and hurts model performance).
```
pip install torch==1.13.1+cu117 --extra-index-url https://download.pytorch.org/whl/cu117
pip install pytorch-lightning==1.9.5 deepspeed==0.7.0 wandb ninja
Expand Down

0 comments on commit 6a702c2

Please sign in to comment.