Skip to content
/ gdGPT Public
forked from CoinCheung/gdGPT

Train llm (bloom and llama) with deepspeed pipeline mode. Faster than zero/zero++/fsdp.

License

Apache-2.0 license
0 stars 8 forks Branches Tags Activity
Star
Notifications You must be signed in to change notification settings

l878619717/gdGPT

BranchesTags

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
configs
configs
 
 
deepspeed
deepspeed
 
 
models
models
 
 
.gitignore
.gitignore
 
 
LICENSE
LICENSE
 
 
README.md
README.md
 
 
convert_model.py
convert_model.py
 
 
datasets.py
datasets.py
 
 
datasets_for_infer.py
datasets_for_infer.py
 
 
demo.py
demo.py
 
 
hostfile
hostfile
 
 
run_infer.sh
run_infer.sh
 
 
run_train.sh
run_train.sh
 
 
tis_run.py
tis_run.py
 
 
train_ds.py
train_ds.py
 
 

Repository files navigation

gdGPT

About

Train llm (bloom and llama) with deepspeed pipeline mode. Faster than zero/zero++/fsdp.

Resources

Readme

License

Apache-2.0 license
Activity

Stars

0 stars

Watchers

0 watching

Forks

0 forks
Report repository

Releases

No releases published

Packages

 
 
 

Languages

  • Python 74.1%
  • C++ 13.0%
  • Cuda 12.7%
  • Other 0.2%