Skip to content

Latest commit

 

History

History
2 lines (2 loc) · 196 Bytes

README.md

File metadata and controls

2 lines (2 loc) · 196 Bytes
Raw

gpt-neo-x

An implementation of model parallel GPT-3-like models on GPUs, based on the DeepSpeed library. Designed to be able to train models in the hundreds of billions of parameters or larger.