Skip to content

Tags: EleutherAI/gpt-neox

Tags

v2.0

Toggle v2.0's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
Simplify and relax dependencies (Take 2) (#818)

* Remove unused einops dependency

* Make Weights & Biases monitoring optional

- Move `wandb` to `./requirements/requirements-wandb.txt`
- Clean up `./deepy.py`
- Make GPT-NeoX not explode if `wandb` is not installed.
- Tell the user when `wandb` is not importable and explain how to fix.
- Remove implicit dependence on `shortuuid`.
- Ensure that `wandb` is installed in Dockerfile.

* Relax many dependencies

* Remove usage of uuid.uuid4()

* Update Dockerfile

Add flash attention install

* Update logging.py to pass when wandb is unimportable

---------

Co-authored-by: Quentin Anthony <[email protected]>

v1.0

Toggle v1.0's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
Merge pull request #813 from EleutherAI/fix-tok-import

fix unexpected indent error for conditional `tiktoken` import

legacy_gptj_residual.1.0.0

Toggle legacy_gptj_residual.1.0.0's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
Merge pull request #492 from EleutherAI/dependabot/pip/requirements/n…

…umpy-1.21.0

Bump numpy from 1.20.2 to 1.21.0 in /requirements