Skip to content

Tags: wanpdsantos/gpt-neox

Tags

v2.0

Toggle v2.0's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
Simplify and relax dependencies (Take 2) (EleutherAI#818)

* Remove unused einops dependency

* Make Weights & Biases monitoring optional

- Move `wandb` to `./requirements/requirements-wandb.txt`
- Clean up `./deepy.py`
- Make GPT-NeoX not explode if `wandb` is not installed.
- Tell the user when `wandb` is not importable and explain how to fix.
- Remove implicit dependence on `shortuuid`.
- Ensure that `wandb` is installed in Dockerfile.

* Relax many dependencies

* Remove usage of uuid.uuid4()

* Update Dockerfile

Add flash attention install

* Update logging.py to pass when wandb is unimportable

---------

Co-authored-by: Quentin Anthony <[email protected]>

v1.0

Toggle v1.0's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
Merge pull request EleutherAI#813 from EleutherAI/fix-tok-import

fix unexpected indent error for conditional `tiktoken` import

legacy_gptj_residual.1.0.0

Toggle legacy_gptj_residual.1.0.0's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
Merge pull request EleutherAI#492 from EleutherAI/dependabot/pip/requ…

…irements/numpy-1.21.0

Bump numpy from 1.20.2 to 1.21.0 in /requirements