New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix depreciated code #32

Closed

StellaAthena opened this issue Jan 4, 2021 · 1 comment · Fixed by #42

Labels

Member

StellaAthena commented Jan 4, 2021

When you run GPT-3 Small, you get a depreciated code warning because of how we handle iterators.

StellaAthena added the bug label

Contributor

sdtblck commented Jan 4, 2021

to be more specific, it's tf.io.tfrecord_iterator here https://github.com/EleutherAI/gpt-neox/blob/main/gpt_neox/datasets.py#L83

I think we should just be able to use https://www.tensorflow.org/api_docs/python/tf/data/TFRecordDataset

sdtblck linked a pull request

that will close this issue

Fix deprecation warning #42

Merged

lucidrains closed this as completed in #42

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment