New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement distributed training using Kubernetes #77

Merged

StellaAthena merged 17 commits into main from k8s

Jan 23, 2021

Fix imports

Loading branch information

leogao2 committed Jan 23, 2021

commit 05f4dcf9a445d992c7ac64a9d5daeefaaf27700c

gpt_neox/gpt_neox.py

-Original file line number
+Diff line change
@@ -1,4 +1,5 @@
 import torch
+import torch.utils.checkpoint
 import torch.nn.functional as F
 from torch import nn, einsum
 from functools import partial
@@ Expand Down @@