New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

NCCL backend in DeepSpeed not yet implemented #990

Closed

jiezhangGt opened this issue Jul 5, 2023 · 1 comment

Labels

jiezhangGt commented Jul 5, 2023

Warning in training log：

[WARNING] [comm.py:152:init_deepspeed_backend] NCCL backend in DeepSpeed not yet implemented
[INFO] [comm.py:594:init_distributed] cdb=None

is this normal?

jiezhangGt added the bug label

Member

Quentin-Anthony commented Jul 5, 2023

Yes. It's a generic warning in DeepSpeed that my pure NCCL comms backend (i.e. without going through torch distributed) hasn't been merged in yet.

Safe to ignore.

Quentin-Anthony closed this as completed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment