NameError: name 'RepeatingLoader' is not defined

[Carolingliang]

[StellaAthena]

Hi! Can you give us some more details about your hardware set-up, what code you ran, what settings you used, etc.?

[Carolingliang]

hardware set-up: cpu is eighty cores, memory is 1t, gpu is 3090 with eight 24G
code: deepspeed train_pipeline.py --deepspeed_config=configs/gpt3_small.json

[StellaAthena]

Try deepspeed train_pipeline.py --deepspeed -–deepspeed_config=configs/checkpoints_config.json

[Carolingliang]

It still has this bug.
Maybe the path of "RepeatingLoader" was not found.
But I didn't find the function"RepeatingLoader" in this project.

[StellaAthena]

deepspeed.utils.RepeatingLoader is a wrapper around an itterable that you can use to define data-loaders in DeepSpeed. You can see where we use it here. I don't see how it could error for you and not for others, but try replacing that line with deepspeed.utils.RepeatingLoader to explicitly import it.

[Carolingliang]

ok ,thanks