Skip to content

Commit

Permalink
Revert "Launch world_size processs even when more GPUs are available"
Browse files Browse the repository at this point in the history
This reverts commit b0b17b5.
  • Loading branch information
johnowhitaker committed Mar 13, 2024
1 parent 9ae0b00 commit 7acc892
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion train.py
Original file line number Diff line number Diff line change
Expand Up @@ -1009,5 +1009,5 @@ def main(
# Run
mp.spawn(fsdp_main,
args=(world_size, args),
nprocs=world_size,
nprocs=torch.cuda.device_count(),
join=True)

0 comments on commit 7acc892

Please sign in to comment.