- Multi gpus: DDP(DistributedDataParallel)
- Half precision: Apex
- Corresponding single gpu version (for comparision)
- Install nvidia-apex and move it to current directory.
- torch >= 1.9.1
- multi gpus
bash train_ddp.sh GPU_ID GPU_NUM
- single gpu
bash train_single.sh GPU_ID