Question about ib_write_lat with CUDA

[yzygitzh]

I've found that ib_write_lat doesn't support CUDA mode.
Wonder whether there is any intrinsic issue that prevents supporting this?
I think it should not be CUDA issue because NCCL library is using IB write with GPU.
If there isn't a big obstacle, I can help draft a PR to fix this.

[elevenxiang]

I've found that ib_write_lat doesn't support CUDA mode. Wonder whether there is any intrinsic issue that prevents supporting this? I think it should not be CUDA issue because NCCL library is using IB write with GPU. If there isn't a big obstacle, I can help draft a PR to fix this.

Can you share your PR link ?
I remove the error exit, and try to run on A100, it will be crash
and gdb showed that not host memory, so it could be CUDA memory issue

Thanks

[yzygitzh]

Hi, sorry for misleading. I meant I don’t know the key issue to support write latency for CUDA either.