You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The text was updated successfully, but these errors were encountered:
WilliamTambellini
changed the title
Add option to use cudaMallocManaged or cudaMalloc
Add option to use either cudaMalloc or cudaMallocManaged
Jan 23, 2024
Hi @ggerganov
Would you mind if I add an option to possibly use
cudaMallocManaged() instead of cudaMalloc() in
https://github.com/ggerganov/ggml/blob/master/src/ggml-cuda.cu
default being of course cudaMalloc()
?
Best
W.
refs:
https://developer.nvidia.com/blog/unified-memory-cuda-beginners/
https://docs.nvidia.com/cuda/cuda-runtime-api/group__CUDART__MEMORY.html#group__CUDART__MEMORY_1gd228014f19cc0975ebe3e0dd2af6dd1b
The text was updated successfully, but these errors were encountered: