-
Notifications
You must be signed in to change notification settings - Fork 87
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
能否改为GPU辅助计算 #65
Comments
system:ubuntu 22.04LTS |
现在编译成功了,但是src/core/device.h的113行我电脑需改为0,不然报invalid device,不知道其他电脑是什么样 |
但是目前能否改为GPU辅助计算,2G的显存似乎不够用 |
I changed the default device GPU id to 0, the new feature of GPU-assisted computing is not supported yet, |
话说amd显卡有计划支持吗? |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
`bzy@server:~/InferLLM/build$ make
-- current platform: x86
-- Build with GPU.
-- Configuring done
-- Generating done
-- Build files have been written to: /home/bzy/InferLLM/build
[ 2%] Building NVCC (Device) object CMakeFiles/InferLLMGPU.dir/src/kern/gpu/InferLLMGPU_generated_kernel_gpu.cu.o
/usr/lib/gcc/x86_64-linux-gnu/11/include/serializeintrin.h(41): error: identifier "__builtin_ia32_serialize" is undefined
/home/bzy/InferLLM/src/kern/naive/quantize.h(45): warning #177-D: variable "bs" was declared but never referenced
1 error detected in the compilation of "/home/bzy/InferLLM/src/kern/gpu/kernel_gpu.cu".
CMake Error at InferLLMGPU_generated_kernel_gpu.cu.o.cmake:280 (message):
Error generating file
/home/bzy/InferLLM/build/CMakeFiles/InferLLMGPU.dir/src/kern/gpu/./InferLLMGPU_generated_kernel_gpu.cu.o
make[2]: *** [CMakeFiles/InferLLMGPU.dir/build.make:522:
CMakeFiles/InferLLMGPU.dir/src/kern/gpu/InferLLMGPU_generated_kernel_gpu.cu.o] 错误 1
make[1]: *** [CMakeFiles/Makefile2:94:CMakeFiles/InferLLMGPU.dir/all] 错误 2
make: *** [Makefile:91:all] 错误 2
`
The text was updated successfully, but these errors were encountered: