Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

能否改为GPU辅助计算 #65

Open
bzy-080408 opened this issue Aug 23, 2023 · 6 comments
Open

能否改为GPU辅助计算 #65

bzy-080408 opened this issue Aug 23, 2023 · 6 comments

Comments

@bzy-080408
Copy link

`bzy@server:~/InferLLM/build$ make
-- current platform: x86
-- Build with GPU.
-- Configuring done
-- Generating done
-- Build files have been written to: /home/bzy/InferLLM/build
[ 2%] Building NVCC (Device) object CMakeFiles/InferLLMGPU.dir/src/kern/gpu/InferLLMGPU_generated_kernel_gpu.cu.o
/usr/lib/gcc/x86_64-linux-gnu/11/include/serializeintrin.h(41): error: identifier "__builtin_ia32_serialize" is undefined

/home/bzy/InferLLM/src/kern/naive/quantize.h(45): warning #177-D: variable "bs" was declared but never referenced

1 error detected in the compilation of "/home/bzy/InferLLM/src/kern/gpu/kernel_gpu.cu".
CMake Error at InferLLMGPU_generated_kernel_gpu.cu.o.cmake:280 (message):
Error generating file
/home/bzy/InferLLM/build/CMakeFiles/InferLLMGPU.dir/src/kern/gpu/./InferLLMGPU_generated_kernel_gpu.cu.o

make[2]: *** [CMakeFiles/InferLLMGPU.dir/build.make:522:
CMakeFiles/InferLLMGPU.dir/src/kern/gpu/InferLLMGPU_generated_kernel_gpu.cu.o] 错误 1
make[1]: *** [CMakeFiles/Makefile2:94:CMakeFiles/InferLLMGPU.dir/all] 错误 2
make: *** [Makefile:91:all] 错误 2
`

@bzy-080408
Copy link
Author

system:ubuntu 22.04LTS
cuda,gcc等全为软件源中安装

@bzy-080408
Copy link
Author

bzy-080408 commented Aug 23, 2023

现在编译成功了,但是src/core/device.h的113行我电脑需改为0,不然报invalid device,不知道其他电脑是什么样

@bzy-080408
Copy link
Author

但是目前能否改为GPU辅助计算,2G的显存似乎不够用

@bzy-080408
Copy link
Author

image

@bzy-080408 bzy-080408 changed the title 启用GPU后编译失败 能否改为GPU辅助计算 Aug 23, 2023
@chenqy4933
Copy link
Collaborator

I changed the default device GPU id to 0, the new feature of GPU-assisted computing is not supported yet,

@bzy-080408
Copy link
Author

话说amd显卡有计划支持吗?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants