New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

llava 34B 评测时CUDA out of memory #156

Closed

jiezhangGt opened this issue Apr 17, 2024 · 2 comments

jiezhangGt commented Apr 17, 2024

你好，我在评测llava 34B 时，有8张卡可用，发现只占了一张卡进行推理，导致CUDA out of memory。请问llava 34B的评测支持多卡评测吗？谢谢

jiezhangGt closed this as completed

Author

jiezhangGt commented Apr 17, 2024

已解决

JesseZZZZZ commented Apr 25, 2024

请问您是怎么解决的呢？我遇到了相同的问题

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment