Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

我对你们的2080ti pipeline很感兴趣 #143

Open
wesleysanjose opened this issue May 3, 2023 · 2 comments
Open

我对你们的2080ti pipeline很感兴趣 #143

wesleysanjose opened this issue May 3, 2023 · 2 comments

Comments

@wesleysanjose
Copy link
Contributor

感觉这个是个低成本的setup，对于train llama 7b，一定要2080ti吗？因为11G mem，还是8块8G mem的显卡也可以。能公开你们整个机器的配置吗
@bigeagle
Copy link
Member

bigeagle commented May 3, 2023

如果只是Fine-tune的话, llama 7b 用 3050 之类的也够了

@PeiqinSun
Copy link
Member

是可以的. 你们只要显存能放得下就没有问题. 由于推荐大家使用2080ti的原因是因为我们目前的kernel只写了关于compute capability=75(即2080系列)的实现。如果你们想使用更多系列的kernel也可以向我们提开发需求, 我们会尽快支持的.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@bigeagle @wesleysanjose @PeiqinSun