forked from huggingface/text-generation-inference
-
Notifications
You must be signed in to change notification settings - Fork 35
Issues: huggingface/tgi-gaudi
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
example/run_generation.py fails with unexpected argument for TextGenerationStreamingResponse
#189
opened Jul 17, 2024 by
gpapilion
4 tasks done
Driver compatibility check and document fixes
#182
opened Jul 8, 2024 by
vidyasiv
Loading…
1 of 5 tasks
updating Dockerfile with new version of habana software
#175
opened Jul 3, 2024 by
ddmatthe
Loading…
1 of 4 tasks
low throughput while using TGI-Gaudi on bigcode/starcoderbase-3b on Gaudi2
#166
opened Jun 22, 2024 by
vishnumadhu365
3 of 4 tasks
Best Performance for a single card for Llama-2-7b-chat-hf
#196
opened Jul 29, 2024 by
AdityaKulshrestha
setting token flags still results in console warning
#195
opened Jul 28, 2024 by
endomorphosis
2 of 4 tasks
code expects newer huggingface_hub versions, tested and this resolves…
#190
opened Jul 17, 2024 by
gpapilion
Loading…
2 of 5 tasks
ProTip!
Type g p on any issue or pull request to go back to the pull request listing page.