Skip to content

Issues: huggingface/tgi-gaudi

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort

Issues list

Issue running meta-llama/Llama-2-13b-chat-hf
#54 by muhammad-asn was closed Feb 19, 2024
2 of 4 tasks
adaptive batching
#192 by donzh was closed Oct 2, 2024 Loading…
upgrade to SynapseAI 1.18
#227 by yuanwu2017 was merged Oct 31, 2024 Loading…
5 tasks
Only Apply the TP in language_model
#219 by yuanwu2017 was merged Sep 6, 2024 Loading…
5 tasks
Integration of llama3.1 fixes
#197 by Feelas was closed Sep 25, 2024
Upgrade SynapseAI version to 1.17.0
#208 by yuanwu2017 was merged Aug 26, 2024 Loading…
5 tasks
Updated kv cache for starcoder
#128 by vidyasiv was merged Jun 14, 2024 Loading…
5 tasks
upgrade the tgi to V2.0.4
#187 by yuanwu2017 was merged Aug 12, 2024 Loading…
5 tasks
Rebase with TGI v2.0
#134 by kdamaszk was merged May 6, 2024 Loading…
Add missing cargo.lock file to Dockerfile
#168 by yafshar was closed Jul 19, 2024 Loading…
Pad token handling for Llama3.1
#199 by schoi-habana was merged Aug 12, 2024 Loading…
5 tasks
Add support for Llava-next
#193 by regisss was closed Aug 12, 2024 Draft
5 tasks
Clear previous hpu_graphs when graph shape changed to save memory
#176 by BaihuiJin was merged Jul 11, 2024 Loading…
5 tasks
HPUGraph destructor issue when installing dill
#130 by yafshar was closed Apr 26, 2024
4 tasks done
Remove the torch package in requirements.txt
#246 by yuanwu2017 was merged Nov 7, 2024 Loading…
5 tasks
Unsupported model type llava_next
#186 by Spycsh was closed Aug 26, 2024
2 of 4 tasks
Revert "Dev/mask ldconfig output v2 (#1716)"
#144 by kdamaszk was merged May 21, 2024 Loading…
5 tasks
V1.2.2 release
#129 by yafshar was closed May 1, 2024 Loading…
5 tasks
llava-next Fp8
#209 by yuanwu2017 was merged Aug 26, 2024 Loading…
5 tasks
updating Dockerfile with new version of habana software
#175 by ddmatthe was closed Aug 12, 2024 Loading…
1 of 4 tasks
Simplify the warmup process
#173 by yuanwu2017 was merged Aug 15, 2024 Loading…
5 tasks
Integrate critical PR from TGI uptream
#155 by luoyiroy was closed Jun 20, 2024
ProTip! Follow long discussions with comments:>50.