Skip to content

Issues: sgl-project/sglang

Development Roadmap
#157 opened Feb 7, 2024 by Ying1123
Open 14
Add SGLang usage examples
#166 opened Feb 8, 2024 by Ying1123
Open 6
Trouble Shooting
#548 opened Jun 14, 2024 by Ying1123
Open
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

164 Open 111 Closed
164 Open 111 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

peer access is not supported between these two devices
#552 opened Jun 16, 2024 by gmonair
1
Trouble Shooting
#548 opened Jun 14, 2024 by Ying1123
MoE model (BDRX/Mixtral) NaN when using flashinfer
#547 opened Jun 14, 2024 by Ying1123
@Ying1123
1
Llava CUDA error: device-side assert triggered
#543 opened Jun 13, 2024 by dmilcevski
3
M2 Mac Attempted Installation: LLVM ERROR: Option 'pbqp' already exists!
#537 opened Jun 12, 2024 by velocity33
[Bug]: Random model output using sglang backend server
#535 opened Jun 12, 2024 by PanJason
1
peft not found
#534 opened Jun 12, 2024 by charul15
AttributeError: module 'flashinfer' has no attribute 'batch_prefill_with_paged_kv_cache'
#533 opened Jun 11, 2024 by ZackZeng999
@ZackZeng999
ImportError: cannot import name 'pin_program'
#532 opened Jun 11, 2024 by ZackZeng999
@ZackZeng999
CUDA error: device-side assert triggered in self.forward_extend_multi_modal(batch)
#528 opened Jun 11, 2024 by LetheRiver0
1
SG-Lang Runtime Stuck Launching in Docker Container
#527 opened Jun 11, 2024 by schopra8
1
The choices normalised logprobs calculation returns poor results due to bias for longer-token options
#523 opened Jun 10, 2024 by AidanCooper
Mistral v0.3 Weight Loading
#519 opened Jun 9, 2024 by huyiwen
Support for Qwen2MoeForCausalLM? good first issue Good for newcomers
#513 opened Jun 7, 2024 by fedshyvana
1
Does llava-next-video deploy only focus on first frames?
#510 opened Jun 7, 2024 by LetheRiver0
1
Mac support? (vLLM)
#508 opened Jun 6, 2024 by shiftbug
1
Unable to load 72b llava qwen on 8*A100 40GB
#507 opened Jun 5, 2024 by jeffhernandez1995
2
Addition of Support of IDEFICS2
#506 opened Jun 5, 2024 by MohdSadiqRyff
guide for implementing multimodal models?
#501 opened Jun 4, 2024 by amosyou
Error when using the langchain wrapper to access the sglang openai server
#499 opened Jun 3, 2024 by brunorigal
llava-next-video inference result is empty
#498 opened Jun 3, 2024 by AmazDeng
4
Any plan to support cascading feature of flashinfer?
#495 opened Jun 3, 2024 by wellhowtosay
@Ying1123
3
[Notice] If someone can not run examples/usage/llava/srt_llava_next_test.py and meet the rpc error or connection reset by peer error.
#494 opened Jun 1, 2024 by Luodian
no longer can load 72b llava qwen on 4*H100 80GB
#485 opened May 27, 2024 by pseudotensor
2
lmms-lab/llava-next-72b CUDA out of memory
#483 opened May 27, 2024 by bingwork
2
ProTip! Find all open issues with in progress development work with linked:pr.