Skip to content

Issues: sgl-project/sglang

Development Roadmap
#157 opened Feb 7, 2024 by Ying1123
Open 14
Add SGLang usage examples
#166 opened Feb 8, 2024 by Ying1123
Open 7
Trouble Shooting
#548 opened Jun 14, 2024 by Ying1123
Open
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
160 Open 126 Closed
160 Open 126 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Metal support?
#23 opened Jan 17, 2024 by mitkox
2 👀 4
Please add Phi3 support
#407 opened May 1, 2024 by Curiosity007
2 👀 3
Using mlx as backend
#188 opened Feb 14, 2024 by sandangel
1 👀 2
Trouble Shooting
#548 opened Jun 14, 2024 by Ying1123
👀 1
JSON decoding result don't match regex
#371 opened Apr 17, 2024 by DouHappy
👀 1
will support multi-loras inference？
#334 opened Mar 28, 2024 by skykiseki
👀 1
How to use 4bit on LLava?
#123 opened Jan 31, 2024 by klanonlyman
👀 1
ImportError: cannot import name 'get_cuda_stream' from 'triton.runtime.jit' In triton-nightly(V100)
#383 opened Apr 23, 2024 by nenomigami
👀 1
The choices normalised logprobs calculation returns poor results due to bias for longer-token options
#523 opened Jun 10, 2024 by AidanCooper
4 👀 1
Have some advise to learn Openai's triton?
#208 opened Feb 20, 2024 by Arcmoon-Hu
2 👀 1
After enabling tensor parallelism (tp-size=2), there is no response
#150 opened Feb 6, 2024 by wushixong
3 👀 1
RecursionError: maximum recursion depth exceeded while calling a Python object when inferencing with long input
#154 opened Feb 6, 2024 by Ja1Zhou
6 👀 1
Llama-3 regex generation can get stuck in infinite generation beyond max_tokens and crash server (reproduction example)
#414 opened May 8, 2024 by Gintasz
3 👀 1
LLaVA model parallelism/fork bug
#260 opened Mar 4, 2024 by lockon-n
👀 1
offset = input_ids.index(self.config.image_token_index)
#161 opened Feb 7, 2024 by JAADARI
2
Development Roadmap
#157 opened Feb 7, 2024 by Ying1123
14
Max Length. good first issue Good for newcomers
#27 opened Jan 17, 2024 by srush
2
unable to install uvloop in windows (dependency)
#152 opened Feb 6, 2024 by Sai-s19
2
Triton support
#35 opened Jan 18, 2024 by TheodoreGalanos
4
Can SGL generate list of json?
#53 opened Jan 19, 2024 by CSWellesSun
6
/generate stuck and no response when serving the Mixtral AWQ
#139 opened Feb 4, 2024 by gamersover
1
OOM Error on A40 GPU [Jupyter notebook]
#86 opened Jan 23, 2024 by aflah02
5
model_override_args with server good first issue Good for newcomers
#591 opened Jul 5, 2024 by ValeKnappich
1
kv cache pool leak detected when benchmark llama13B-awq using A40
#105 opened Jan 26, 2024 by lusirisyoud
4
Fail to load TheBloke/tulu-2-dpo-70B-AWQ on A800*2: TimeoutError: result expired
#99 opened Jan 25, 2024 by Penglikai
2
ProTip! Adding no:label will show everything without a label.