You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
As part of the Qwen2 series, Qwen2-57B-A14B is released, which delivers competitive performance against 32B dense models, and would be really valuable addition to community! It however, requires the Qwen2MoeForCausalLM architecture which is currently not implemented in SGL. Is there any plan to support this? Thanks!
As part of the Qwen2 series, Qwen2-57B-A14B is released, which delivers competitive performance against 32B dense models, and would be really valuable addition to community! It however, requires the Qwen2MoeForCausalLM architecture which is currently not implemented in SGL. Is there any plan to support this? Thanks!
https://qwenlm.github.io/blog/qwen2/
The text was updated successfully, but these errors were encountered: