Skip to content

Issues: OpenGVLab/OmniQuant

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

27 Open 48 Closed
27 Open 48 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cpu and cuda:0! (when checking argument for argument mat2 in method wrapper_CUDA_bmm)
#89 opened Aug 5, 2024 by mcpaulgeorge
2
The version of transformers, auto_gptq, autoawq
#88 opened Aug 5, 2024 by zhangfzR
Quantify tinyllama-1.1B-Chat-v1.0, a CUDA assertion error occurred
#87 opened Jul 12, 2024 by causeof-you
[New Feature] Seek MLA Supported by Smooth
#86 opened Jul 10, 2024 by RanchiZhao
question about let
#85 opened Jul 8, 2024 by mxjmtxrm
[Model Request] MiniCPM
#84 opened Jul 2, 2024 by RanchiZhao
The llama-1-65b model seems unstable in this code
#83 opened Jun 24, 2024 by Xingrun-Xing
2
Questions about quantization
#81 opened Jun 10, 2024 by mxjmtxrm
How to accelerate the inference speed with real_quant
#80 opened Jun 5, 2024 by j2kim99
3
Which bug do you fix for auto_gptq
#79 opened Jun 2, 2024 by BaohaoLiao
1
Questions regarding Infusing Omniquant into MLC
#77 opened Apr 29, 2024 by BuildBackBuehler
3
OPT-30B
#76 opened Apr 26, 2024 by Arthur-Ling
Llama-3-8B
#75 opened Apr 22, 2024 by hsb1995
5
Why is the compressed file one file instead of the pre trained weights, where there are many files for training the mode
#73 opened Apr 15, 2024 by hsb1995
1
TypeError: FalconRotaryEmbedding.forward() missing 1 required positional argument: position_ids
#72 opened Apr 11, 2024 by luchangli03
AttributeError: 'FalconAttention' object has no attribute 'maybe_rotary'
#71 opened Apr 11, 2024 by luchangli03
1
Other Task
#67 opened Mar 20, 2024 by hsb1995
1
reproduce evaluation results
#60 opened Feb 5, 2024 by oujieww
9
How to properly evaluate W6A6 models using checkpoint from the mode zoo
#59 opened Jan 26, 2024 by ChengZhang-98
2
AutoGPTQ or AutoGPTQ-bugfix?
#57 opened Jan 22, 2024 by Alvant
7
The ckpt of Quantized OPT model is not be found
#53 opened Jan 12, 2024 by liuxy1103
6
AttributeError: 'Attention' object has no attribute 'W_pack'
#39 opened Dec 7, 2023 by yrf200112
Quantize LLAMA-2-7b-chat to W4A4
#37 opened Nov 28, 2023 by nmyuchen
4
RuntimeError when quantize bloom using our code
#29 opened Nov 3, 2023 by Louym
Cannot compile with mlc-llm
#21 opened Oct 10, 2023 by 0x1997
2
ProTip! Type g i on any issue or pull request to go back to the issue listing page.