Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AutoRound/Examples dependency is injected to AutoRound pkg dependency #177

Closed
Qubitium opened this issue Jul 7, 2024 · 4 comments
Closed

Comments

@Qubitium
Copy link

Qubitium commented Jul 7, 2024

GPTQModel has merged AutorRound integration via PR ModelCloud/GPTQModel#166 but we find the the CI tests is importing auto-gptq (via auto-round depends) as dependency which is strange to us since the only auto-gptq code in AutoRound is in examples.

Can examples/require*txt not be merge into auto-round pkg depends proper?

@wenhuach21
Copy link
Contributor

GPTQModel has merged AutorRound integration via PR ModelCloud/GPTQModel#166 but we find the the CI tests is importing auto-gptq (via auto-round depends) as dependency which is strange to us since the only auto-gptq code in AutoRound is in examples.

Can examples/require*txt not be merge into auto-round pkg depends proper?

Thank you for integrating Autoround. We should have not merge the example/requirement.txt in the main branch.

During the model packing, we need to import some packing functions from autogptq.

BTW, our API has changed a little to support the new features

@Qubitium
Copy link
Author

@wenhuach21 We are closely following pending v0.3 autoround release in ModelCloud/GPTQModel#179 as there are lots of feature and internal api change. Is there an estimated release date for autoround v0.3?

@wenhuach21
Copy link
Contributor

@wenhuach21 We are closely following pending v0.3 autoround release in ModelCloud/GPTQModel#179 as there are lots of feature and internal api change. Is there an estimated release date for autoround v0.3?

about 2 weeks

@wenhuach21
Copy link
Contributor

sorry for the late. V0.3 has been released

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants