-
Notifications
You must be signed in to change notification settings - Fork 78
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Tomesd is not reducing the total memory consumption. #51
Comments
Yes I experience this too |
I believe someone looked into this before and found that diffusers was already using memory efficient attention, which saves most of the memory that ToMe would have saved anyway. The numbers in the paper are for the original implementation of stable diffusion. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
When i use Diffusors without tomesd the total memory usage in nvidia-smi is 3966MiB.
But when i use it with tomesd ( using the example in the readme ) , the usage on nvidia-smi is still the same.
Any idea whats happening?
The text was updated successfully, but these errors were encountered: