Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ggml_bert_new_tensor_impl: not enough space in the context's memory pool #327

Closed
luoweb opened this issue Jul 2, 2023 · 1 comment
Closed

Comments

@luoweb
Copy link

luoweb commented Jul 2, 2023

model url:https://huggingface.co/skeskinen/ggml/resolve/main/all-MiniLM-L6-v2/ggml-model-q4_0.bin

ggml_bert_new_tensor_impl: not enough space in the context's memory pool

4:01PM DBG Loading model bert-embeddings from bert-MiniLM-L6-v2q4_0
4:01PM DBG Loading model in memory from file: /Users/block/code/data/models/bert-MiniLM-L6-v2q4_0
bert_load_from_file: loading model from '/Users/block/code/data/models/bert-MiniLM-L6-v2q4_0' - please wait ...
bert_load_from_file: n_vocab = 30522
bert_load_from_file: n_max_tokens   = 512
bert_load_from_file: n_embd  = 384
bert_load_from_file: n_intermediate  = 1536
bert_load_from_file: n_head  = 12
bert_load_from_file: n_layer = 6
bert_load_from_file: f16     = 2
bert_load_from_file: ggml ctx size =  13.57 MB
bert_load_from_file: ............ done
bert_load_from_file: model size =    13.55 MB / num tensors = 101
bert_load_from_file: mem_per_token 452 KB, mem_per_input 248 MB
loaded
4:01PM DBG Loading model bert-embeddings from bert-MiniLM-L6-v2q4_0
4:01PM DBG Model already loaded in memory: bert-MiniLM-L6-v2q4_0
4:01PM DBG Loading model bert-embeddings from bert-MiniLM-L6-v2q4_0
4:01PM DBG Model already loaded in memory: bert-MiniLM-L6-v2q4_0
4:01PM DBG Loading model bert-embeddings from bert-MiniLM-L6-v2q4_0
4:01PM DBG Model already loaded in memory: bert-MiniLM-L6-v2q4_0
ggml_bert_new_tensor_impl: not enough space in the context's memory pool (needed 271388624, available 260703040)
fatal error: unexpected signal during runtime execution
[signal SIGSEGV: segmentation violation code=0x2 addr=0x48 pc=0x1049aadb4]
@luoweb
Copy link
Author

luoweb commented Jul 2, 2023

restart the computer, the issue solved, please turn off the issue

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants