-
Notifications
You must be signed in to change notification settings - Fork 4.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
bert-base-chinese Incompatible shapes error #8381
Comments
same error |
Why the error is not clear. - name: LanguageModelFeaturizer
# Name of the language model to use
model_name: "bert"
# Pre-Trained weights to be loaded
model_weights: "bert-base-chinese"
# An optional path to a specific directory to download and cache the pre-trained model weights.
# The `default` cache_dir is the same as https://huggingface.co/transformers/serialization.html#cache-directory .
cache_dir: data/bert-base-chinese |
Thanks for raising this issue, @dakshvar22 will get back to you about it soon✨ Please also check out the docs and the forum in case your issue was raised there too 🤗 |
@Dustyposa As I know,I should put JiebaTokenizer before LanguageModelFeaturizer to run rasa.But I don't think this caused the error,Maybe I was wrong?The use of HFTransformersNLP doesn't matter the error. |
It's looks like |
It seems the Tokenizer, do not use jieba when use bert |
@muximuxi Thank you,you are right.I use rasa_chinese and rasa_chinese_service.The problem has been solved. @Dustyposa Thank you for your help as well. |
@Wind-Ward @muximuxi using rasa_chinese and rasa_chinese_service just solving the intent-training , when i put entity nlu data, this error occur 。
|
same error,and i delete all my cache models,it run |
Rasa version:
2.4.3
Rasa SDK version (if used & relevant):
2.4.1
Rasa X version (if used & relevant):
0.37.1
Python version:
3.6.12
Operating system (windows, osx, ...):
Linux-3.10.0-1127.19.1.el7.x86_64-x86_64-with-centos-7.7.1908-Core
Issue:
Hi,I'm try to use "bert-base-chinese" component to train my data,but I ran into problems.
I have upgraded transformers already,but the problem still exists.Could you help me?Thanks a lot.
Error (including full traceback):
Command or request that led to error:
Content of configuration file (config.yml) (if relevant):
The text was updated successfully, but these errors were encountered: