score function failed with the new transformers v4.0.0

[kirzharov]

What I did:
Try to get scores with score function

Actual result:
Get the error: 'RobertaTokenizerFast' object has no attribute 'max_len'

Expected result:
score function work as before and get results

More details:

• bert_score version: 0.3.6
• transformers version: 4.0.0
• Python version: 3.8

Context:

• Release notes for the new transformers version: https://github.com/huggingface/transformers/releases/tag/v4.0.0
• PR with removing max_len attribute from transformers package: Remove deprecated huggingface/transformers#8604

Previous warning:
The max_len attribute has been deprecated and will be removed in a future version, use model_max_length instead.

[kirzharov]

Hi guys! I added PR with a hotfix for this issue: #86, and when I created a PR, I saw a similar one: #84 😀

[kirzharov]

For those who will need to use the bert_score version before this fix (for example: 0.3.6, 0.3.5, .etc):

Just add transformers==3.5.1 to your requirements.txt file or install before installing previous bert_score version with pip install transformers==3.5.1 or just update with pip install -U transformers==3.5.1 (if you have installed transformers or bert_score before)

Link to the comment from similar issue in transformers repo: huggingface/transformers#8739 (comment)

[davebulaval]

Hi guys! I added PR with a hotfix for this issue: #86, and when I created a PR, I saw a similar one: #84

tks for the help on the fix.

[felixgwu]

This is resolved. Please use the code in our master branch for now. We will update the pypi package soon.