The md5 hashtest of the dataset DocVQA_VAL hasn't passed.

[EmberYS]

I checked the Completeness of DocVQA_VAL after downloading it from here. Not sure which one is correct, please take a correct.

[kennymckormick]

Hi, @EmberYS ,
That's due to you are not using the latest code, please fetch the latest main branch and retry.

[EmberYS]

Hi, @kennymckormick
Although PR#104 fixed md5 of DocVQA_VAL, the column of “answers” in DocVQA_VAL doesn't fit code here.

This problem of mismatch between them leads to:

This seems to require modifying the code for DocVQA_VAL ( I tested replacing "answer" with "answers". Passed !) or dataset of DocVQA_VAL. Also pleased to open a pull request if helpful.

[SparksJoe]

HI, @EmberYS
The bug in DocVQA has been resolved, please refer to #111 to modify the dataset_md5_dict and then reload DocVQA dataset.

[kennymckormick]

Hi, @EmberYS ,
As verified by myself, the problem of DocVQA has been fixed now. I tried to evaluate InternLM-XComposer2 on DocVQA_VAL, and obtained a 58.6 score.