-
Notifications
You must be signed in to change notification settings - Fork 63
Issues: open-compass/VLMEvalKit
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
How to calculate avg score after the leaderboard update to 8 multimodal benchmarks
#206
by wanxinzzz
was closed May 21, 2024
About MMBench data source: Is there any difference from huggingface
lmms-lab/MMBench
?
#192
by Coobiw
was closed May 6, 2024
Error ‘assert len(chunk_encode) == 2’ when eval MMMU_DEV_VAL
#173
by wutaiqiang
was closed Apr 25, 2024
There are some known issues with VQA tasks like OCRVQA, TextVQA, ChartQA, etc. We will fix them asap.
#168
by BlueBlueFF
was closed Apr 27, 2024
ModuleNotFoundError: No module named 'llava.model.builder'
#166
by TousenKaname
was closed Apr 23, 2024
IndexError: index 1 is out of bounds for dimension 0 with size 1
#150
by lucasjinreal
was closed Apr 21, 2024
Error Encountered in Multi-Node Evaluation Using Distributed Arguments
#142
by jdy18
was closed Apr 21, 2024
Previous Next
ProTip!
Add no:assignee to see everything that’s not assigned.