-
Notifications
You must be signed in to change notification settings - Fork 72
Issues: open-compass/VLMEvalKit
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
Question about LlavaBench Evaluation
#194
by justinphan3110
was closed May 9, 2024
updated May 9, 2024
How to calculate avg score after the leaderboard update to 8 multimodal benchmarks
#206
by wanxinzzz
was closed May 21, 2024
updated May 21, 2024
mmmu should only use mmmu val not MMMU_DEV_VAL
#198
by max-yue
was closed May 24, 2024
updated May 24, 2024
Questions regarding the metrics for SEED bench
#20
by zjysteven
was closed Dec 23, 2023
updated Jun 14, 2024
The code for evaluating open question of MMMU is completely wrong
#110
by xwwu2015
was closed Jun 17, 2024
updated Jun 17, 2024
about vlmeval/evaluate/multiple_choice.py
#227
by mary-0830
was closed Jun 20, 2024
updated Jun 20, 2024
about vlmeval/evaluate/multiple_choice.py
#228
by mary-0830
was closed Jun 20, 2024
updated Jun 20, 2024
MMBench_EN_V11 404 not found after evaluation
#239
by MonolithFoundation
was closed Jun 26, 2024
updated Jun 26, 2024
SEEDBench2 and SEEDBench2_Plus give the same result
#247
by ruifengma
was closed Jul 1, 2024
updated Jul 1, 2024
Previous Next
ProTip!
no:milestone will show everything without a milestone.