-
Notifications
You must be signed in to change notification settings - Fork 65
Issues: open-compass/VLMEvalKit
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
If i want to use model of LLaVa in VLMEval, which version should i installed for these?
#100
by EmberYS
was closed Mar 7, 2024
(feature request) can we add load_dotenv() as a small quality of life improvement?
#107
by kdu4108
was closed Mar 20, 2024
OPENAI_API_KEY is not set properly, will use exact matching for evaluation
#109
by StarCycle
was closed Mar 15, 2024
The code for evaluating open question of MMMU is completely wrong
#110
by xwwu2015
was closed Jun 17, 2024
The scores calculated by VLMEvalKit differ from the score calculated on the MMBench website
#121
by jdy18
was closed Mar 20, 2024
[Feature Request] To evaluate MMMU test set, you need to transfer the xlsx output to a json file
#124
by StarCycle
was closed Apr 9, 2024
Previous Next
ProTip!
Exclude everything labeled
bug
with -label:bug.