-
Notifications
You must be signed in to change notification settings - Fork 63
Issues: open-compass/VLMEvalKit
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
ModuleNotFoundError: No module named 'xtuner.parallel'
#139
by starlitsky2010
was closed Apr 11, 2024
Pos_tokens.reshape error while testing mmmu on internlm-xcomposer2-7b
#136
by littleSunlxy
was closed Apr 2, 2024
[Feature Request] To evaluate MMMU test set, you need to transfer the xlsx output to a json file
#124
by StarCycle
was closed Apr 9, 2024
The scores calculated by VLMEvalKit differ from the score calculated on the MMBench website
#121
by jdy18
was closed Mar 20, 2024
The code for evaluating open question of MMMU is completely wrong
#110
by xwwu2015
was closed Jun 17, 2024
OPENAI_API_KEY is not set properly, will use exact matching for evaluation
#109
by StarCycle
was closed Mar 15, 2024
(feature request) can we add load_dotenv() as a small quality of life improvement?
#107
by kdu4108
was closed Mar 20, 2024
If i want to use model of LLaVa in VLMEval, which version should i installed for these?
#100
by EmberYS
was closed Mar 7, 2024
Enhancing Multi-Choice Question Handling with Case-Sensitive Matching
#99
by jdy18
was closed Mar 12, 2024
ProTip!
Type g i on any issue or pull request to go back to the issue listing page.