Skip to content

Issues: open-compass/VLMEvalKit

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort

Issues list

Multi-GPU inference issue
#224 by ruifengma was closed Jun 19, 2024 updated Oct 8, 2024
error when eval MiniCPM_Llama3_V2.5 on MMMU_TEST
#250 by ruifengma was closed Aug 28, 2024 updated Sep 11, 2024
Math_Vista result is not summarized
#253 by ruifengma was closed Jul 8, 2024 updated Jul 8, 2024
SEEDBench2 and SEEDBench2_Plus give the same result
#247 by ruifengma was closed Jul 1, 2024 updated Jul 1, 2024
Judge model seems not working
#236 by ruifengma was closed Jun 26, 2024 updated Jun 26, 2024
ProTip! Exclude everything labeled bug with -label:bug.