-
Notifications
You must be signed in to change notification settings - Fork 65
Issues: open-compass/VLMEvalKit
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
Does vlmeval support multi card inference and batch size > 1?
Feature Request
#32
opened Dec 28, 2023 by
John-Ge
updated Jan 27, 2024
There is a long gap between the validation accuracy of the dataset of vlmevalkit and the model paper
#94
opened Feb 23, 2024 by
YongLD
updated Mar 13, 2024
Evaluation of custom models and datasets.
#108
opened Mar 9, 2024 by
juxingyiwan
updated Mar 16, 2024
How are models that use in-context examples handled?
Feature Request
#90
opened Feb 7, 2024 by
sachit-menon
updated Apr 15, 2024
[Request]Consider integrating MMT-Bench and CONTEXTUAL?
#196
opened May 10, 2024 by
iamlockelightning
updated Jun 18, 2024
ProTip!
no:milestone will show everything without a milestone.