-
Notifications
You must be signed in to change notification settings - Fork 94
Issues: open-compass/VLMEvalKit
[Help Wanted] Supporting the
chat_inner
API for existing VLMs.
#323
opened Jul 27, 2024 by
kennymckormick
Open
2
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
What is the estiamted runtime across benchmarks, and OpenAI api cost?
#33
by findalexli
was closed Jan 20, 2024
If i want to use model of LLaVa in VLMEval, which version should i installed for these?
#100
by EmberYS
was closed Mar 7, 2024
Enhancing Multi-Choice Question Handling with Case-Sensitive Matching
#99
by jdy18
was closed Mar 12, 2024
OPENAI_API_KEY is not set properly, will use exact matching for evaluation
#109
by StarCycle
was closed Mar 15, 2024
The scores calculated by VLMEvalKit differ from the score calculated on the MMBench website
#121
by jdy18
was closed Mar 20, 2024
Previous Next
ProTip!
Find all open issues with in progress development work with linked:pr.