Skip to content

Issues: open-compass/VLMEvalKit

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort

Issues list

The results of instructblip 13b
#187 opened Apr 29, 2024 by YongLD
[Support] multiple process parallel inference large model on multi-gpu In Progress New feature is under working
#298 opened Jul 19, 2024 by junming-yang Loading…
[Benchmark] mmniah
#434 opened Sep 1, 2024 by ttguoguo3 Loading…
评测InternVL2-8B出现OOM
#533 opened Oct 21, 2024 by AACengineer
[Benchmark] Add MLLMJudgeDataset
#534 opened Oct 21, 2024 by Misaki-Wang Loading…
[Fix] Fix #546
#562 opened Oct 31, 2024 by kennymckormick Loading…
Audio modality evaluation help wanted Extra attention is needed
#313 opened Jul 25, 2024 by Simplesss
关于幻觉benchmark的支持 help wanted Extra attention is needed
#384 opened Aug 15, 2024 by shufangxun
【提问】关于语音模型的评测 help wanted Extra attention is needed
#473 opened Sep 19, 2024 by xx0412
textonly benchmarks
#497 opened Sep 30, 2024 by JcWang20
dataset_config.py在哪里
#545 opened Oct 24, 2024 by hello-bluedog
best to have docker image help wanted Extra attention is needed
#190 opened May 3, 2024 by max-yue
Inconsistent max_new_tokens
#356 opened Aug 3, 2024 by amitbcp
评测MVBench时报错
#551 opened Oct 25, 2024 by helloworld01001
grounding数据支持
#219 opened Jun 12, 2024 by sxlyiyiyi
[Request] Consider integrating the following list? help wanted Extra attention is needed
#257 opened Jul 5, 2024 by sarapieri
ProTip! Mix and match filters to narrow down what you’re looking for.