Skip to content

Issues: open-compass/VLMEvalKit

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
22 Open 276 Closed
22 Open 276 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[Doc] Update readme
#297 by kennymckormick was merged Jul 19, 2024 Loading…
[Update] meta_data
#295 by junming-yang was merged Jul 19, 2024 Loading…
[Model] Support Llava-Next-Interleave
#294 by junming-yang was merged Jul 19, 2024 Loading…
[Benchmark] Support MATH-Vision
#292 by scikkk was merged Jul 19, 2024 Loading…
[Fix] fix minor typo
#291 by junming-yang was merged Jul 18, 2024 Loading…
Error about vlmeval/dataset/utils/multiple_choice.py
#290 by mary-0830 was closed Jul 19, 2024
11
How to create OpenVLM.json
#288 by amitbcp was closed Jul 18, 2024
4
Update bunnyllama3.py
#287 by Isaachhh was merged Jul 17, 2024 Loading…
Customize prompt for Bunny
#286 by Isaachhh was merged Jul 16, 2024 Loading…
[Update] update dataset init class
#285 by junming-yang was merged Jul 16, 2024 Loading…
Update leaderboard
#284 by junming-yang was merged Jul 15, 2024 Loading…
Fix dataset dist init & minor typo
#283 by junming-yang was merged Jul 15, 2024 Loading…
Missing dataset_config.py
#282 by beichenzbc was closed Jul 15, 2024
4
Added blink
#281 by zeyofu was merged Jul 18, 2024 Loading…
Add blink
#280 by zeyofu was closed Jul 15, 2024 Loading…
Change the displaying of the Dataset Name
#279 by tianyu-z was merged Jul 14, 2024 Loading…
Refactor branch
#278 by mayubo2333 was merged Jul 13, 2024 Loading…
docs: update README.md
#277 by eltociear was merged Jul 12, 2024 Loading…
Support MMLongBench_DOC
#276 by junming-yang was merged Jul 13, 2024 Loading…
3
fix api model inference
#275 by junming-yang was merged Jul 12, 2024 Loading…
[Fix] Fix #272
#273 by kennymckormick was merged Jul 11, 2024 Loading…
[bug] The same sample was run twice in mp_utils.py
#272 by buptweixin was closed Jul 11, 2024
1
[BUG] local variable 'structs' referenced before assignment
#271 by Yunnglin was closed Jul 12, 2024
1
Update result link
#267 by junming-yang was merged Jul 10, 2024 Loading…
[Fix] Update MMBench-Video Prompt for no-pack setting
#266 by kennymckormick was merged Jul 9, 2024 Loading…
ProTip! Type g i on any issue or pull request to go back to the issue listing page.