New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MMMU test set #65

Closed

mactavish91 opened this issue Jan 23, 2024 · 2 comments

Labels

Feature Request

mactavish91 commented Jan 23, 2024

It will be nice if VLMEvalKit can generate result for MMMU test set,

kennymckormick added the Feature Request label

Member

kennymckormick commented Jan 27, 2024

Hi, @mactavish91 ,
The feature has been updated in #75.

kennymckormick closed this as completed

Author

mactavish91 commented Jan 28, 2024

@kennymckormick Thank you for you great effort! I wonder if there is a version that can be submitted to the MMMU leaderboard.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment