Commits

History for

Commits on Jun 18, 2024

update
kennymckormick
committedJun 18, 2024

Commits on Jun 17, 2024

update MMTBench
kennymckormick
committedJun 17, 2024
update mmt-bench
KainingYing
committedJun 17, 2024

Commits on May 21, 2024

fix
kennymckormick
committedMay 21, 2024

Commits on May 17, 2024

update run.py
kennymckormick
committedMay 17, 2024

Commits on Apr 30, 2024

update run.py
kennymckormick
committedApr 30, 2024

Commits on Apr 29, 2024

[Dataset] MMBench V11 (open-compass#185 )
kennymckormick
committedApr 29, 2024

Commits on Apr 23, 2024

fix bug in set device
kennymckormick
committedApr 23, 2024

Commits on Apr 21, 2024

update
kennymckormick
committedApr 21, 2024

Commits on Apr 17, 2024

fix run.py
kennymckormick
committedApr 17, 2024

Commits on Apr 16, 2024

fix run.py
kennymckormick
committedApr 16, 2024
[Improvement] Use judge_kwargs for initializing judges (open-compass#153 )
kennymckormick
committedApr 16, 2024

Commits on Apr 9, 2024

[Refactor] Refactor the Generate Interface (open-compass#140 )
kennymckormick
committedApr 9, 2024

Commits on Apr 8, 2024

[Dataset] Add InfoVQA and DocVQA_TEST (open-compass#137 )

LightDXY
and
kennymckormick
committedApr 8, 2024

Commits on Apr 3, 2024

verbose args also apply to VLM APIs
kennymckormick
committedApr 3, 2024

Commits on Mar 31, 2024

reorder processes in run.py
kennymckormick
committedMar 31, 2024

Commits on Mar 26, 2024

[Feature] Support json output for MMMU offical evaluation (open-compass#130 )
SparksJoe
committedMar 26, 2024
[Prompt] Refine VQA Prompt (open-compass#129 )
kennymckormick
committedMar 26, 2024

Commits on Mar 19, 2024

[Improvement] Support load_dotenv (open-compass#120 )
kennymckormick
committedMar 19, 2024
[Improvement] Add Pre-Commit Check (open-compass#119 )
kennymckormick
committedMar 19, 2024

Commits on Mar 15, 2024

[Improvement] Update LLaVA version, hyper parameters and evaluation results (open-compass#115 )
kennymckormick
committedMar 15, 2024

Commits on Mar 8, 2024

[Improvement] Incorporate codebase changes during early March (open-compass#106 )
kennymckormick
committedMar 8, 2024

Commits on Feb 28, 2024

[Refactor] Remove the multi_generate interface (open-compass#98 )
kennymckormick
committedFeb 28, 2024

Commits on Feb 24, 2024

[Dataset] Add OCRBench (open-compass#91 )

echo840
and
kennymckormick
committedFeb 24, 2024

Commits on Feb 2, 2024

[Improvement] Minor Updates 0202 (open-compass#86 )
kennymckormick
committedFeb 2, 2024

Commits on Jan 30, 2024

fix work_dir bugs
kennymckormick
committedJan 30, 2024
[Feature] Minor Updates (open-compass#81 )
kennymckormick
committedJan 30, 2024

Commits on Jan 29, 2024

[Metric] Update QA metrics calculation method (open-compass#72 )

FangXinyu-0913
and
kennymckormick
committedJan 29, 2024

Commits on Jan 27, 2024

minor update
kennymckormick
committedJan 27, 2024

Commits on Jan 20, 2024

[Fix] Skip evaluation for MMBench_TEST on non-official servers
kennymckormick
committedJan 20, 2024

Commits on Jan 17, 2024

[Dataset] Support LLaVABench (open-compass#55 )
kennymckormick
committedJan 17, 2024

Commits on Jan 14, 2024

[Benchmark] support AI2D (open-compass#51 )
kennymckormick
committedJan 14, 2024

Commits on Jan 13, 2024

[Dataset] Add DocVQA (open-compass#50 )

SparksJoe
and
llllIlllll
committedJan 13, 2024

Commits on Jan 2, 2024

[Dataset] HallusionBench (open-compass#38 )
kennymckormick
committedJan 2, 2024

Commits on Jan 1, 2024

[Dataset] MathVista dataset (open-compass#29 )

committedJan 1, 2024