PureMM is developed by TencentQQ Multimedia Research Team.
- [2024-01-26]:v1.3 model weight released.
- [2024-01-17]:v1.2 model weight released.
- [2023-12-28]:Model and inference code released.
pip install -e .
- The latest version of model weight should download from huggingface: https://huggingface.co/Q-MM/PureMM/tree/main
Before evaluation, please download the MME benchmark files MME into the mme_bench directory.
Then run the cmd:
sh eval/eval_mme.sh
PureMM achieved 1686.52 points on perception score, which was top1 on MME benchmark on 2024-01-21.
![企业微信截图_262e4ae1-bfa3-43f5-bcf6-f9abcbf2d533](https://private-user-images.githubusercontent.com/14832463/298383536-3a1cca00-5365-4242-8352-2b6a49c32ed9.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjQ3Nzk4MTcsIm5iZiI6MTcyNDc3OTUxNywicGF0aCI6Ii8xNDgzMjQ2My8yOTgzODM1MzYtM2ExY2NhMDAtNTM2NS00MjQyLTgzNTItMmI2YTQ5YzMyZWQ5LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA4MjclMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwODI3VDE3MjUxN1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWE0ZTE2ODExYzNlMjAyM2I3NTZlYjgzYWRlMjBhN2ZlMWRiNTA1OWQ4OGRiNjM1ZjUwMTU2YTVkYjhkN2UxNjEmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.ezmVScl08rEWDD_uJ9_cT4hTjk-MleDVmId_v6BZ8Q4)