errors in MME evaluation

[liuliAI]

Describe the issue

Issue:
errors in MME evaluation
Command:

CUDA_VISIBLE_DEVICES=0 bash scripts/v1_5/eval/mme.sh

Log:

RuntimeError: CUDA error: CUBLAS_STATUS_NOT_SUPPORTED when calling `cublasGemmEx( handle, opa, opb, m, n, k, &falpha, a, CUDA_R_16F, lda, b, CUDA_R_16F, ldb, &fbeta, c, CUDA_R_16F, ldc, CUDA_R_32F, CUBLAS_GEMM_DEFAULT_TENSOR_OP)`
Traceback (most recent call last):
  File "/data/LLaVA/playground/data/eval/MME/convert_answer_to_mme.py", line 43, in <module>
    GT = get_gt(
  File "/data/LLaVA/playground/data/eval/MME/convert_answer_to_mme.py", line 35, in get_gt
    question, answer = line.strip().split('\t')
ValueError: not enough values to unpack (expected 2, got 1)
=========== Perception ===========
Traceback (most recent call last):
  File "/data/LLaVA/playground/data/eval/MME/eval_tool/calculation.py", line 164, in <module>
    cal.process_result(results_dir)
  File "/data/LLaVA/playground/data/eval/MME/eval_tool/calculation.py", line 98, in process_result
    lines = open(task_txt, 'r').readlines()
FileNotFoundError: [Errno 2] No such file or directory: 'answers/llava-v1.5-13b/existence.txt'

[wijayarobert]

I also get the same error. Did you manage to resolve it?