how to get 'test_out.csv'?

[jiminbot20]

I downloaded 'clotho_audio_test' and changed 'hparam.py' mode = 'test'
Then, I run python train.py
'test_out.csv' was created but it was empty.
I was expecting

But it was

like this.
How can I get proper 'test_out.csv' and scores of the test?

This is capture of terminal after I run the code.

[chenkun97]

Are there corresponding .npy files in your data/test_data directory? If not, you should enter the create_dataset directory, and run python create_test_set.py to prepare the data.
The test data set only provides audio data, we cannot calculate the scores of the test. You can set mode = 'eval' to get the scores in evaluation datasets.
If you have other questions, please contact us. Thank you!

[jiminbot20]

If directory should be data/test_data, then directory down below is wrong?

[chenkun97]

It is correct. The model does not use audio as input, but the corresponding Mel-spectrogram. So we need to extract the data and save the results in the corresponding folder. The data/test_data is obtained by create_test_set.py

[jiminbot20]

Still not working...after I run the code it ends so quick and test_data folder is not creating

[lukewys]

Hi @jiminbot20 , does the clotho_test_audio contains the evaluation set audio? It should be the folder extracted from clotho_audio_test.7z. I tried on my own yesterday, it works fine.

[chenkun97]

I tried to run it, and there is no problem.

The problem may be that the code does not find the clotho_test_audio directory. My data directory is in the create_dataset directory. You can modify line 46 of create_test_set.py according to the location of your data.

[jiminbot20]

clotho_audio_test looks like this

And zip file that I downloaded is like this

Is this right?

[lukewys]

No, it should contain directly the *.wav files. In other words, you don't need the test folder.

[jiminbot20]

Oh I figure out. path problem...
line 46 'creat_test_set.py' in your git is written as 'file_list = glob.glob('./data/clotho_test_audio/*.wav')'
but it should be change into 'file_list = glob.glob('./data/clotho_audio_test/test/*.wav')'

[lukewys]

Yes, in default we do not expect the "test" folder. You could change it to whatever you like.

[jiminbot20]

I did it! Thanks for helping me!