This folder consists of link to a colab notebook that helps us evaluate the performance at a bin level. The txt files required for running the notebook are in this drive folder

The Demo plot as in Default Approach , SOTA for NWPU Dataset can be found here.

The Demo Plot as in Default Approach , Overall performance of networks in terms of Pooled MAE +/- std can be found here.

The Demo Plot as in Proposed Approach, Dataset-wise Analysis, RR sampling NWPU can be found here.

The Demo Plot as in Proposed Approach, Network-wise Analysis on DM Count network for NWPU dataset can be found here.

If you are interested in using the evaluation procedure for your network, you could make a copy of this colab notebook and use the same.

The jupyter notebook percentage plot-single network_BL.ipynb provides demo for generating the TPER curves. The reuired txt files to run this notebook are also added to this repo inside the BL_txt folder.

The game_metric.py contains the file which you can use to calculate the GAME metric.