Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Decreasing Test Accuracy in README .png #13

Open
Robert-Browning opened this issue Jan 22, 2019 · 7 comments
Open

Decreasing Test Accuracy in README .png #13

Robert-Browning opened this issue Jan 22, 2019 · 7 comments

Comments

@Robert-Browning
Copy link

In your README, the tensorboardx output for Test Acc is steadily decreasing over all 100 epochs. Is that just a 'typo' or were those your actual results?

image

PS Thanks a ton for the code. It has been very helpful!

@wave-transmitter
Copy link

Hi, pay attention to the y-axis of the first figure, values are between 0.962 and 0.963. Moreover, evaluation on test set is carried out every 20 epochs.

So test accuracy is just, let's say, oscillating between those two values. It's totally normal. Probably one would notice the same effect if he/she could zoom in on the other two accuracy curves.

@cantonioupao
Copy link

cantonioupao commented Feb 8, 2019

How did you get the graph results? i run the "inference.py" file but didn't get the results

@wave-transmitter
Copy link

These graph results were provided by @jfzhang95 in README file after training the model. I also managed to get similar result by running train.py.

As mentioned in issues #8 and #10 there is problem with inference.py and pretrained model loading.

@cantonioupao
Copy link

I am running it in Linux and i didn't get this frame windows after running inference.py . I only got a window displaying the video under testing

@wave-transmitter
Copy link

wave-transmitter commented Feb 20, 2019

As I said previously, you can only get these tensorboard graph results by running "train.py". By running "inference.py" you are just using a pretrained model to make predictions for a single input video. Epochs, accuracy, loss and etc. are parameters of the training procedure.

@cantonioupao
Copy link

I already run the train.py in a Linux system , however i don't get the results , only some statistics in every epoch it executes.
pytorch_breakfast_testing

@wave-transmitter
Copy link

Hey, in my opinion you should open a new issue since your questions are no longer relevant with that issue. We should help the future readers of that topic.

To answer to your question, as specified in @Robert-Browning initial question but also through README, in order to get these graphs you gonna need tensorboardX installed and a tensorboard console launched while running "train.py". You can find instructions on how to do that here. You only have to start the tensorboard server, the setup is already done.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants