Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Some data parts are not stored using "SaveStructureToString" #137

Open
mikerabat opened this issue May 15, 2024 · 1 comment
Open

Some data parts are not stored using "SaveStructureToString" #137

mikerabat opened this issue May 15, 2024 · 1 comment
Assignees
Labels
bug Something isn't working

Comments

@mikerabat
Copy link

E.g. the base class TNNetAddNoiseBase does not store the "Enabled" property in that structure. That has the following impact:
Assume you have a TNNetDropout layer in your net. Based on that definition if the enabled flag is set on each learning iteration it randomly changes the which activations are used in a learning step.
Now assume you finished learning and save the net to a file - later loading it and use it to classify
an unseen example.

Based on randomness the outcome is unpredictable and changes on each iteration! (I found that when I tried to analyze some
ECG recordings for sleeping apneas and the output probabilites changed each time)

My workaround is to manually go through each layer after loading or cloning (for threads) and set the flag "Enabled" to false.
Would be nice though to have either a general switch or have a function to remove TNNetAddNoiseBase layers at all for production
runs that rely on same input = same output principle ;) or have the structure enhanced by storing additional properties...

@joaopauloschuler
Copy link
Owner

Dear @mikerabat ,
I'll look into it and FUP.

@joaopauloschuler joaopauloschuler self-assigned this May 17, 2024
@joaopauloschuler joaopauloschuler added the bug Something isn't working label May 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants