Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Loss function drmsd component commented out #16

Open
TrentBrick opened this issue Apr 18, 2019 · 5 comments
Open

Loss function drmsd component commented out #16

TrentBrick opened this issue Apr 18, 2019 · 5 comments

Comments

@TrentBrick
Copy link

I was wondering why you commented out the drmsd component of the loss function while training?

@JeppeHallgren
Copy link
Collaborator

What line are you referring to here?

@TrentBrick
Copy link
Author

Lines 53 and 56 of openprotein.py

@TrentBrick
Copy link
Author

While on the topic of loss functions, am I right that you apply the mask to the tertiary structure and primary sequence when you preprocess the data rather than masking it in the loss function?

This seems bad to me because you are changing the protein itself before it is presented to the neural network and removing potential interactions the model should be acknowledging in making its angle predictions.

@JeppeHallgren
Copy link
Collaborator

Hey @TrentBrick ,
My assumption was that most people would actually want to define their own loss function and overwrite def compute_loss in openprotein.py. Happy to discuss what default loss function makes the most sense - I quickly found that drmsd can have some very steep gradients (changing just one dihedral angle can cause the global drmsd loss to explode).

@JeppeHallgren
Copy link
Collaborator

Processing the masks in the preprocessing was purely done for efficiency reasons (faster that doing it in every training iteration). But of course if a given model needs the masked values, the preprocessing script should have an option not to apply the mask.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants