-
Notifications
You must be signed in to change notification settings - Fork 28
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Support for Loss Functions (Symmetric Loss function) #71
Comments
Can you please explain why we would need this? @s0nicboOm |
Symmetric Loss function is when we want to weight the positive as well as the negative outliers equally. Currently we use Absolute error and MSE. Here there is an Opportunity of introducing more such similar loss functions. |
Hey,I would like to try resolving this issue. |
hi, If I have understood it right, you want to me add support for symmetric functions https://github.com/numaproj/numalogic/blob/main/numalogic/models/vae/base.py here in the _init_criterion method.
like the sigmoid loss from torch |
torch.nn.functional has 21 loss functions among which 6 are symmetric loss functions, 3 are already supported
Need to add the following
|
Hi @rum1887 ! We are ultimately looking to support loss functions that are not only in PyTorch but also provide a flexibility to the user to plug in there own custom loss function. This issue does not only point to adding more loss functions but also asks for a better way of providing that interface to the user to bring in their own custom loss function that integrates with the models that we have today. Take an example of a custom loss function that user wants to use in. In this case we are limited but if-else structure and we are not able to provide the flexibility to user. So, we do need a support for custom loss function that involves making a new interface. Hope that makes sense. Also, it should be noted that loss_fn are used at two places today: 1) training and 2) calculating reconstruction/prediction. Thanks for the question. Let me add it to the issue summary for better clarification. |
Summary
Introduce Symmetric Loss functions for the ML model.
Use Cases
Message from the maintainers:
If you wish to see this enhancement implemented please add a 👍 reaction to this issue! We often sort issues this way to know what to prioritize.
The text was updated successfully, but these errors were encountered: