Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Multi gpu for conditional moment #156

Closed
malihass opened this issue Jul 14, 2023 · 0 comments · Fixed by #157
Closed

Multi gpu for conditional moment #156

malihass opened this issue Jul 14, 2023 · 0 comments · Fixed by #157
Assignees
Labels
bug Something isn't working

Comments

@malihass
Copy link
Collaborator

The use of multi gpu does not work with the conditional moment batch handling. Batch handler still expects the full batch size instead of batch size divided by number of GPUs

Currently I get dimension errors when calling calc_loss_cond_mom . I suspect this has to do with the mask dimension.

@malihass malihass added the bug Something isn't working label Jul 14, 2023
@malihass malihass self-assigned this Jul 14, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant