Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Strange error, but it works normally #9

Closed
zsw111-zzz opened this issue May 17, 2023 · 2 comments
Closed

Strange error, but it works normally #9

zsw111-zzz opened this issue May 17, 2023 · 2 comments

Comments

@zsw111-zzz
Copy link

Thank you very much for your excellent contribution,But I found some problems while running:During training or inference, the program repeatedly warns as follows, but the program still runs:

torch.cat(): Sizes of tensors must match except in dimension 0. Got 240 and 224 in dimension 2 (The offending index is 3)
05/17/2023 20:37:16 - INFO - main - current idx video7812 from ret returns wrong image/video, use 4266 instead.
torch.cat(): Sizes of tensors must match except in dimension 0. Got 240 and 224 in dimension 2 (The offending index is 3)
05/17/2023 20:37:17 - INFO - main - current idx video3481 from ret returns wrong image/video, use 225 instead.

@TXH-mercury
Copy link
Owner

hi @zsw111-zzz , this mechanism ensures that if there are errors when loading some broken examples (videos, images, or audios), another example will be sampled to replace it instead of whole program crushing (try-except). And you can remove it by filtering save examples in advance. The information printed is the specific error in loading.
In principle, this mechanism should only be used for training dataloader instead of test dataloader. And we have not remove it for test due to that almost all test datasets are not broken. (Most broken examples are in pretraining dataset.)

@zsw111-zzz
Copy link
Author

Thank you very much for your reply. Your reply perfectly solved my problem. Thank you again for your outstanding contribution!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants