Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Problems that arise during training #63

Open
TengfeiZeng opened this issue Jun 3, 2023 · 0 comments
Open

Problems that arise during training #63

TengfeiZeng opened this issue Jun 3, 2023 · 0 comments

Comments

@TengfeiZeng
Copy link

Hello, I encountered such problems when I was training. At the beginning of the training, the previous several epochs can be very good to complete the training, but after training a dozen epochs, there will always be data set loading error or index out of scope such an error, do not know what is the reason。
The error is shown below,sometimes mistake number one, sometimes mistake number two:

  1. File "/2DPASS-main/network/arch_2dpass.py", line 67, in p2img_mapping img_feat.append(pts_fea[batch_idx == b][p2img_idx[b]])
    IndexError: list index out of range

  2. File "/home/ubuntu/anaconda3/envs/2dpass/lib/python3.7/site-packages/torch/utils/data/dataloader.py", line 1225, in _process_data data.reraise()
    File "/home/ubuntu/anaconda3/envs/2dpass/lib/python3.7/site-packages/torch/_utils.py", line 429, in reraise raise self.exc_type(msg)
    KeyError: Caught KeyError in DataLoader worker process 6.

File "/2DPASS-main/dataloader/pc_dataset.py", line 111, in getitem annotated_data = np.vectorize(self.learning_map.getitem)(annotated_data)
File "/home/ubuntu/anaconda3/envs/2dpass/lib/python3.7/site-packages/numpy/lib/function_base.py", line 2163, in call return self._vectorize_call(func=func, args=vargs)
File "/home/ubuntu/anaconda3/envs/2dpass/lib/python3.7/site-packages/numpy/lib/function_base.py", line 2246, in _vectorize_call outputs = ufunc(*inputs)
KeyError: 56

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant