Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Training failure due to the scale difference between the offset and the canonical space gs. #166

Closed
Time-Lord12th opened this issue Jul 16, 2024 · 4 comments

Comments

@Time-Lord12th
Copy link

Hello,
Thanks for your great work. Have you ever encountered training failure due to the scale difference between the offset and the canonical space gs?
For example, the position range of the canonical space gs is [-0.2, 0.2], while the offset range output by the deformation model is [-1, 1]. So most of the gs will be deformed out of the camera's field of view, causing a large difference between the rendered image and the ground truth, making it impossible for the model to optimize properly.
Do you have any opinion on this issue?

@guanjunwu
Copy link
Collaborator

yes of course, you can just change the initialization of the deformation field in L221 and L223.

@Time-Lord12th
Copy link
Author

thanks, but I wonder why L221 and L223 are the same. L223 should initialize m.bias?
image

@guanjunwu
Copy link
Collaborator

Yes, you can set different initialize level, but I think you can only modify L221.

@Time-Lord12th
Copy link
Author

thanks for your advice!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants