Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

About the translation of camera in HyperNeRF dataset and coords convention #95

Open
MobiusLqm opened this issue Mar 4, 2024 · 2 comments

Comments

@MobiusLqm
Copy link

MobiusLqm commented Mar 4, 2024

Hi, Thanks for your wonderful work.

  1. in your codes line 164-165 of scene/hyper_loader.py , you use T = - camera.position @ R instead of T = camera.position ,Could your please tell What's the reason behind it?
  2. Addtionaly, as far as i know , 3d gaussian splatting uses opencv coords convention, but hypernerf dataset uses openGL convention. Why don't you convert it to opencv coords?
    Looking forward to your reply!
    Regards.
@guanjunwu
Copy link
Collaborator

guanjunwu commented Mar 4, 2024

Thanks for your question!

  1. I've tried many times to align camera poses among these datasets. Maybe the camera pose of hypernerf is c2w instead of w2c. So I have to change it.
  2. In fact ,the full loader code is borrowed from TiNeuVox. And the colmap.sh also generate dense point clouds from this dataset, in order to make it useful and simple, so I didn't convert it.
    When running the hypernerf dataset, you can found a image will be saved as 'output.png', that's my debug figure that point out the relationship between camera poses and point clouds.

@MobiusLqm
Copy link
Author

Thank your for you quick reply!
https://github.com/google/nerfies#datasets

  1. after checking the repo of nerfies and hypernerf, I found that hypernerf follows nerfies dataset format. The orientation is a w2c matrix, and the position is in world coords. This makes me more confused , I still dont understand why this line of code works.
  2. So sorry, my bad, Hypernerf uses opencv coords convention.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants