Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Underwhelmed by the results #61

Open
Bardo-Konrad opened this issue Jun 3, 2024 · 9 comments
Open

Underwhelmed by the results #61

Bardo-Konrad opened this issue Jun 3, 2024 · 9 comments

Comments

@Bardo-Konrad
Copy link

Bardo-Konrad commented Jun 3, 2024

I understood that this was to produce high quality meshes from nerfs/gaussian splatting.

I am underwhelmed by the results. I expected fine details, not the typically coarse output of photogrammetry and that's even worse.

a
b

@hbb1
Copy link
Owner

hbb1 commented Jun 3, 2024

What is the problem there?

@Bardo-Konrad
Copy link
Author

I expected fine details, not the typically coarse output of photogrammetry

@hbb1
Copy link
Owner

hbb1 commented Jun 3, 2024

Did you process everything correctly? or just the result is not satisfied.

@Bardo-Konrad
Copy link
Author

Bardo-Konrad commented Jun 3, 2024

This was my approach

call activate surfel_splatting
python.exe C:\2d-gaussian-splatting\convert.py -s .
python.exe C:\2d-gaussian-splatting\train.py -s .
python.exe C:\2d-gaussian-splatting\render.py -m <path to output checkpoint folder> -s .

The be all and end all of GS/Nerf is perspective dependent reflections and very fine details. Given that you cannot put pdr in meshes, I don't expect that, but the fine details are utterly missing. Instead of this I can just use reality capture.

@hbb1
Copy link
Owner

hbb1 commented Jun 3, 2024

Did the rendering results look normal? Can you showcase your dataset. Let's figure out some failure cases for facilitating future works.

@Bardo-Konrad
Copy link
Author

Bardo-Konrad commented Jun 3, 2024

Sure: images.zip
And renders: renders.zip renders2.zip

@hbb1
Copy link
Owner

hbb1 commented Jun 3, 2024

061

079

I think the images are textureless, sparse-viewed, blurred and low-resolution. This will definitely pose challenge for NeRF/GS based solutions. Maybe reality capture is a more robust choice in these cases.

@Bardo-Konrad
Copy link
Author

Is the goal of this r. fine details in meshes compared to standard photogrammetry?

@hbb1
Copy link
Owner

hbb1 commented Jun 3, 2024

The goal is geometrically accurate radiance fields.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants