Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How can I recover the covariance matrix using quaternions and two-dimensional scales? #88

Open
SlamCabbage opened this issue Jun 18, 2024 · 7 comments

Comments

@SlamCabbage
Copy link

No description provided.

@hbb1
Copy link
Owner

hbb1 commented Jun 18, 2024

padding zeros to the scales and pass them into build_scaling_rotation

@SlamCabbage
Copy link
Author

torch.exp is used in build_scaling_rotation, so is the "scales" saved at the end the actual size of the Gaussian in this scene?

@hbb1
Copy link
Owner

hbb1 commented Jun 18, 2024

Hi, when I refers to the scales, I mean the post-activation scales. Yes, the scales are indeed measured in the actual scene; that is, the world space. You need to append the scale-post-activation for recovering a full covariance.

@SlamCabbage
Copy link
Author

image
大佬您好,我用中文了,这是waymo数据,我可视化它的协方差,这个是按照scale的0.05倍可视化的。如果按照1.0倍进行可视化,那么整个场景都是一坨纠缠在一起的,完全看不出来。

@DavidXu-JJ
Copy link

Waymo should not be a problem.
https://streetunveiler.github.io/
I use 2DGS in my project above. And I at least successfully reconstruct the scene.

@SlamCabbage
Copy link
Author

image
我对scales做了一个exp操作之后,可视化的结果如上图。
用2d gs可视化工具能看到这个场景的地面点虽然不多,但是在图像上是覆盖全了,为什么我对高斯进行可视化,地面并没有能够把空出补全的大高斯平面呢?

@SlamCabbage
Copy link
Author

Waymo should not be a problem. https://streetunveiler.github.io/ I use 2DGS in my project above. And I at least successfully reconstruct the scene.

Already following, looking forward to open source

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants