Any chance to view it in a real-time viewer?

[camtrik]

Hi, thank you for your nice work! I've tried the DyNeRF dataset and the rendered video looks nice. But is there a way to view the dynamic scene interactively by using viewers like SIBR or possibly any other viewers?

[guanjunwu]

emmm I‘m working on it but haven't finished yet.
maybe you can read the poses like d-nerf initially that can open the viewer, then change the pose in GUI to find the correct position of dynerf's dataset?

[wzy-99]

emmm I‘m working on it but haven't finished yet. maybe you can read the poses like d-nerf initially that can open the viewer, then change the pose in GUI to find the correct position of dynerf's dataset?

Hello, just saw your comment on the issue.

I have made a time-controlled SIBR viewer in SIBR_custom at the branch dynamic_gaussian_splatting. Maybe some help.

BTW, I am also a HUSTer and a NeRFer. So, hope to cooperate someday.

[aleatorydialogue]

wzy-99, is this custom-SIBR used to view while training or only after training is complete? appreciate your work on this, i'd really love to get it up and running asap

[wzy-99]

wzy-99, is this custom-SIBR used to view while training or only after training is complete? appreciate your work on this, i'd really love to get it up and running asap

You can use it to view the training progress in real-time or after the training is complete. I have made modifications to the program SIBR_remoteGaussian_app_rwdi.exe by adding a time slider control t, ranging from 0 to 1.0. However, you need to modify the code of the network_gui loop in python.

[yzslab]

Hi, I also implemented a viewer for 4DGaussians, and it is web based: https://github.com/yzslab/gaussian-splatting-lightning#load-model-trained-by-other-implementations

Run python viewer.py 4DGaussians/outputs/lego --vanilla_gs4d, and access http:https://SERVER_IP:8080, then you can view your scene interactively (NOTE: Edit and Render panel are not available for 4DGaussians).

4DGS-new.mp4

[muximuxi]

Hi, I also implemented a viewer for 4DGaussians, and it is web based: https://github.com/yzslab/gaussian-splatting-lightning#load-model-trained-by-other-implementations

Run python viewer.py 4DGaussians/outputs/lego --vanilla_gs4d, and access http:https://SERVER_IP:8080, then you can view your scene interactively.

4DGS-new.mp4

hi~, how did you load the 4Dgaussian model here, when I use python viewer.py 4DGaussians/outputs/lego --vanilla_gs4d , the error like this: how did you solve this?@yzslab
Unexpected key(s) in state_dict: "deformation_net.shs_deform.1.weight", "deformation_net.shs_deform.1.bias", "deformation_net.shs_deform.3.weight", "deformation_net.shs_deform.3.bias".

[cmh1027]

@muximuxi It seems that he didn't take into account shs_deform weights because the original gs4d turns it off by default. You can ignore it by passing strict=False to load_state_dict function

[azzarelli]

For anyone interested in a dearpygui viewer for this project (seems a lot more GS papers are using this), I implemented a simple one here. You just need to place the script into the same folder as train.py then pip install dearpygui and run gui.py the same way you would with the train.py.

Hope this helps

PS> If your're interested in something more elaborate the GUI is essentially the same as SC-GS

[GiadaFerreri]

Hi, I also implemented a viewer for 4DGaussians, and it is web based: https://github.com/yzslab/gaussian-splatting-lightning#load-model-trained-by-other-implementations

Run python viewer.py 4DGaussians/outputs/lego --vanilla_gs4d, and access http:https://SERVER_IP:8080, then you can view your scene interactively.

4DGS-new.mp4

Hi, I tried this viewer with my trained model from this repository. This is what I get (there's only 'General' panel):

This is what I get in the command prompt:

How can I enable the other two panels ('Edit' and 'Render' panels)?

[yzslab]

Hi, I also implemented a viewer for 4DGaussians, and it is web based: https://github.com/yzslab/gaussian-splatting-lightning#load-model-trained-by-other-implementations
Run python viewer.py 4DGaussians/outputs/lego --vanilla_gs4d, and access http:https://SERVER_IP:8080, then you can view your scene interactively.
4DGS-new.mp4

Hi, I tried this viewer with my trained model from this repository. This is what I get (there's only 'General' panel):

This is what I get in the command prompt:

How can I enable the other two panels ('Edit' and 'Render' panels)?

Hi, edit and render are not compatible with third-partry dynamic scene.
If you really need it you can implemente it yourself.