-
Notifications
You must be signed in to change notification settings - Fork 150
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Viewing outputs in SIBR viewer #11
Comments
I have not time to expand the SIBR viewer and edit the rendering time locally. I only set the timestamp in the code like this: video_cams = scene.getVideoCameras()
for iteration in range(first_iter, final_iter+1):
if network_gui.conn == None:
network_gui.try_connect()
while network_gui.conn != None:
try:
net_image_bytes = None
custom_cam, do_training, pipe.convert_SHs_python, pipe.compute_cov3D_python, keep_alive, scaling_modifer = network_gui.receive()
if custom_cam != None:
count +=1
viewpoint_index = (count ) % len(video_cams)
if (count //(len(video_cams))) % 2 == 0:
viewpoint_index = viewpoint_index
else:
viewpoint_index = len(video_cams) - viewpoint_index - 1
# print(viewpoint_index)
viewpoint = video_cams[viewpoint_index]
custom_cam.time = viewpoint.time
print(custom_cam.time, viewpoint_index, count)
net_image = render(custom_cam, gaussians, pipe, background, scaling_modifer, stage=stage)["render"]
net_image_bytes = memoryview((torch.clamp(net_image, min=0, max=1.0) * 255).byte().permute(1, 2, 0).contiguous().cpu().numpy())
network_gui.send(net_image_bytes, dataset.source_path)
if do_training and ((iteration < int(opt.iterations)) or not keep_alive) :
break
except Exception as e:
print(e)
network_gui.conn = None |
Could you tell me, the SIBR Remote Gaussian Viewer shown above, is that the original code from Inria or modified for playback of 4D data? Can the Viewers for Windows (60MB) work? Also, I tested running the Remote viewer while training, it connected but did not display any window in the GUI. |
Yes. It only works in dnerf dataset. I test it in the Windows11 with RTX 3080 GPU. Other format of dataset(dynerf,hypernerf)needs add correct pose loader in the origin code of SIBR viewer. I've not finished it yet. |
I tried this command while the bouncing balls dnerf were training;
The GUI opens and says connected but no viewer window appears, are there any other arguments I need to use? |
maybe you can add the |
Does this only work while training or can it be used to loaded pretrained dnerfs? |
any more luck getting this to work? It says connected but then immediately connection dropped, over and over... |
no luck, it doesnt work for me |
Same problem. Anyone can help? Many thanks! |
I meet the same problem. |
@Zhentao-Liu thanks I was able to view the scenes I trained with that command and see the same artifacts, the models I trained were trained with the first release of code, was yours more recent? Also, did you find a way to play the 4D sequence? is there a timeline within SIBR that you found? |
Yes, I use the code more recent, but I think there is no core difference. |
@Zhentao-Liu Hi, do you have any problems reproducing the results of my paper?.. |
@henrypearce4D @Zhentao-Liu My command:
|
@guanjunwu this sounds great! I will make sure to test this week! |
Where is SIBR_remoteGaussian_app_rwdi.exe? Can you help me? |
hey you tested this? please provide the link for downloading the viewer and also provide the commands use for run viewer. |
I also want to know! |
Hey @guanjunwu, |
Hi, the viewer is based on 3DGS's viewer. The rendering process is modified from my code. python train.py -s data/hypernerf/virg/virg-3dprinter --port 6017 --expname "hypernerf/3dprinter" --configs arguments/hypernerf/3dprinter.py
./viewers/bin/SIBR_remoteGaussian_app.exe --port 6017 --path data/dnerf/lego This path only decide the camera intrinsics and extrinsics. And it is a straightforward solution. After viewer is initialized, you can rotate the camera to find the correct position. |
Thanks for your great work ! And I'm sorry for the time consumption. |
Last quetstion, is it possible to view the trained model using you viewer ? Running
Even though the 'cfg_args' file is present in the given directory. (using the remoteGaussian_app.exe leads to a black screen in the viewer) |
Sorry, the viewer hasn't supported it yet. |
Thanks for your answer. When loading the model using: |
you can open the viewer at first, and change iterations in arguments/dynerf/default.py to 14010, then launch the training process :) |
Thanks a lot :) It all works now . Sorry again |
On the project page there are results shown in SIBR viewer;
What are the instructions to get this working?
The text was updated successfully, but these errors were encountered: