Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for multiple cameras in stereo matching #2

Open
bobble-git opened this issue Nov 14, 2023 · 4 comments
Open

Support for multiple cameras in stereo matching #2

bobble-git opened this issue Nov 14, 2023 · 4 comments

Comments

@bobble-git
Copy link

I'm having trouble extending this code for multiple camera . Can you suggest a fix.

@2b-t
Copy link
Owner

2b-t commented Nov 14, 2023

Hi @bobbie-git,
to be honest when writing it now over five years ago I never really though of using it with multiple cameras. Should be doable though.
So you would like to do multi-camera stereo matching with more than two input images, right? Do you have some example images for what the input looks like? What matching algorithm are you interested in implementing?

@bobble-git
Copy link
Author

Yes, I want to use multiple images rather than two, currently using the Middlebury stereo dataset Cones Dataset, and want to perform interpolation to scale the cost volumes. I want to use SGM as the matching algorithm. and for the cost function I'm using the weighted census cost function

@2b-t
Copy link
Owner

2b-t commented Nov 15, 2023

I am pretty busy during the week but I might have a look at it over the weekend. Not sure if I will have time to extend it but pretty sure that I can give you a hint on how to do it.

@bobble-git
Copy link
Author

image

I'm trying to recreate the results of this paper Iterative Guided Gaussian

This is the image I've obtained using four images of the cones dataset by modifying your code, I think it is working. Need to get rid of these occlusion errors on the left side of the image. They were not so exaggerated in the paper even though he used the extreme left and right images of the dataset. Any suggestions? Can it be related to the fact that they are using 16 directions in SGM instead of using 4 directions like in your code. Could you tell me how to extend it to 16 directions.

the main modifications I've done are in the stereo_matching.py. There is another file called interpolate.py that performs the scaling of the cost volumes to the highest size

Code for interpolate.py
changes made in stereo_matcing.py

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants