Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

About the generation process of flow field/displacement field #574

Open
DongChunL opened this issue Dec 12, 2023 · 2 comments
Open

About the generation process of flow field/displacement field #574

DongChunL opened this issue Dec 12, 2023 · 2 comments

Comments

@DongChunL
Copy link

DongChunL commented Dec 12, 2023

The term "flow/displacement field" mentioned below specifically refers to what is generated after the decoder, that is, it is between UNET and STN and not within the STN itself.

I see code like this: _self.flow=conv_fn(dec_nf[-1], dim, kernel_size=3, padding=1),_ but conv_fn is not visible. I understand that this sentence literally means that the flow field is obtained from the last layer of the decoder.Or maybe I was wrong?

However, I don't understand how this is done. What is the logic inside the conv_fn function? Can you provide the internal code of the conv_fn function? I haven't found it. Or, could you explain the conv_fn function in detail ,I mean, "
How to compute the flow field between images from feature maps?"
Thank you.

@Pascal-bucketbreaker
Copy link

I have the inverse question: How to compute the terminal image from the original image and flowfield?

@adalca
Copy link
Collaborator

adalca commented Jan 22, 2024

in which framework (tf/torch)

in tf, for example, we cover this in the tutorial at the end:

warp_model = vxm.networks.Transform(vol_shape, interp_method='nearest')
warped_seg = warp_model.predict([vol, warp])

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants