Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is it possible to add other interpolation methods? #92

Open
zelenooki87 opened this issue May 5, 2024 · 6 comments
Open

Is it possible to add other interpolation methods? #92

zelenooki87 opened this issue May 5, 2024 · 6 comments

Comments

@zelenooki87
Copy link

Is it possible to add other interpolation methods? I would assume IFRNet would be the easiest to implement because there is a Vulkan ported version. Is it possible to add some other interpolation from this benchmark page?
https://github.com/AIVFI/Video-Frame-Interpolation-Rankings-and-Video-Deblurring-Rankings
Thank you very much in advance

@WolframRhodium
Copy link
Contributor

RIFE is the only model that is in the top rank in terms of perceptual quality with available pre-trained models, according to this ranking.

I would assume IFRNet would be the easiest to implement because there is a Vulkan ported version.

This is false.

@zelenooki87
Copy link
Author

Oh, that was my layman's assumption. Some videos I interpolated with ema-vfi and ifrnet in a conda environment seemed to me to be somewhat better than rife. In one of the previous issues I opened, you wrote to me that ema-vfi is too slow to consider adding it. Has anything changed in the meantime? You added swinir and scunet and big respect for that. :) Greetings

@WolframRhodium
Copy link
Contributor

Now the GridSample operator is the bottleneck that affects all modern video frame interpolation models.

@zelenooki87
Copy link
Author

@WolframRhodium What about to implement new interpolation method?
https://github.com/mulns/PerVFI

@zelenooki87
Copy link
Author

or this one? (seems better)
https://github.com/JHLew/MoMo

@WolframRhodium
Copy link
Contributor

You can do these yourself.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants