This is the official code of the project, Soundini: Sound-Guided Diffusion for Natural Video Editing. Given video, you can modifiy the appearance of video solely based on audio. We leverage two types of the pre-trained models, DDPMs and CLIP (sound-aligned).

Paper, Project Page