Shoubin Yu - Homepage
Description: Zero-Shot Controllable Image-to-Video Animation via Motion Decomposition
video generation (16) image-to-video (9) zero-shot (3) image animation (1) controllable image-to-video generation (1)
In this paper, we introduce a new challenging task called Zero-shot Controllable Image-to-Video Animation, where the goal is to animate an image based on motion trajectories defined by the user, without fine-tuning the base model. Primary challenges include maintaining consistency of background, consistency of object in motion, faithfulness to the user-defined trajectory, and quality of motion animation. We also introduce a novel approach for this task, leveraging diffusion models called Img2VidAnim-Zero (I
Shoubin Yu - Homepage