AB
AiBoss
project

Animate Anyone - A framework for image-to-video character animation compositing launched by Alibaba.

Animate Anyone is an open-source framework developed by Alibaba Research Institute of Intelligent Computing that animates characters or people in static images. Based on the diffusion model, this framework incorporates ReferenceNet, Pos...

Animate Anyone, developed by Alibaba Research Institute of Intelligent Computing, is an open-source framework that animates characters or figures in static images. It has garnered nearly 13,000 stars on GitHub and sparked heated discussions both domestically and internationally. Building upon a diffusion model, the framework incorporates technologies such as ReferenceNet, Pose Guider, and a timing generation module to maintain consistency, controllability, and stability when photos are animated, outputting high-quality dynamic videos. The "Tongyi Dance King" feature in Alibaba's AI chat assistant, Tongyi Qianwen, is based on this technology, allowing people/figures in photos to perform various dances, including driving tests, shoulder-shaking dances, and ghost dances.

Application scenarios for Animate Anyone

  • Animate characters: Whether it's a real person, anime character, cartoon character, or humanoid object, Animate Anyone can bring them to life, adding fun to all kinds of creative projects.
  • Fashion Video Compositing: In the fashion industry, Animate Anyone can transform static models into dynamic displays, achieving dynamic presentations from different angles and with varying clothing effects, providing a new visual experience for clothing displays.
  • Human Dance Generation: Animate Anyone can generate realistic dance videos by combining reference images and pose skeletal animation, making even the most ordinary characters dance.

How to use Animate Anyone

Animate Anyone's project homepage ishttps://humanaigc.github.io/animate-anyone/The GitHub repository address ishttps://github.com/HumanAIGC/AnimateAnyoneYou can quickly experience it online through the Tongyi Qianwen APP or Hugging Face:

  1. Hugging Face Community Demo: Visithttps://huggingface.co/spaces/xunsong/Moore-AnimateAnyoneUpload or drag and drop an image, add a dynamic pose graph, adjust the parameters, and then click Animate to animate the character in the image.
  2. Tongyi Thousand Questions: Install the Tongyi Thousand Questions APP on your phone, then select "Dance with a Photo" in the command center or directly enter "Tongyi Dance King". Choose the dance template you are interested in, upload a static photo, and you can generate a dynamic video.