UniAnimate: 统一视频扩散模型实现一致性人体图像动画

本仓库包含 UniAnimate 的模型权重：

• "models/dw-ll_ucoco_384.onnx"：用于 dwpose 提取的模型权重。

• "models/open_clip_pytorch_model.bin"：用于 clip 嵌入的模型权重。

• "models/unianimate_16f_32f_non_ema_223000.pth"：UniAnimate 人体图像动画的模型权重（16/32 帧）。

• "models/yolox_l.onnx"：用于 dwpose 提取的模型权重。

• "models/v2-1_512-ema-pruned.ckpt"：Stable Diffusion 的模型权重。

BibTeX

如果本仓库对您有帮助，请引用我们的相关技术论文。

@article{wang2024unianimate,
      title={UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animation},
      author={Wang, Xiang and Zhang, Shiwei and Gao, Changxin and Wang, Jiayu and Zhou, Xiaoqiang and Zhang, Yingya and Yan, Luxin and Sang, Nong},
      journal={arXiv preprint arXiv:2406.01188},
      year={2024}
}
@inproceedings{TFT2V,
      title={A Recipe for Scaling up Text-to-Video Generation with Text-free Videos},
      author={Wang, Xiang and Zhang, Shiwei and Yuan, Hangjie and Qing, Zhiwu and Gong, Biao and Zhang, Yingya and Shen, Yujun and Gao, Changxin and Sang, Nong},
      booktitle={CVPR},
      year={2024}
}
@article{VideoComposer,
      title={VideoComposer: Compositional Video Synthesis with Motion Controllability},
      author={Wang, Xiang and Yuan, Hangjie and Zhang, Shiwei and Chen, Dayou and Wang, Jiuniu and Zhang, Yingya and Shen, Yujun and Zhao, Deli and Zhou, Jingren},
      journal={NeurIPS},
      year={2023}
}