Skywork/SkyReels-A1
By Skywork · ↓ 41 · ♥ 66 · Updated 2025-03-04
What's in this repo
This page lists the files in Skywork/SkyReels-A1, including 1k3d68.onnx, 2d106det.onnx, genderage.onnx and more.
- 10 ONNX models (.onnx files)
- 68 files, including 15 .json, 10 .onnx, 7 .npy, 6 .safetensors, 4 .pth, 4 .pkl
- Last updated 2025-03-04
ONNX files
| File | Size | Download |
|---|---|---|
| eval/face_encoder/models/antelopev2/1k3d68.onnx | — | Download |
| eval/face_encoder/models/antelopev2/2d106det.onnx | — | Download |
| eval/face_encoder/models/antelopev2/genderage.onnx | — | Download |
| eval/face_encoder/models/antelopev2/glintr100.onnx | — | Download |
| eval/face_encoder/models/antelopev2/scrfd_10g_bnkps.onnx | — | Download |
| eval/face_encoder/models/buffalo_l/1k3d68.onnx | — | Download |
| eval/face_encoder/models/buffalo_l/2d106det.onnx | — | Download |
| eval/face_encoder/models/buffalo_l/det_10g.onnx | — | Download |
| eval/face_encoder/models/buffalo_l/genderage.onnx | — | Download |
| eval/face_encoder/models/buffalo_l/w600k_r50.onnx | — | Download |
How to use
These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.
README
SkyReels-A1: Expressive Portrait Animation in Video Diffusion Transformers
🌐 Github · 👋 Playground · Discord
This repo contains Diffusers style model weights for Skyreels A1 models. You can find the inference code on SkyReels-A1 repository.
🔥🔥🔥 News!!
- Mar 4, 2025: 🎉 We release audio-driven portrait image animation pipeline. SkyReels-A1
- Feb 18, 2025: 👋 We release the inference code and model weights of SkyReels-A1.
- Feb 18, 2025: 🔥 We have open-sourced I2V video generation model SkyReels-V1. This is the first and most advanced open-source human-centric video foundation model.
Overview of SkyReels-A1 framework. Given an input video sequence and a reference portrait image, we extract facial expression-aware landmarks from the video, which serve as motion descriptors for transferring expressions onto the portrait. Utilizing a conditional video generation framework based on DiT, our approach directly integrates these facial expression-aware landmarks into the input latent space. In alignment with prior research, we employ a pose guidance mechanism constructed within a VAE architecture. This component encodes facial expression-aware landmarks as conditional input for the DiT framework, thereby enabling the model to capture essential low- dimensional visual attributes while preserving the semantic integrity of facial features.
Some generated results:
Citation
If you find SkyReels-A1 useful for your research, welcome to cite our work using the following BibTeX:
@article{qiu2025skyreels,
title={SkyReels-A1: Expressive Portrait Animation in Video Diffusion Transformers},
author={Qiu, Di and Fei, Zhengcong and Wang, Rui and Bai, Jialin and Yu, Changqian and Fan, Mingyuan and Chen, Guibin and Wen, Xiang},
journal={arXiv preprint arXiv:2502.10841},
year={2025}
}
Model info
Created: 2025-02-13
Updated: 2025-03-04
View on Hugging FaceFiles (68)
Related models
More from Skywork
No other models by this author.