meageropoulos/V-Express_dup
By meageropoulos · ↓ 15 · ♥ 0 · Updated 2025-02-16
What's in this repo
This page lists the files in meageropoulos/V-Express_dup, including 2d106det.onnx, det_10g.onnx, genderage.onnx and more.
- 4 ONNX models (.onnx files)
- 23 files, including 8 .json, 7 .bin, 4 .onnx, 1 .md
- Last updated 2025-02-16
ONNX files
| File | Size | Download |
|---|---|---|
| model_ckpts/insightface_models/models/buffalo_l/2d106det.onnx | — | Download |
| model_ckpts/insightface_models/models/buffalo_l/det_10g.onnx | — | Download |
| model_ckpts/insightface_models/models/buffalo_l/genderage.onnx | — | Download |
| model_ckpts/insightface_models/models/buffalo_l/w600k_r50.onnx | — | Download |
How to use
These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.
README
V-Express Model Card
Project Page | Paper | Code
Introduction
Models
Audio Encoder
- model_ckpts/wav2vec2-base-960h. (It is also available from the original model card facebook/wav2vec2-base-960h)
Face Analysis
- model_ckpts/insightface_models/models/buffalo_l. (It is also available from the original repository insightface/buffalo_l)
V-Express
- model_ckpts/sd-vae-ft-mse. VAE encoder. (original model card stabilityai/sd-vae-ft-mse)
- model_ckpts/stable-diffusion-v1-5. Only the model configuration file for unet is needed here. (original model card runwayml/stable-diffusion-v1-5)
- model_ckpts/v-express. The video generation model conditional on audio and V-kps we call V-Express.
- You should download and put all
.binmodel tomodel_ckpts/v-expressdirectory, which includesaudio_projection.bin,denoising_unet.bin,motion_module.bin,reference_net.bin, andv_kps_guider.bin.
Model info
text-to-image
diffusers
diffusers
onnx
text-to-image
stable-diffusion
audio-to-video
en
arxiv:2406.02511
license:apache-2.0
region:us
↓ 15
♥ 0
Created: 2025-02-16
Updated: 2025-02-16
View on Hugging FaceFiles (23)
.gitattributes
README.md
audio_projection.bin
denoising_unet.bin
gitattributes
model_ckpts/insightface_models/models/buffalo_l/2d106det.onnx
ONNX
model_ckpts/insightface_models/models/buffalo_l/det_10g.onnx
ONNX
model_ckpts/insightface_models/models/buffalo_l/genderage.onnx
ONNX
model_ckpts/insightface_models/models/buffalo_l/w600k_r50.onnx
ONNX
model_ckpts/sd-vae-ft-mse/config.json
model_ckpts/sd-vae-ft-mse/diffusion_pytorch_model.bin
model_ckpts/stable-diffusion-v1-5/unet/config.json
model_ckpts/v-express/put_vexpress_bin_here
model_ckpts/wav2vec2-base-960h/config.json
model_ckpts/wav2vec2-base-960h/feature_extractor_config.json
model_ckpts/wav2vec2-base-960h/preprocessor_config.json
model_ckpts/wav2vec2-base-960h/pytorch_model.bin
model_ckpts/wav2vec2-base-960h/special_tokens_map.json
model_ckpts/wav2vec2-base-960h/tokenizer_config.json
model_ckpts/wav2vec2-base-960h/vocab.json
motion_module.bin
reference_net.bin
v_kps_guider.bin