ONNX Model Zoo

Kelton/heygem

By Kelton · ↓ 0 · ♥ 6 · Updated 2025-04-02

What's in this repo

This page lists the files in Kelton/heygem, including face_attr_epoch_12_220318.onnx, model_float32.onnx, pfpld_robust_sim_bs1_8003.onnx and more.

  • 7 ONNX models (.onnx files)
  • 134 files, including 80 .so, 29 .py, 7 .onnx, 4 .txt, 2 .md, 2 .yaml
  • Last updated 2025-04-02

ONNX files

File Size Download
face_attr_detect/face_attr_epoch_12_220318.onnx — Download
face_detect_utils/resources/model_float32.onnx — Download
face_detect_utils/resources/pfpld_robust_sim_bs1_8003.onnx — Download
face_detect_utils/resources/scrfd_500m_bnkps_shape640x640.onnx — Download
pretrain_models/face_lib/face_parsing/79999_iter.onnx — Download
pretrain_models/face_lib/face_restore/gfpgan/GFPGANv1.4.onnx — Download
xseg/xseg_211104_4790000.onnx — Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

License Python Linux

中文 | English


HeyGem-Linux-Python-Hack

项目简介

[HeyGem-Linux-Python-Hack] 是一个基于 Python 的数字人项目,它从 HeyGem.ai 中提取出来,它能够直接在 Linux 系统上运行,摆脱了对 Docker 和 Windows 系统的依赖。我们的目标是提供一个更易于部署和使用的数字人解决方案。

如果你觉得这个项目对你有帮助,欢迎给我们 Star!
如果运行过程中遇到问题,在查阅已有 Issue 后,在查阅 Google/baidu/ai 后,欢迎提交 Issues!

主要特性

  • 无需 Docker: 直接在 Linux 系统上运行,简化部署流程。
  • 无需 Windows: 完全基于 Linux 开发和测试。
  • Python 驱动: 使用 Python 语言开发,易于理解和扩展。
  • 开发者友好: 易于使用和扩展。
  • 完全离线。

开始使用

安装

本项目支持且仅支持 Linux & python3.8 环境
请确保你的 Linux 系统上已经安装了 Python 3.8。然后,使用 pip 安装项目依赖项
同时也提供一个备用的环境 requirements_0.txt,遇到问题的话,你可以参考它来建立一个新的环境。
具体的 onnxruntime-gpu / torch 等需要结合你的机器上的 cuda 版本去尝试一些组合,否则仍旧可能遇到问题。
请尽量不要询问任何关于 pip 的问题,感谢合作

# 直接安装整个 requirements.txt 不一定成功,更建议跑代码观察报错信息,然后根据报错信息结合 requirements 去尝试安装,祝你顺利。
# pip install -r requirements.txt

使用

把项目克隆到本地

git clone https://github.com/Holasyb918/HeyGem-Linux-Python-Hack
cd HeyGem-Linux-Python-Hack
bash download.sh
开始使用
  • repo 中已提供可以用于 demo 的音视频样例,代码可以直接运行。
command:
python run.py 
  • 如果要使用自己的数据,可以外部传入参数,请注意,path 是本地文件,且仅支持相对路径.
command:
python run.py --audio_path example/audio.wav --video_path example/video.mp4
gradio:
python app.py
# 请等待模型初始化完成后提交任务

Contributing

欢迎贡献!

License

参考 heyGem.ai 的协议.

Model info

onnx region:us
↓ 0 ♥ 6

Created: 2025-04-02

Updated: 2025-04-02

View on Hugging Face

Files (134)

.gitattributes
README.md
README_en.md
app.py
config/config.ini
download.sh
example/audio.wav
example/video.mp4
face_attr_detect/.DS_Store
face_attr_detect/__init__.py
face_attr_detect/face_attr.cpython-38-x86_64-linux-gnu.so
face_attr_detect/face_attr_epoch_12_220318.onnx ONNX
face_detect_utils/__init__.py
face_detect_utils/face_detect.cpython-38-x86_64-linux-gnu.so
face_detect_utils/head_pose.cpython-38-x86_64-linux-gnu.so
face_detect_utils/resources/model_float32.onnx ONNX
face_detect_utils/resources/pfpld_robust_sim_bs1_8003.onnx ONNX
face_detect_utils/resources/scrfd_500m_bnkps_shape640x640.onnx ONNX
face_detect_utils/scrfd.cpython-38-x86_64-linux-gnu.so
face_lib/__init__.py
face_lib/face_detect_and_align/__init__.py
face_lib/face_detect_and_align/face_align_5_landmarks.cpython-38-x86_64-linux-gnu.so
face_lib/face_detect_and_align/face_align_utils.cpython-38-x86_64-linux-gnu.so
face_lib/face_detect_and_align/scrfd_insightface/__init__.py
face_lib/face_detect_and_align/scrfd_insightface/scrfd.cpython-38-x86_64-linux-gnu.so
face_lib/face_parsing/__init__.py
face_lib/face_parsing/face_parsing_api.cpython-38-x86_64-linux-gnu.so
face_lib/face_restore/__init__.py
face_lib/face_restore/gfpgan_onnx/gfpgan_onnx_api.cpython-38-x86_64-linux-gnu.so
h_utils/__init__.py
h_utils/custom.cpython-38-x86_64-linux-gnu.so
h_utils/obs_client.cpython-38-x86_64-linux-gnu.so
h_utils/request_utils.cpython-38-x86_64-linux-gnu.so
h_utils/sweep_bot.cpython-38-x86_64-linux-gnu.so
h_utils/zip_utils.cpython-38-x86_64-linux-gnu.so
landmark2face_wy/audio_handler.cpython-38-x86_64-linux-gnu.so
landmark2face_wy/checkpoints/anylang/dinet_v1_20240131.pth
landmark2face_wy/checkpoints/test/opt.txt
landmark2face_wy/data/Facereala3dmm_dataset.cpython-38-x86_64-linux-gnu.so
landmark2face_wy/data/Facereala3dmmexp512_dataset.py
landmark2face_wy/data/Facereala3dmmexpwenet512_dataset.py
landmark2face_wy/data/__init__.py
landmark2face_wy/data/base_dataset.cpython-38-x86_64-linux-gnu.so
landmark2face_wy/data/image_folder.cpython-38-x86_64-linux-gnu.so
landmark2face_wy/data/l2faceaudio512_dataset.py
landmark2face_wy/data/l2faceaudio_dataset.py
landmark2face_wy/digitalhuman_interface.cpython-38-x86_64-linux-gnu.so
landmark2face_wy/loss/__init__.py
landmark2face_wy/loss/perceptual.cpython-38-x86_64-linux-gnu.so
landmark2face_wy/models/DINet.cpython-38-x86_64-linux-gnu.so
landmark2face_wy/models/__init__.py
landmark2face_wy/models/base_function.cpython-38-x86_64-linux-gnu.so
landmark2face_wy/models/base_model.cpython-38-x86_64-linux-gnu.so
landmark2face_wy/models/face3d2face_model.cpython-38-x86_64-linux-gnu.so
landmark2face_wy/models/face_model.cpython-38-x86_64-linux-gnu.so
landmark2face_wy/models/l2faceaudio_model.cpython-38-x86_64-linux-gnu.so
landmark2face_wy/models/networks.cpython-38-x86_64-linux-gnu.so
landmark2face_wy/models/networks_HD.cpython-38-x86_64-linux-gnu.so
landmark2face_wy/models/networks_pix2pixHD.cpython-38-x86_64-linux-gnu.so
landmark2face_wy/models/pirender_3dmm_mouth_hd_model.cpython-38-x86_64-linux-gnu.so
landmark2face_wy/models/pirender_3dmm_mouth_hdv2_model.cpython-38-x86_64-linux-gnu.so
landmark2face_wy/options/__init__.py
landmark2face_wy/options/base_options.cpython-38-x86_64-linux-gnu.so
landmark2face_wy/options/test_options.cpython-38-x86_64-linux-gnu.so
landmark2face_wy/options/train_options.cpython-38-x86_64-linux-gnu.so
landmark2face_wy/sync_batchnorm/__init__.py
landmark2face_wy/sync_batchnorm/batchnorm.cpython-38-x86_64-linux-gnu.so
landmark2face_wy/sync_batchnorm/batchnorm_reimpl.cpython-38-x86_64-linux-gnu.so
landmark2face_wy/sync_batchnorm/comm.cpython-38-x86_64-linux-gnu.so
landmark2face_wy/sync_batchnorm/replicate.cpython-38-x86_64-linux-gnu.so
landmark2face_wy/sync_batchnorm/unittest.cpython-38-x86_64-linux-gnu.so
landmark2face_wy/test_3dmm_multi_exp_wenet.cpython-38-x86_64-linux-gnu.so
landmark2face_wy/test_3dmm_multi_exp_wenet0.cpython-38-x86_64-linux-gnu.so
landmark2face_wy/util/__init__.py
landmark2face_wy/util/flow_util.cpython-38-x86_64-linux-gnu.so
landmark2face_wy/util/get_data.cpython-38-x86_64-linux-gnu.so
landmark2face_wy/util/html.cpython-38-x86_64-linux-gnu.so
landmark2face_wy/util/image_pool.cpython-38-x86_64-linux-gnu.so
landmark2face_wy/util/util.cpython-38-x86_64-linux-gnu.so
landmark2face_wy/util/visualizer.cpython-38-x86_64-linux-gnu.so
license.txt
log/dh.log
model_lib/__init__.py
model_lib/base_wrapper/__init__.py
model_lib/base_wrapper/onnx_model.cpython-38-x86_64-linux-gnu.so
model_lib/model_base.py
pack/packaging_script.py
preprocess_audio_and_3dmm.cpython-38-x86_64-linux-gnu.so
pretrain_models/face_lib/face_parsing/79999_iter.onnx ONNX
requirements.txt
requirements_0.txt
run.py
service/__init__.py
service/server.cpython-38-x86_64-linux-gnu.so
service/trans_dh_service.cpython-38-x86_64-linux-gnu.so
sources.list
wenet/compute_ctc_att_bnf.cpython-38-x86_64-linux-gnu.so
wenet/examples/aishell/aidata/conf/train_conformer_multi_cn.yaml
wenet/examples/aishell/aidata/conf/train_conformer_multi_cn_linear.yaml
wenet/examples/aishell/aidata/exp/conformer/wenetmodel.pt
wenet/tools/_extract_feats.py
wenet/transformer/__init__.py
wenet/transformer/asr_model.cpython-38-x86_64-linux-gnu.so
wenet/transformer/attention.cpython-38-x86_64-linux-gnu.so
wenet/transformer/cmvn.cpython-38-x86_64-linux-gnu.so
wenet/transformer/convolution.cpython-38-x86_64-linux-gnu.so
wenet/transformer/ctc.cpython-38-x86_64-linux-gnu.so
wenet/transformer/decoder.cpython-38-x86_64-linux-gnu.so
wenet/transformer/decoder_layer.cpython-38-x86_64-linux-gnu.so
wenet/transformer/embedding.cpython-38-x86_64-linux-gnu.so
wenet/transformer/encoder.cpython-38-x86_64-linux-gnu.so
wenet/transformer/encoder_layer.cpython-38-x86_64-linux-gnu.so
wenet/transformer/label_smoothing_loss.cpython-38-x86_64-linux-gnu.so
wenet/transformer/positionwise_feed_forward.cpython-38-x86_64-linux-gnu.so
wenet/transformer/subsampling.cpython-38-x86_64-linux-gnu.so
wenet/transformer/swish.cpython-38-x86_64-linux-gnu.so
wenet/utils/checkpoint.cpython-38-x86_64-linux-gnu.so
wenet/utils/cmvn.py
wenet/utils/common.cpython-38-x86_64-linux-gnu.so
wenet/utils/ctc_util.cpython-38-x86_64-linux-gnu.so
wenet/utils/executor.cpython-38-x86_64-linux-gnu.so
wenet/utils/mask.cpython-38-x86_64-linux-gnu.so
wenet/utils/scheduler.cpython-38-x86_64-linux-gnu.so
xseg/dfl_xseg_api.cpython-38-x86_64-linux-gnu.so
xseg/xseg_211104_4790000.onnx ONNX
y_utils/__init__.py
y_utils/config.cpython-38-x86_64-linux-gnu.so
y_utils/lcr.cpython-38-x86_64-linux-gnu.so
y_utils/liblcr.so
y_utils/logger.cpython-38-x86_64-linux-gnu.so
y_utils/md5.cpython-38-x86_64-linux-gnu.so
y_utils/time_utils.cpython-38-x86_64-linux-gnu.so
y_utils/tools.cpython-38-x86_64-linux-gnu.so

Related models