ONNX 模型库
返回模型

说明文档

<h1 align='Center'>Hallo:面向肖像图像动画的分层音频驱动视觉合成</h1>

<div align='Center'> <a href='https://github.com/xumingw' target='_blank'>Mingwang Xu</a><sup>1*</sup>  <a href='https://github.com/crystallee-ai' target='_blank'>Hui Li</a><sup>1*</sup>  <a href='https://github.com/subazinga' target='_blank'>Qingkun Su</a><sup>1*</sup>  <a href='https://github.com/NinoNeumann' target='_blank'>Hanlin Shang</a><sup>1</sup>  <a href='https://github.com/AricGamma' target='_blank'>Liwei Zhang</a><sup>1</sup>  <a href='https://github.com/cnexah' target='_blank'>Ce Liu</a><sup>3</sup>  </div> <div align='center'> <a href='https://jingdongwang2017.github.io/' target='_blank'>Jingdong Wang</a><sup>2</sup>  <a href='https://yoyo000.github.io/' target='_blank'>Yao Yao</a><sup>4</sup>  <a href='https://sites.google.com/site/zhusiyucs/home' target='_blank'>Siyu Zhu</a><sup>1</sup>  </div>

<div align='Center'> <sup>1</sup>复旦大学  <sup>2</sup>百度公司  <sup>3</sup>苏黎世联邦理工学院  <sup>4</sup>南京大学 </div>

<br> <div align='center'> <a href='https://github.com/fudan-generative-vision/hallo'><img src='https://img.shields.io/github/stars/fudan-generative-vision/hallo?style=social'></a> <a href='https://fudan-generative-vision.github.io/hallo/#/'><img src='https://img.shields.io/badge/Project-HomePage-Green'></a> <a href='https://arxiv.org/pdf/2406.08801'><img src='https://img.shields.io/badge/Paper-Arxiv-red'></a> <a href='https://huggingface.co/fudan-generative-ai/hallo'><img src='https://img.shields.io/badge/%F0%9F%A4%97%20HuggingFace-Model-yellow'></a> <a href='assets/wechat.jpeg'><img src='https://badges.aleen42.com/src/wechat.svg'></a> </div>

<br>

社会风险与缓解措施

由音频驱动的肖像图像动画技术的发展带来了社会风险,例如创建逼真肖像可能被滥用于深度伪造(deepfakes)所带来的伦理问题。为缓解这些风险,建立伦理准则和负责任的使用实践至关重要。使用个人图像和声音还会引发隐私和同意方面的担忧。解决这些问题需要透明的数据使用政策、知情同意以及保护隐私权。通过应对这些风险并实施缓解措施,本研究旨在确保该技术的负责任和合乎伦理的发展。

fudan-generative-ai/hallo

作者 fudan-generative-ai

diffusers
↓ 0 ♥ 97

创建时间: 2024-06-22 04:05:34+00:00

更新时间: 2024-07-11 04:22:31+00:00

在 Hugging Face 上查看

文件 (30)

.gitattributes
README.md
audio_separator/Kim_Vocal_2.onnx ONNX
audio_separator/download_checks.json
audio_separator/mdx_model_data.json
audio_separator/vr_model_data.json
config.json
face_analysis/models/1k3d68.onnx ONNX
face_analysis/models/2d106det.onnx ONNX
face_analysis/models/face_landmarker_v2_with_blendshapes.task
face_analysis/models/genderage.onnx ONNX
face_analysis/models/glintr100.onnx ONNX
face_analysis/models/scrfd_10g_bnkps.onnx ONNX
hallo/net.pth
motion_module/mm_sd_v15_v2.ckpt
sd-vae-ft-mse/.gitattributes
sd-vae-ft-mse/README.md
sd-vae-ft-mse/config.json
sd-vae-ft-mse/diffusion_pytorch_model.safetensors
stable-diffusion-v1-5/unet/config.json
stable-diffusion-v1-5/unet/diffusion_pytorch_model.safetensors
wav2vec/wav2vec2-base-960h/.gitattributes
wav2vec/wav2vec2-base-960h/README.md
wav2vec/wav2vec2-base-960h/config.json
wav2vec/wav2vec2-base-960h/feature_extractor_config.json
wav2vec/wav2vec2-base-960h/model.safetensors
wav2vec/wav2vec2-base-960h/preprocessor_config.json
wav2vec/wav2vec2-base-960h/special_tokens_map.json
wav2vec/wav2vec2-base-960h/tokenizer_config.json
wav2vec/wav2vec2-base-960h/vocab.json