liuhuadai/AudioLCM
By liuhuadai · ↓ 2 · ♥ 9 · Updated 2024-06-06
What's in this repo
This page lists the files in liuhuadai/AudioLCM, including model.onnx.
- 1 ONNX models (.onnx files)
- 38 files, including 8 .json, 4 .yaml, 3 .md, 3 .ckpt, 3 .bin, 2 .msgpack
- Last updated 2024-06-06
ONNX files
| File | Size | Download |
|---|---|---|
| useful_ckpt/bert-base-uncased/model.onnx | — | Download |
How to use
These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.
README
🎵🎵🎵AudioLCM：Text-to-Audio Generation with Latent Consistency Models
We develop AudioLCM building on LCM (latent consistency models) for text-to-audio generation.
code
Our code is released here : https://github.com/liuhuadai/AudioLCM)
Please follow the instructions in the repository for installation, usage and experiments.
Quickstart Guide
Download the AudioLCM model and generate audio from a text prompt:
from pythonscripts.InferAPI import AudioLCMInfer
prompt="Constant rattling noise and sharp vibrations"
config_path="./audiolcm.yaml"
model_path="./audiolcm.ckpt"
vocoder_path="./model/vocoder"
audio_path = AudioLCMInfer(prompt, config_path=config_path, model_path=model_path, vocoder_path=vocoder_path)
Use the AudioLCMBatchInfer function to generate multiple audio samples for a batch of text prompts:
from pythonscripts.InferAPI import AudioLCMBatchInfer
prompts=[
"Constant rattling noise and sharp vibrations",
"A rocket flies by followed by a loud explosion and fire crackling as a truck engine runs idle",
"Humming and vibrating with a man and children speaking and laughing"
]
config_path="./audiolcm.yaml"
model_path="./audiolcm.ckpt"
vocoder_path="./model/vocoder"
audio_path = AudioLCMBatchInfer(prompts, config_path=config_path, model_path=model_path, vocoder_path=vocoder_path)
DEMO
🎵🎵Welcome to try our demo🎵🎵: https://huggingface.co/spaces/AIGC-Audio/AudioLCM
Model info
Created: 2024-06-05
Updated: 2024-06-06
View on Hugging FaceFiles (38)
Related models
More from liuhuadai
No other models by this author.