返回模型

说明文档

license: mit language:

en
zh base_model:
Qwen/Qwen2.5-Omni-3B pipeline_tag: image-text-to-text library_name: transformers tags:
Qwen2.5-Omni
Qwen2.5-Omni-3B
Int8
Omni

Qwen2.5-Omni-3B

本版本的 Qwen2.5-Omni-3B 已转换为在 Axera NPU 上运行，采用 w8a16 量化。

兼容 Pulsar2 版本：3.4

转换工具链接：

对于对模型转换感兴趣的用户，可以通过原始仓库尝试导出 axmodel： https://huggingface.co/Qwen/Qwen2.5-Omni-3B

Pulsar2 链接，如何将 LLM 从 Huggingface 转换为 axmodel

AXera NPU HOST LLM 运行时

支持平台

AX650
- AX650N DEMO 板
- M4N-Dock（爱芯派Pro）
- M.2 加速卡

音频处理 待补充

图像处理 待补充

视频处理 待补充

DDR 容量指的是需要消耗的 CMM 内存。请确保开发板上的 CMM 内存分配大于此值。

如何使用

将本仓库中的所有文件下载到设备上

如果您使用的是 AX650 开发板

(base) lihongjie@ai-dev1:~/axera-tech/Qwen2.5-Omni-3B$ tree -L 2
.
├── python
│   ├── modeling_axinfer.py
│   ├── preprocess.py
│   ├── run_axinfer.py
│   ├── utils_axinfer.py
│   ├── utils_lm.py
│   ├── utils.py
│   └── utils_vl.py
├── Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512
│   ├── config.json
│   ├── qwen2_5_omni_talker_p128_l0_together.axmodel
......
│   ├── qwen2_5_omni_talker_post.axmodel
│   ├── special_tokens_map.json
│   ├── spk_dict.pt
│   ├── thinker_to_talker_proj_decode.axmodel
│   ├── thinker_to_talker_proj_prefill_512.axmodel
│   ├── token2wav_bigvgan.axmodel
│   ├── token2wav_dit.axmodel
│   ├── tokenizer_config.json
│   ├── tokenizer.json
│   └── vocab.json
├── Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512
│   ├── config.json
......
│   ├── Qwen2.5-Omni-3B_vision.axmodel
│   ├── qwen2_5_omni_text_p128_l0_together.axmodel
......
│   ├── qwen2_5_omni_text_post.axmodel
├── README.md
└── videos

演示

运行命令

cd python
python3 run_axinfer.py

输出

文本

It's a Nord Electro 6 keyboard. It's a really popular one. It has a lot of features like different sounds and effects. Have you played with it much?

音频

AXERA-TECH/Qwen2.5-Omni-3B

作者 AXERA-TECH

image-text-to-text transformers

↓ 0 ♥ 0

创建时间: 2025-08-01 10:45:18+00:00

更新时间: 2025-08-05 06:41:03+00:00

在 Hugging Face 上查看

文件 (109)

.gitattributes

Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512/added_tokens.json

Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512/chat_template.json

Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512/config.json

Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512/configuration.json

Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512/generation_config.json

Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512/merges.txt

Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512/model.embed_tokens.weight.bfloat16.bin

Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512/model.embed_tokens.weight.float32.bin

Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512/model.embed_tokens.weight.npy

Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512/model.safetensors.index.json

Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512/preprocessor_config.json

Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512/qwen2_5_omni_talker_p128_l0_together.axmodel

Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512/qwen2_5_omni_talker_p128_l10_together.axmodel

Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512/qwen2_5_omni_talker_p128_l11_together.axmodel

Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512/qwen2_5_omni_talker_p128_l12_together.axmodel

Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512/qwen2_5_omni_talker_p128_l13_together.axmodel

Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512/qwen2_5_omni_talker_p128_l14_together.axmodel

Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512/qwen2_5_omni_talker_p128_l15_together.axmodel

Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512/qwen2_5_omni_talker_p128_l16_together.axmodel

Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512/qwen2_5_omni_talker_p128_l17_together.axmodel

Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512/qwen2_5_omni_talker_p128_l18_together.axmodel

Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512/qwen2_5_omni_talker_p128_l19_together.axmodel

Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512/qwen2_5_omni_talker_p128_l1_together.axmodel

Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512/qwen2_5_omni_talker_p128_l20_together.axmodel

Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512/qwen2_5_omni_talker_p128_l21_together.axmodel

Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512/qwen2_5_omni_talker_p128_l22_together.axmodel

Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512/qwen2_5_omni_talker_p128_l23_together.axmodel

Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512/qwen2_5_omni_talker_p128_l2_together.axmodel

Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512/qwen2_5_omni_talker_p128_l3_together.axmodel

Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512/qwen2_5_omni_talker_p128_l4_together.axmodel

Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512/qwen2_5_omni_talker_p128_l5_together.axmodel

Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512/qwen2_5_omni_talker_p128_l6_together.axmodel

Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512/qwen2_5_omni_talker_p128_l7_together.axmodel

Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512/qwen2_5_omni_talker_p128_l8_together.axmodel

Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512/qwen2_5_omni_talker_p128_l9_together.axmodel

Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512/qwen2_5_omni_talker_post.axmodel

Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512/special_tokens_map.json

Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512/spk_dict.pt

Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512/thinker_to_talker_proj_decode.onnx ONNX

Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512/thinker_to_talker_proj_prefill_512.onnx ONNX

Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512/token2wav_bigvgan.axmodel

Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512/token2wav_dit.axmodel

Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512/tokenizer.json

Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512/tokenizer_config.json

Qwen2.5-Omni-3B-AX650-talker-chunk_prefill_512/vocab.json

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/Qwen2.5-Omni-3B_vision.axmodel

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/added_tokens.json

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/audio_tower.axmodel

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/chat_template.json

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/config.json

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/configuration.json

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/generation_config.json

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/merges.txt

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/model.embed_tokens.weight.bfloat16.bin

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/model.embed_tokens.weight.float32.bin

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/model.embed_tokens.weight.npy

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/model.safetensors.index.json

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/preprocessor_config.json

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/qwen2_5_omni_text_p128_l0_together.axmodel

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/qwen2_5_omni_text_p128_l10_together.axmodel

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/qwen2_5_omni_text_p128_l11_together.axmodel

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/qwen2_5_omni_text_p128_l12_together.axmodel

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/qwen2_5_omni_text_p128_l13_together.axmodel

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/qwen2_5_omni_text_p128_l14_together.axmodel

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/qwen2_5_omni_text_p128_l15_together.axmodel

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/qwen2_5_omni_text_p128_l16_together.axmodel

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/qwen2_5_omni_text_p128_l17_together.axmodel

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/qwen2_5_omni_text_p128_l18_together.axmodel

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/qwen2_5_omni_text_p128_l19_together.axmodel

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/qwen2_5_omni_text_p128_l1_together.axmodel

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/qwen2_5_omni_text_p128_l20_together.axmodel

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/qwen2_5_omni_text_p128_l21_together.axmodel

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/qwen2_5_omni_text_p128_l22_together.axmodel

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/qwen2_5_omni_text_p128_l23_together.axmodel

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/qwen2_5_omni_text_p128_l24_together.axmodel

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/qwen2_5_omni_text_p128_l25_together.axmodel

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/qwen2_5_omni_text_p128_l26_together.axmodel

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/qwen2_5_omni_text_p128_l27_together.axmodel

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/qwen2_5_omni_text_p128_l28_together.axmodel

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/qwen2_5_omni_text_p128_l29_together.axmodel

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/qwen2_5_omni_text_p128_l2_together.axmodel

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/qwen2_5_omni_text_p128_l30_together.axmodel

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/qwen2_5_omni_text_p128_l31_together.axmodel

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/qwen2_5_omni_text_p128_l32_together.axmodel

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/qwen2_5_omni_text_p128_l33_together.axmodel

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/qwen2_5_omni_text_p128_l34_together.axmodel

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/qwen2_5_omni_text_p128_l35_together.axmodel

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/qwen2_5_omni_text_p128_l3_together.axmodel

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/qwen2_5_omni_text_p128_l4_together.axmodel

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/qwen2_5_omni_text_p128_l5_together.axmodel

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/qwen2_5_omni_text_p128_l6_together.axmodel

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/qwen2_5_omni_text_p128_l7_together.axmodel

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/qwen2_5_omni_text_p128_l8_together.axmodel

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/qwen2_5_omni_text_p128_l9_together.axmodel

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/qwen2_5_omni_text_post.axmodel

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/special_tokens_map.json

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/tokenizer.json

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/tokenizer_config.json

Qwen2.5-Omni-3B-AX650-thinker-chunk_prefill_512/vocab.json

README.md

python/modeling_axinfer.py

python/preprocess.py

python/run_axinfer.py

python/utils.py

python/utils_axinfer.py

python/utils_lm.py

python/utils_vl.py

videos/1.mp4