lwanming/Phi3-mini-4k-instruct-static
By lwanming · ↓ 0 · ♥ 0 · Updated 2024-11-07
What's in this repo
This page lists the files in lwanming/Phi3-mini-4k-instruct-static, including 1_prefill_INT4_128.onnx, 1_prefill_INT4_128_fp16.onnx, 2_decode_INT4_128.onnx and more.
- 10 ONNX models (.onnx files)
- 21 files, including 10 .onnx, 10 .data
- Last updated 2024-11-07
ONNX files
| File | Size | Download |
|---|---|---|
| 1_prefill_INT4_128.onnx | — | Download |
| 1_prefill_INT4_128_fp16.onnx | — | Download |
| 2_decode_INT4_128.onnx | — | Download |
| 2_decode_INT4_128_fp16.onnx | — | Download |
| Phi_3_mini_4k_instruct_decoder_static_kvcache_simplifiedlayernorm.onnx | — | Download |
| Phi_3_mini_4k_instruct_decoder_static_kvcache_simplifiedlayernorm_fp16.onnx | — | Download |
| Phi_3_mini_4k_instruct_static_kvcache_uint4_simlayernorm.onnx | — | Download |
| Phi_3_mini_4k_instruct_static_kvcache_uint4_simlayernorm_fp16.onnx | — | Download |
| Phi_3_mini_4k_instruct_static_kvcache_uint4_sink_simlayernorm.onnx | — | Download |
| Phi_3_mini_4k_instruct_static_kvcache_uint4_sink_simlayernorm_fp16.onnx | — | Download |
How to use
These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.
No README provided by the author.
Files (21)
.gitattributes
1_prefill_INT4_128.onnx
ONNX
1_prefill_INT4_128.onnx.data
1_prefill_INT4_128_fp16.onnx
ONNX
1_prefill_INT4_128_fp16.onnx.data
2_decode_INT4_128.onnx
ONNX
2_decode_INT4_128.onnx.data
2_decode_INT4_128_fp16.onnx
ONNX
2_decode_INT4_128_fp16.onnx.data
Phi_3_mini_4k_instruct_decoder_static_kvcache_simplifiedlayernorm.onnx
ONNX
Phi_3_mini_4k_instruct_decoder_static_kvcache_simplifiedlayernorm.onnx.data
Phi_3_mini_4k_instruct_decoder_static_kvcache_simplifiedlayernorm_fp16.onnx
ONNX
Phi_3_mini_4k_instruct_decoder_static_kvcache_simplifiedlayernorm_fp16.onnx.data
Phi_3_mini_4k_instruct_static_kvcache_uint4_simlayernorm.onnx
ONNX
Phi_3_mini_4k_instruct_static_kvcache_uint4_simlayernorm.onnx.data
Phi_3_mini_4k_instruct_static_kvcache_uint4_simlayernorm_fp16.onnx
ONNX
Phi_3_mini_4k_instruct_static_kvcache_uint4_simlayernorm_fp16.onnx.data
Phi_3_mini_4k_instruct_static_kvcache_uint4_sink_simlayernorm.onnx
ONNX
Phi_3_mini_4k_instruct_static_kvcache_uint4_sink_simlayernorm.onnx.data
Phi_3_mini_4k_instruct_static_kvcache_uint4_sink_simlayernorm_fp16.onnx
ONNX
Phi_3_mini_4k_instruct_static_kvcache_uint4_sink_simlayernorm_fp16.onnx.data
Related models
More from lwanming
More models
No task type declared.