llmware/phi-3-onnx

By llmware · ↓ 2 · ♥ 1 · Updated 2024-10-31

What's in this repo

This page lists the files in llmware/phi-3-onnx, including model.onnx.

1 ONNX models (.onnx files)
11 files, including 6 .json, 1 .txt, 1 .md, 1 .onnx, 1 .data
Last updated 2024-10-31

ONNX files

File	Size	Download
model.onnx	—	Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

phi-3-onnx

phi-3-onnx is an ONNX int4 quantized version of Microsoft Phi-3-mini-4k-instruct, providing a very fast, very small inference implementation, optimized for AI PCs using Intel GPU, CPU and NPU.

Model Description

Developed by: microsoft
Quantized by: llmware
Model type: phi3
Parameters: 3.8 billion
Model Parent: microsoft/Phi-3-mini-4k-instruct
Language(s) (NLP): English
License: Apache 2.0
Uses: Chat, general-purpose LLM
Quantization: int4

Model Card Contact

llmware on hf

llmware website

Model info

onnx phi3 green llmware-chat p3 custom_code base_model:microsoft/Phi-3-mini-4k-instruct base_model:quantized:microsoft/Phi-3-mini-4k-instruct license:apache-2.0 region:us

↓ 2 ♥ 1

Created: 2024-09-03

Updated: 2024-10-31

View on Hugging Face

Files (11)

.gitattributes

LICENSE.txt

README.md

config.json

genai_config.json

hash_record_sha256.json

model.onnx ONNX

model.onnx.data

special_tokens_map.json

tokenizer.json

tokenizer_config.json

Related models

More models

No task type declared.