lokinfey/Fara-7B-ONNX-INT4-CPU

By lokinfey · ↓ 0 · ♥ 0 · Updated 2025-12-21

What's in this repo

This page lists the files in lokinfey/Fara-7B-ONNX-INT4-CPU, including model.onnx.

1 ONNX models (.onnx files)
12 files, including 6 .json, 1 .md, 1 .jinja, 1 .txt, 1 .onnx, 1 .data
Last updated 2025-12-21

ONNX files

File	Size	Download
model.onnx	—	Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

This is a quantized INT4 model based on X86 CPU Fara-7B. You can deploy it on your CPU devices.

Note: This is unoffical version,just for test and dev.

Model info

onnx license:mit region:us

↓ 0 ♥ 0

Created: 2025-12-21

Updated: 2025-12-21

View on Hugging Face

Files (12)

.gitattributes

README.md

added_tokens.json

chat_template.jinja

genai_config.json

merges.txt

model.onnx ONNX

model.onnx.data

special_tokens_map.json

tokenizer.json

tokenizer_config.json

vocab.json

Related models

More models

No task type declared.