aless2212/Mistral-7B-Instruct-v0.2-onnx-fp16

By aless2212 · ↓ 2 · ♥ 0 · Updated 2024-03-23

What's in this repo

This page lists the files in aless2212/Mistral-7B-Instruct-v0.2-onnx-fp16, including model_optimized.onnx.

1 ONNX models (.onnx files)
10 files, including 5 .json, 1 .md, 1 .onnx, 1 .data, 1 .model
Last updated 2024-03-23

ONNX files

File	Size	Download
model_optimized.onnx	—	Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

see the instructions there. The fp32 can be probably used with CPU. fp16 is only gpu. all conversion done on an RX7600 8GB with my custom versions of PyTorch and Onnxruntime. https://huggingface.co/aless2212/Mistral-7B-Instruct-v0.2-onnx-fp32

Model info

text-generation transformers

transformers onnx mistral text-generation conversational license:apache-2.0 endpoints_compatible region:us

↓ 2 ♥ 0

Created: 2024-03-23

Updated: 2024-03-23

View on Hugging Face

Files (10)

.gitattributes

README.md

config.json

model_optimized.onnx ONNX

model_optimized.onnx.data

ort_config.json

special_tokens_map.json

tokenizer.json

tokenizer.model

tokenizer_config.json

Related models

More text-generation models

Browse all text-generation models