Felladrin/onnx-Evol-Orca-LaMini-flan-t5-small

By Felladrin · ↓ 2 · ♥ 0 · Updated 2023-11-26

What's in this repo

This page lists the files in Felladrin/onnx-Evol-Orca-LaMini-flan-t5-small, including decoder_model.onnx, decoder_model_merged.onnx, decoder_model_merged_quantized.onnx and more.

8 ONNX models (.onnx files)
17 files, including 8 .onnx, 6 .json, 1 .md, 1 .model
Last updated 2023-11-26

ONNX files

File	Size	Download
onnx/decoder_model.onnx	—	Download
onnx/decoder_model_merged.onnx	—	Download
onnx/decoder_model_merged_quantized.onnx	—	Download
onnx/decoder_model_quantized.onnx	—	Download
onnx/decoder_with_past_model.onnx	—	Download
onnx/decoder_with_past_model_quantized.onnx	—	Download
onnx/encoder_model.onnx	—	Download
onnx/encoder_model_quantized.onnx	—	Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

INT8 ONNX version of sachith-surge/Evol-Orca-LaMini-flan-t5-small to use with Transformers.js.

Example usage

import { pipeline } from '@xenova/transformers';

const generator = await pipeline('text2text-generation', 'Felladrin/onnx-Evol-Orca-LaMini-flan-t5-small');
const output =  await generator("How can I become more healthy?", { add_special_tokens: true, max_new_tokens: 50, repetition_penalty: 1.2});
console.log(output); // 1. Exercise: Exercise can help you stay fit and healthy. It can help you stay fit and...

Model info

transformers.js

transformers.js onnx t5 text2text-generation base_model:sachithgunasekara/Evol-Orca-LaMini-flan-t5-small base_model:quantized:sachithgunasekara/Evol-Orca-LaMini-flan-t5-small region:us

↓ 2 ♥ 0

Created: 2023-11-26

Updated: 2023-11-26

View on Hugging Face

Files (17)

.gitattributes

README.md

config.json

generation_config.json

onnx/decoder_model.onnx ONNX

onnx/decoder_model_merged.onnx ONNX

onnx/decoder_model_merged_quantized.onnx ONNX

onnx/decoder_model_quantized.onnx ONNX

onnx/decoder_with_past_model.onnx ONNX

onnx/decoder_with_past_model_quantized.onnx ONNX

onnx/encoder_model.onnx ONNX

onnx/encoder_model_quantized.onnx ONNX

quantize_config.json

special_tokens_map.json

spiece.model

tokenizer.json

tokenizer_config.json

Related models

More models

No task type declared.