Felladrin/onnx-flan-t5-base-samsum

By Felladrin · ↓ 3 · ♥ 0 · Updated 2023-11-23

What's in this repo

This page lists the files in Felladrin/onnx-flan-t5-base-samsum, including decoder_model.onnx, decoder_model_merged.onnx, decoder_model_merged_quantized.onnx and more.

8 ONNX models (.onnx files)
17 files, including 8 .onnx, 6 .json, 1 .md, 1 .model
Last updated 2023-11-23

ONNX files

File	Size	Download
onnx/decoder_model.onnx	—	Download
onnx/decoder_model_merged.onnx	—	Download
onnx/decoder_model_merged_quantized.onnx	—	Download
onnx/decoder_model_quantized.onnx	—	Download
onnx/decoder_with_past_model.onnx	—	Download
onnx/decoder_with_past_model_quantized.onnx	—	Download
onnx/encoder_model.onnx	—	Download
onnx/encoder_model_quantized.onnx	—	Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

INT8 ONNX version of philschmid/flan-t5-base-samsum to use with Transformers.js.

Example usage

import { pipeline } from '@xenova/transformers';

const generator = await pipeline('text2text-generation', 'Felladrin/onnx-flan-t5-base-samsum');
const output =  await generator("Val: it's raining! Candy: I know, just started... Val: r we going? we will be wet Candy: maybe wait a little? see if stops Val: ok. let's wait half h and than see Candy: god idea, I call u then Val: great :)", { add_special_tokens: true, max_new_tokens: 60, repetition_penalty: 1.2});
console.log(output); // It's raining. Val and Candy will wait half an hour and then see if...

Model info

transformers.js

transformers.js onnx t5 text2text-generation dataset:samsum base_model:philschmid/flan-t5-base-samsum base_model:quantized:philschmid/flan-t5-base-samsum license:apache-2.0 region:us

↓ 3 ♥ 0

Created: 2023-11-23

Updated: 2023-11-23

View on Hugging Face

Files (17)

.gitattributes

README.md

config.json

generation_config.json

onnx/decoder_model.onnx ONNX

onnx/decoder_model_merged.onnx ONNX

onnx/decoder_model_merged_quantized.onnx ONNX

onnx/decoder_model_quantized.onnx ONNX

onnx/decoder_with_past_model.onnx ONNX

onnx/decoder_with_past_model_quantized.onnx ONNX

onnx/encoder_model.onnx ONNX

onnx/encoder_model_quantized.onnx ONNX

quantize_config.json

special_tokens_map.json

spiece.model

tokenizer.json

tokenizer_config.json

Related models

More models

No task type declared.