说明文档

Transformers.js

[!IMPORTANT]
注意：此模型需要 Transformers.js v4.0.0 及以上版本！

示例：基础示例

import { pipeline, TextStreamer } from \"@huggingface/transformers\";

// Create a text generation pipeline
const generator = await pipeline(
  \"text-generation\",
  \"onnx-community/granite-4.0-micro-ONNX\",
  { dtype: \"q4f16\", device: \"webgpu\" },
);

// Define the list of messages
const messages = [
  { role: \"system\", content: \"You are a helpful assistant.\" },
  { role: \"user\", content: \"What is the capital of France?\" },
];

// Generate a response
const output = await generator(messages, {
    max_new_tokens: 512,
    do_sample: false,
    streamer: new TextStreamer(generator.tokenizer, { skip_prompt: true, skip_special_tokens: true }),
});
console.log(output[0].generated_text.at(-1).content);
// The capital of France is Paris.

onnx-community/granite-4.0-micro-ONNX

作者 onnx-community

text-generation

↓ 0 ♥ 1

创建时间: 2025-10-02 02:41:44+00:00

更新时间: 2025-10-02 18:13:38+00:00

在 Hugging Face 上查看

文件 (25)

.gitattributes

README.md

model.onnx ONNX

model.onnx_data

model.onnx_data_1

model.onnx_data_2

model.onnx_data_3

model.onnx_data_4

model.onnx_data_5

model.onnx_data_6

model_fp16.onnx ONNX

model_fp16.onnx_data

model_fp16.onnx_data_1

model_fp16.onnx_data_2

model_fp16.onnx_data_3

model_q4.onnx ONNX

model_q4.onnx_data

model_q4.onnx_data_1

model_q4f16.onnx ONNX

model_q4f16.onnx_data

model_q4f16.onnx_data_1

model_quantized.onnx ONNX

model_quantized.onnx_data

model_quantized.onnx_data_1

model_quantized.onnx_data_2