适用于 facebook/bart-base 的适配器 AdapterHub/narrativeqa 的 ONNX 导出

AdapterHub/narrativeqa 为 UKP SQuARE 的转换版本

用法

onnx_path = hf_hub_download(repo_id='UKP-SQuARE/bart-base-pf-narrativeqa-onnx', filename='model.onnx') # or model_quant.onnx for quantization
onnx_model = InferenceSession(onnx_path, providers=['CPUExecutionProvider'])

context = 'ONNX is an open format to represent models. The benefits of using ONNX include interoperability of frameworks and hardware optimization.'
question = 'What are advantages of ONNX?'
tokenizer = AutoTokenizer.from_pretrained('UKP-SQuARE/bart-base-pf-narrativeqa-onnx')

inputs = tokenizer(question, context, padding=True, truncation=True, return_tensors='np')
outputs = onnx_model.run(input_feed=dict(inputs), output_names=None)

架构与训练

<!-- 在此处添加描述 -->

评估结果

<!-- 在此处添加描述 -->

引用

<!-- 在此处添加描述 -->