ONNX 导出版适配器 AdapterHub/roberta-base-pf-cosmos_qa（适用于 roberta-base）

将 AdapterHub/roberta-base-pf-cosmos_qa 转换为 UKP SQuARE 格式

使用方法

onnx_path = hf_hub_download(repo_id='UKP-SQuARE/roberta-base-pf-cosmos_qa-onnx', filename='model.onnx') # 或使用 model_quant.onnx 进行量化
onnx_model = InferenceSession(onnx_path, providers=['CPUExecutionProvider'])

context = 'ONNX is an open format to represent models. The benefits of using ONNX include interoperability of frameworks and hardware optimization.'
question = 'What are advantages of ONNX?'
choices = ["Cat", "Horse", "Tiger", "Fish"]tokenizer = AutoTokenizer.from_pretrained('UKP-SQuARE/roberta-base-pf-cosmos_qa-onnx')

raw_input = [[context, question +  + choice] for choice in choices]
inputs = tokenizer(raw_input, padding=True, truncation=True, return_tensors="np")
inputs['token_type_ids'] = np.expand_dims(inputs['token_type_ids'], axis=0)
inputs['input_ids'] =  np.expand_dims(inputs['input_ids'], axis=0)
inputs['attention_mask'] =  np.expand_dims(inputs['attention_mask'], axis=0)
outputs = onnx_model.run(input_feed=dict(inputs), output_names=None)

架构与训练

该适配器的训练代码可在 https://github.com/adapter-hub/efficient-task-transfer 获取。 所有任务的训练配置可以在这里找到。

评估结果

有关结果的更多信息，请参阅论文。

引用

如果您使用此适配器，请引用我们的论文 "What to Pre-Train on? Efficient Intermediate Task Selection"：

@inproceedings{poth-etal-2021-what-to-pre-train-on,
    title={What to Pre-Train on? Efficient Intermediate Task Selection},
    author={Clifton Poth and Jonas Pfeiffer and Andreas Rücklé and Iryna Gurevych},
    booktitle = "Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP)",
    month = nov,
    year = "2021",
    address = "Online",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/2104.08247",
    pages = "to appear",
}