返回模型
说明文档
Llama-2 ONNX
本仓库包含 Llama-2 7B 的优化版本。
下载模型
您可以使用 huggingface_hub 下载此仓库。可以通过 Python 脚本和命令行两种方式完成。Python 示例请参考 HuggingFace Hub 文档。
使用命令行：
- 确保已安装最新版本的
huggingface_hub。
pip install -U huggingface_hub
- 下载仓库。
huggingface-cli download alpindale/Llama-2-7b-ONNX --repo-type model --cache-dir /path/to/custom/cache/directory --local-dir /path/to/download/dir --local-dir-use-symlinks False
--cache-dir 参数仅在您的默认缓存目录（~/.cache）没有足够的磁盘空间来容纳整个仓库时才需要。
聊天界面
您可以使用 Gradio 聊天界面来运行模型。
首先，安装所需的包：
pip install -r ChatApp/requirements.txt
将 Python 路径设置为仓库的根目录（用于导入所需的模块）：
export PYTHONPATH=$PYTHONPATH:$(pwd)
然后您可以直接运行：
python ChatApp/app.py
然后在浏览器中访问 http://localhost:7860 即可使用该界面。
命令行界面
该仓库还提供了运行模型的示例代码。
python llama2_onnx_inference.py --onnx_file FP16/LlamaV2_7B_float16.onnx --embedding_file embeddings.pth --tokenizer_path tokenizer.model --prompt \"What is the lightest element?\"
输出：
The lightest element is hydrogen. Hydrogen is the lightest element on the periodic table, with an atomic mass of 1.00794 u (unified atomic mass units).
常见问题
为什么第一次推理会话很慢？
ONNX 运行时执行提供程序可能需要为底层硬件生成 JIT 二进制文件，通常该二进制文件会被缓存，并在后续运行中直接加载以减少开销。
为什么 FP16 在我的设备上比 FP32 慢？
您的设备可能不支持原生 FP16 运算，因此权重会在运行时转换为 FP32。使用 FP32 版本的模型可以避免转换开销。
如何优化推理？
建议将输入/输出放在目标设备上以避免昂贵的数据拷贝，详情请参考以下文档：
我应该使用什么生成参数来运行模型？
您可以使用提供的示例代码进行温度和 top-p 采样。请参考 Meta 的示例此处。
alpindale/Llama-2-7b-ONNX
作者 alpindale
text-generation
↓ 0
♥ 8
创建时间: 2023-09-21 19:36:33+00:00
更新时间: 2023-09-21 23:24:22+00:00
在 Hugging Face 上查看文件 (1203)
.gitattributes
ChatApp/app.py
ChatApp/app_modules/__pycache__/overwrites.cpython-39.pyc
ChatApp/app_modules/__pycache__/presets.cpython-39.pyc
ChatApp/app_modules/__pycache__/utils.cpython-39.pyc
ChatApp/app_modules/overwrites.py
ChatApp/app_modules/presets.py
ChatApp/app_modules/utils.py
ChatApp/assets/custom.css
ChatApp/assets/custom.js
ChatApp/interface/__pycache__/base_interface.cpython-39.pyc
ChatApp/interface/__pycache__/empty_stub_interface.cpython-39.pyc
ChatApp/interface/__pycache__/hddr_llama_onnx_interface.cpython-39.pyc
ChatApp/interface/base_interface.py
ChatApp/interface/empty_stub_interface.py
ChatApp/interface/hddr_llama_onnx_interface.py
ChatApp/requirements.txt
FP16-Chat/.gitattributes
FP16-Chat/.gitignore
FP16-Chat/Constant_69_attr__value
FP16-Chat/Constant_77_attr__value
FP16-Chat/LlamaV2_7B_FT_float16.onnx
ONNX
FP16-Chat/embeddings.data
FP16-Chat/onnx__MatMul_20670
FP16-Chat/onnx__MatMul_20671
FP16-Chat/onnx__MatMul_20672
FP16-Chat/onnx__MatMul_20692
FP16-Chat/onnx__MatMul_20693
FP16-Chat/onnx__MatMul_20694
FP16-Chat/onnx__MatMul_20695
FP16-Chat/onnx__MatMul_20696
FP16-Chat/onnx__MatMul_20697
FP16-Chat/onnx__MatMul_20698
FP16-Chat/onnx__MatMul_20718
FP16-Chat/onnx__MatMul_20719
FP16-Chat/onnx__MatMul_20720
FP16-Chat/onnx__MatMul_20721
FP16-Chat/onnx__MatMul_20722
FP16-Chat/onnx__MatMul_20723
FP16-Chat/onnx__MatMul_20724
FP16-Chat/onnx__MatMul_20744
FP16-Chat/onnx__MatMul_20745
FP16-Chat/onnx__MatMul_20746
FP16-Chat/onnx__MatMul_20747
FP16-Chat/onnx__MatMul_20748
FP16-Chat/onnx__MatMul_20749
FP16-Chat/onnx__MatMul_20750
FP16-Chat/onnx__MatMul_20770
FP16-Chat/onnx__MatMul_20771
FP16-Chat/onnx__MatMul_20772
FP16-Chat/onnx__MatMul_20773
FP16-Chat/onnx__MatMul_20774
FP16-Chat/onnx__MatMul_20775
FP16-Chat/onnx__MatMul_20776
FP16-Chat/onnx__MatMul_20796
FP16-Chat/onnx__MatMul_20797
FP16-Chat/onnx__MatMul_20798
FP16-Chat/onnx__MatMul_20799
FP16-Chat/onnx__MatMul_20800
FP16-Chat/onnx__MatMul_20801
FP16-Chat/onnx__MatMul_20802
FP16-Chat/onnx__MatMul_20822
FP16-Chat/onnx__MatMul_20823
FP16-Chat/onnx__MatMul_20824
FP16-Chat/onnx__MatMul_20825
FP16-Chat/onnx__MatMul_20826
FP16-Chat/onnx__MatMul_20827
FP16-Chat/onnx__MatMul_20828
FP16-Chat/onnx__MatMul_20848
FP16-Chat/onnx__MatMul_20849
FP16-Chat/onnx__MatMul_20850
FP16-Chat/onnx__MatMul_20851
FP16-Chat/onnx__MatMul_20852
FP16-Chat/onnx__MatMul_20853
FP16-Chat/onnx__MatMul_20854
FP16-Chat/onnx__MatMul_20874
FP16-Chat/onnx__MatMul_20875
FP16-Chat/onnx__MatMul_20876
FP16-Chat/onnx__MatMul_20877
FP16-Chat/onnx__MatMul_20878
FP16-Chat/onnx__MatMul_20879
FP16-Chat/onnx__MatMul_20880
FP16-Chat/onnx__MatMul_20900
FP16-Chat/onnx__MatMul_20901
FP16-Chat/onnx__MatMul_20902
FP16-Chat/onnx__MatMul_20903
FP16-Chat/onnx__MatMul_20904
FP16-Chat/onnx__MatMul_20905
FP16-Chat/onnx__MatMul_20906
FP16-Chat/onnx__MatMul_20926
FP16-Chat/onnx__MatMul_20927
FP16-Chat/onnx__MatMul_20928
FP16-Chat/onnx__MatMul_20929
FP16-Chat/onnx__MatMul_20930
FP16-Chat/onnx__MatMul_20931
FP16-Chat/onnx__MatMul_20932
FP16-Chat/onnx__MatMul_20952
FP16-Chat/onnx__MatMul_20953
FP16-Chat/onnx__MatMul_20954
FP16-Chat/onnx__MatMul_20955
FP16-Chat/onnx__MatMul_20956
FP16-Chat/onnx__MatMul_20957
FP16-Chat/onnx__MatMul_20958
FP16-Chat/onnx__MatMul_20978
FP16-Chat/onnx__MatMul_20979
FP16-Chat/onnx__MatMul_20980
FP16-Chat/onnx__MatMul_20981
FP16-Chat/onnx__MatMul_20982
FP16-Chat/onnx__MatMul_20983
FP16-Chat/onnx__MatMul_20984
FP16-Chat/onnx__MatMul_21004
FP16-Chat/onnx__MatMul_21005
FP16-Chat/onnx__MatMul_21006
FP16-Chat/onnx__MatMul_21007
FP16-Chat/onnx__MatMul_21008
FP16-Chat/onnx__MatMul_21009
FP16-Chat/onnx__MatMul_21010
FP16-Chat/onnx__MatMul_21030
FP16-Chat/onnx__MatMul_21031
FP16-Chat/onnx__MatMul_21032
FP16-Chat/onnx__MatMul_21033
FP16-Chat/onnx__MatMul_21034
FP16-Chat/onnx__MatMul_21035
FP16-Chat/onnx__MatMul_21036
FP16-Chat/onnx__MatMul_21056
FP16-Chat/onnx__MatMul_21057
FP16-Chat/onnx__MatMul_21058
FP16-Chat/onnx__MatMul_21059
FP16-Chat/onnx__MatMul_21060
FP16-Chat/onnx__MatMul_21061
FP16-Chat/onnx__MatMul_21062
FP16-Chat/onnx__MatMul_21082
FP16-Chat/onnx__MatMul_21083
FP16-Chat/onnx__MatMul_21084
FP16-Chat/onnx__MatMul_21085
FP16-Chat/onnx__MatMul_21086
FP16-Chat/onnx__MatMul_21087
FP16-Chat/onnx__MatMul_21088
FP16-Chat/onnx__MatMul_21108
FP16-Chat/onnx__MatMul_21109
FP16-Chat/onnx__MatMul_21110
FP16-Chat/onnx__MatMul_21111
FP16-Chat/onnx__MatMul_21112
FP16-Chat/onnx__MatMul_21113
FP16-Chat/onnx__MatMul_21114
FP16-Chat/onnx__MatMul_21134
FP16-Chat/onnx__MatMul_21135
FP16-Chat/onnx__MatMul_21136
FP16-Chat/onnx__MatMul_21137
FP16-Chat/onnx__MatMul_21138
FP16-Chat/onnx__MatMul_21139
FP16-Chat/onnx__MatMul_21140
FP16-Chat/onnx__MatMul_21160
FP16-Chat/onnx__MatMul_21161
FP16-Chat/onnx__MatMul_21162
FP16-Chat/onnx__MatMul_21163
FP16-Chat/onnx__MatMul_21164
FP16-Chat/onnx__MatMul_21165
FP16-Chat/onnx__MatMul_21166
FP16-Chat/onnx__MatMul_21186
FP16-Chat/onnx__MatMul_21187
FP16-Chat/onnx__MatMul_21188
FP16-Chat/onnx__MatMul_21189
FP16-Chat/onnx__MatMul_21190
FP16-Chat/onnx__MatMul_21191
FP16-Chat/onnx__MatMul_21192
FP16-Chat/onnx__MatMul_21212
FP16-Chat/onnx__MatMul_21213
FP16-Chat/onnx__MatMul_21214
FP16-Chat/onnx__MatMul_21215
FP16-Chat/onnx__MatMul_21216
FP16-Chat/onnx__MatMul_21217
FP16-Chat/onnx__MatMul_21218
FP16-Chat/onnx__MatMul_21238
FP16-Chat/onnx__MatMul_21239
FP16-Chat/onnx__MatMul_21240
FP16-Chat/onnx__MatMul_21241
FP16-Chat/onnx__MatMul_21242
FP16-Chat/onnx__MatMul_21243
FP16-Chat/onnx__MatMul_21244
FP16-Chat/onnx__MatMul_21264
FP16-Chat/onnx__MatMul_21265
FP16-Chat/onnx__MatMul_21266
FP16-Chat/onnx__MatMul_21267
FP16-Chat/onnx__MatMul_21268
FP16-Chat/onnx__MatMul_21269
FP16-Chat/onnx__MatMul_21270
FP16-Chat/onnx__MatMul_21290
FP16-Chat/onnx__MatMul_21291
FP16-Chat/onnx__MatMul_21292
FP16-Chat/onnx__MatMul_21293
FP16-Chat/onnx__MatMul_21294
FP16-Chat/onnx__MatMul_21295
FP16-Chat/onnx__MatMul_21296
FP16-Chat/onnx__MatMul_21316
FP16-Chat/onnx__MatMul_21317
FP16-Chat/onnx__MatMul_21318
FP16-Chat/onnx__MatMul_21319
FP16-Chat/onnx__MatMul_21320
FP16-Chat/onnx__MatMul_21321
FP16-Chat/onnx__MatMul_21322
FP16-Chat/onnx__MatMul_21342
FP16-Chat/onnx__MatMul_21343
FP16-Chat/onnx__MatMul_21344
FP16-Chat/onnx__MatMul_21345
FP16-Chat/onnx__MatMul_21346
FP16-Chat/onnx__MatMul_21347
FP16-Chat/onnx__MatMul_21348
FP16-Chat/onnx__MatMul_21368
FP16-Chat/onnx__MatMul_21369
FP16-Chat/onnx__MatMul_21370
FP16-Chat/onnx__MatMul_21371
FP16-Chat/onnx__MatMul_21372
FP16-Chat/onnx__MatMul_21373
FP16-Chat/onnx__MatMul_21374
FP16-Chat/onnx__MatMul_21394
FP16-Chat/onnx__MatMul_21395
FP16-Chat/onnx__MatMul_21396
FP16-Chat/onnx__MatMul_21397
FP16-Chat/onnx__MatMul_21398
FP16-Chat/onnx__MatMul_21399
FP16-Chat/onnx__MatMul_21400
FP16-Chat/onnx__MatMul_21420
FP16-Chat/onnx__MatMul_21421
FP16-Chat/onnx__MatMul_21422
FP16-Chat/onnx__MatMul_21423
FP16-Chat/onnx__MatMul_21424
FP16-Chat/onnx__MatMul_21425
FP16-Chat/onnx__MatMul_21426
FP16-Chat/onnx__MatMul_21446
FP16-Chat/onnx__MatMul_21447
FP16-Chat/onnx__MatMul_21448
FP16-Chat/onnx__MatMul_21449
FP16-Chat/onnx__MatMul_21450
FP16-Chat/onnx__MatMul_21451
FP16-Chat/onnx__MatMul_21452
FP16-Chat/onnx__MatMul_21472
FP16-Chat/onnx__MatMul_21473
FP16-Chat/onnx__MatMul_21474
FP16-Chat/onnx__MatMul_21475
FP16-Chat/onnx__MatMul_21476
FP16-Chat/onnx__MatMul_21477
FP16-Chat/onnx__MatMul_21478
FP16-Chat/onnx__MatMul_21498
FP16-Chat/onnx__MatMul_21499
FP16-Chat/onnx__MatMul_21500
FP16-Chat/onnx__MatMul_21501
FP16-Chat/onnx__MatMul_21502
FP16-Chat/transformer.block_list.0.attn_norm.weight
FP16-Chat/transformer.block_list.0.proj_norm.weight
FP16-Chat/transformer.block_list.1.attn_norm.weight
FP16-Chat/transformer.block_list.1.proj_norm.weight
FP16-Chat/transformer.block_list.10.attn_norm.weight
FP16-Chat/transformer.block_list.10.proj_norm.weight
FP16-Chat/transformer.block_list.11.attn_norm.weight
FP16-Chat/transformer.block_list.11.proj_norm.weight
FP16-Chat/transformer.block_list.12.attn_norm.weight
FP16-Chat/transformer.block_list.12.proj_norm.weight
FP16-Chat/transformer.block_list.13.attn_norm.weight
FP16-Chat/transformer.block_list.13.proj_norm.weight
FP16-Chat/transformer.block_list.14.attn_norm.weight
FP16-Chat/transformer.block_list.14.proj_norm.weight
FP16-Chat/transformer.block_list.15.attn_norm.weight
FP16-Chat/transformer.block_list.15.proj_norm.weight
FP16-Chat/transformer.block_list.16.attn_norm.weight
FP16-Chat/transformer.block_list.16.proj_norm.weight
FP16-Chat/transformer.block_list.17.attn_norm.weight
FP16-Chat/transformer.block_list.17.proj_norm.weight
FP16-Chat/transformer.block_list.18.attn_norm.weight
FP16-Chat/transformer.block_list.18.proj_norm.weight
FP16-Chat/transformer.block_list.19.attn_norm.weight
FP16-Chat/transformer.block_list.19.proj_norm.weight
FP16-Chat/transformer.block_list.2.attn_norm.weight
FP16-Chat/transformer.block_list.2.proj_norm.weight
FP16-Chat/transformer.block_list.20.attn_norm.weight
FP16-Chat/transformer.block_list.20.proj_norm.weight
FP16-Chat/transformer.block_list.21.attn_norm.weight
FP16-Chat/transformer.block_list.21.proj_norm.weight
FP16-Chat/transformer.block_list.22.attn_norm.weight
FP16-Chat/transformer.block_list.22.proj_norm.weight
FP16-Chat/transformer.block_list.23.attn_norm.weight
FP16-Chat/transformer.block_list.23.proj_norm.weight
FP16-Chat/transformer.block_list.24.attn_norm.weight
FP16-Chat/transformer.block_list.24.proj_norm.weight
FP16-Chat/transformer.block_list.25.attn_norm.weight
FP16-Chat/transformer.block_list.25.proj_norm.weight
FP16-Chat/transformer.block_list.26.attn_norm.weight
FP16-Chat/transformer.block_list.26.proj_norm.weight
FP16-Chat/transformer.block_list.27.attn_norm.weight
FP16-Chat/transformer.block_list.27.proj_norm.weight
FP16-Chat/transformer.block_list.28.attn_norm.weight
FP16-Chat/transformer.block_list.28.proj_norm.weight
FP16-Chat/transformer.block_list.29.attn_norm.weight
FP16-Chat/transformer.block_list.29.proj_norm.weight
FP16-Chat/transformer.block_list.3.attn_norm.weight
FP16-Chat/transformer.block_list.3.proj_norm.weight
FP16-Chat/transformer.block_list.30.attn_norm.weight
FP16-Chat/transformer.block_list.30.proj_norm.weight
FP16-Chat/transformer.block_list.31.attn_norm.weight
FP16-Chat/transformer.block_list.31.proj_norm.weight
FP16-Chat/transformer.block_list.4.attn_norm.weight
FP16-Chat/transformer.block_list.4.proj_norm.weight
FP16-Chat/transformer.block_list.5.attn_norm.weight
FP16-Chat/transformer.block_list.5.proj_norm.weight
FP16-Chat/transformer.block_list.6.attn_norm.weight
FP16-Chat/transformer.block_list.6.proj_norm.weight
FP16-Chat/transformer.block_list.7.attn_norm.weight
FP16-Chat/transformer.block_list.7.proj_norm.weight
FP16-Chat/transformer.block_list.8.attn_norm.weight
FP16-Chat/transformer.block_list.8.proj_norm.weight
FP16-Chat/transformer.block_list.9.attn_norm.weight
FP16-Chat/transformer.block_list.9.proj_norm.weight
FP16-Chat/transformer.layer_norm.weight
FP16/Constant_69_attr__value
FP16/Constant_77_attr__value
FP16/LlamaV2_7B_float16.onnx
ONNX
FP16/embeddings.data
FP16/onnx__MatMul_20670
FP16/onnx__MatMul_20671
FP16/onnx__MatMul_20672
FP16/onnx__MatMul_20692
FP16/onnx__MatMul_20693
FP16/onnx__MatMul_20694
FP16/onnx__MatMul_20695
FP16/onnx__MatMul_20696
FP16/onnx__MatMul_20697
FP16/onnx__MatMul_20698
FP16/onnx__MatMul_20718
FP16/onnx__MatMul_20719
FP16/onnx__MatMul_20720
FP16/onnx__MatMul_20721
FP16/onnx__MatMul_20722
FP16/onnx__MatMul_20723
FP16/onnx__MatMul_20724
FP16/onnx__MatMul_20744
FP16/onnx__MatMul_20745
FP16/onnx__MatMul_20746
FP16/onnx__MatMul_20747
FP16/onnx__MatMul_20748
FP16/onnx__MatMul_20749
FP16/onnx__MatMul_20750
FP16/onnx__MatMul_20770
FP16/onnx__MatMul_20771
FP16/onnx__MatMul_20772
FP16/onnx__MatMul_20773
FP16/onnx__MatMul_20774
FP16/onnx__MatMul_20775
FP16/onnx__MatMul_20776
FP16/onnx__MatMul_20796
FP16/onnx__MatMul_20797
FP16/onnx__MatMul_20798
FP16/onnx__MatMul_20799
FP16/onnx__MatMul_20800
FP16/onnx__MatMul_20801
FP16/onnx__MatMul_20802
FP16/onnx__MatMul_20822
FP16/onnx__MatMul_20823
FP16/onnx__MatMul_20824
FP16/onnx__MatMul_20825
FP16/onnx__MatMul_20826
FP16/onnx__MatMul_20827
FP16/onnx__MatMul_20828
FP16/onnx__MatMul_20848
FP16/onnx__MatMul_20849
FP16/onnx__MatMul_20850
FP16/onnx__MatMul_20851
FP16/onnx__MatMul_20852
FP16/onnx__MatMul_20853
FP16/onnx__MatMul_20854
FP16/onnx__MatMul_20874
FP16/onnx__MatMul_20875
FP16/onnx__MatMul_20876
FP16/onnx__MatMul_20877
FP16/onnx__MatMul_20878
FP16/onnx__MatMul_20879
FP16/onnx__MatMul_20880
FP16/onnx__MatMul_20900
FP16/onnx__MatMul_20901
FP16/onnx__MatMul_20902
FP16/onnx__MatMul_20903
FP16/onnx__MatMul_20904
FP16/onnx__MatMul_20905
FP16/onnx__MatMul_20906
FP16/onnx__MatMul_20926
FP16/onnx__MatMul_20927
FP16/onnx__MatMul_20928
FP16/onnx__MatMul_20929
FP16/onnx__MatMul_20930
FP16/onnx__MatMul_20931
FP16/onnx__MatMul_20932
FP16/onnx__MatMul_20952
FP16/onnx__MatMul_20953
FP16/onnx__MatMul_20954
FP16/onnx__MatMul_20955
FP16/onnx__MatMul_20956
FP16/onnx__MatMul_20957
FP16/onnx__MatMul_20958
FP16/onnx__MatMul_20978
FP16/onnx__MatMul_20979
FP16/onnx__MatMul_20980
FP16/onnx__MatMul_20981
FP16/onnx__MatMul_20982
FP16/onnx__MatMul_20983
FP16/onnx__MatMul_20984
FP16/onnx__MatMul_21004
FP16/onnx__MatMul_21005
FP16/onnx__MatMul_21006
FP16/onnx__MatMul_21007
FP16/onnx__MatMul_21008
FP16/onnx__MatMul_21009
FP16/onnx__MatMul_21010
FP16/onnx__MatMul_21030
FP16/onnx__MatMul_21031
FP16/onnx__MatMul_21032
FP16/onnx__MatMul_21033
FP16/onnx__MatMul_21034
FP16/onnx__MatMul_21035
FP16/onnx__MatMul_21036
FP16/onnx__MatMul_21056
FP16/onnx__MatMul_21057
FP16/onnx__MatMul_21058
FP16/onnx__MatMul_21059
FP16/onnx__MatMul_21060
FP16/onnx__MatMul_21061
FP16/onnx__MatMul_21062
FP16/onnx__MatMul_21082
FP16/onnx__MatMul_21083
FP16/onnx__MatMul_21084
FP16/onnx__MatMul_21085
FP16/onnx__MatMul_21086
FP16/onnx__MatMul_21087
FP16/onnx__MatMul_21088
FP16/onnx__MatMul_21108
FP16/onnx__MatMul_21109
FP16/onnx__MatMul_21110
FP16/onnx__MatMul_21111
FP16/onnx__MatMul_21112
FP16/onnx__MatMul_21113
FP16/onnx__MatMul_21114
FP16/onnx__MatMul_21134
FP16/onnx__MatMul_21135
FP16/onnx__MatMul_21136
FP16/onnx__MatMul_21137
FP16/onnx__MatMul_21138
FP16/onnx__MatMul_21139
FP16/onnx__MatMul_21140
FP16/onnx__MatMul_21160
FP16/onnx__MatMul_21161
FP16/onnx__MatMul_21162
FP16/onnx__MatMul_21163
FP16/onnx__MatMul_21164
FP16/onnx__MatMul_21165
FP16/onnx__MatMul_21166
FP16/onnx__MatMul_21186
FP16/onnx__MatMul_21187
FP16/onnx__MatMul_21188
FP16/onnx__MatMul_21189
FP16/onnx__MatMul_21190
FP16/onnx__MatMul_21191
FP16/onnx__MatMul_21192
FP16/onnx__MatMul_21212
FP16/onnx__MatMul_21213
FP16/onnx__MatMul_21214
FP16/onnx__MatMul_21215
FP16/onnx__MatMul_21216
FP16/onnx__MatMul_21217
FP16/onnx__MatMul_21218
FP16/onnx__MatMul_21238
FP16/onnx__MatMul_21239
FP16/onnx__MatMul_21240
FP16/onnx__MatMul_21241
FP16/onnx__MatMul_21242
FP16/onnx__MatMul_21243
FP16/onnx__MatMul_21244
FP16/onnx__MatMul_21264
FP16/onnx__MatMul_21265
FP16/onnx__MatMul_21266
FP16/onnx__MatMul_21267
FP16/onnx__MatMul_21268
FP16/onnx__MatMul_21269
FP16/onnx__MatMul_21270
FP16/onnx__MatMul_21290
FP16/onnx__MatMul_21291
FP16/onnx__MatMul_21292
FP16/onnx__MatMul_21293
FP16/onnx__MatMul_21294
FP16/onnx__MatMul_21295
FP16/onnx__MatMul_21296
FP16/onnx__MatMul_21316
FP16/onnx__MatMul_21317
FP16/onnx__MatMul_21318
FP16/onnx__MatMul_21319
FP16/onnx__MatMul_21320
FP16/onnx__MatMul_21321
FP16/onnx__MatMul_21322
FP16/onnx__MatMul_21342
FP16/onnx__MatMul_21343
FP16/onnx__MatMul_21344
FP16/onnx__MatMul_21345
FP16/onnx__MatMul_21346
FP16/onnx__MatMul_21347
FP16/onnx__MatMul_21348
FP16/onnx__MatMul_21368
FP16/onnx__MatMul_21369
FP16/onnx__MatMul_21370
FP16/onnx__MatMul_21371
FP16/onnx__MatMul_21372
FP16/onnx__MatMul_21373
FP16/onnx__MatMul_21374
FP16/onnx__MatMul_21394
FP16/onnx__MatMul_21395
FP16/onnx__MatMul_21396
FP16/onnx__MatMul_21397
FP16/onnx__MatMul_21398
FP16/onnx__MatMul_21399
FP16/onnx__MatMul_21400
FP16/onnx__MatMul_21420
FP16/onnx__MatMul_21421
FP16/onnx__MatMul_21422
FP16/onnx__MatMul_21423
FP16/onnx__MatMul_21424
FP16/onnx__MatMul_21425
FP16/onnx__MatMul_21426
FP16/onnx__MatMul_21446
FP16/onnx__MatMul_21447
FP16/onnx__MatMul_21448
FP16/onnx__MatMul_21449
FP16/onnx__MatMul_21450
FP16/onnx__MatMul_21451
FP16/onnx__MatMul_21452
FP16/onnx__MatMul_21472
FP16/onnx__MatMul_21473
FP16/onnx__MatMul_21474
FP16/onnx__MatMul_21475
FP16/onnx__MatMul_21476
FP16/onnx__MatMul_21477
FP16/onnx__MatMul_21478
FP16/onnx__MatMul_21498
FP16/onnx__MatMul_21499
FP16/onnx__MatMul_21500
FP16/onnx__MatMul_21501
FP16/onnx__MatMul_21502
FP16/transformer.block_list.0.attn_norm.weight
FP16/transformer.block_list.0.proj_norm.weight
FP16/transformer.block_list.1.attn_norm.weight
FP16/transformer.block_list.1.proj_norm.weight
FP16/transformer.block_list.10.attn_norm.weight
FP16/transformer.block_list.10.proj_norm.weight
FP16/transformer.block_list.11.attn_norm.weight
FP16/transformer.block_list.11.proj_norm.weight
FP16/transformer.block_list.12.attn_norm.weight
FP16/transformer.block_list.12.proj_norm.weight
FP16/transformer.block_list.13.attn_norm.weight
FP16/transformer.block_list.13.proj_norm.weight
FP16/transformer.block_list.14.attn_norm.weight
FP16/transformer.block_list.14.proj_norm.weight
FP16/transformer.block_list.15.attn_norm.weight
FP16/transformer.block_list.15.proj_norm.weight
FP16/transformer.block_list.16.attn_norm.weight
FP16/transformer.block_list.16.proj_norm.weight
FP16/transformer.block_list.17.attn_norm.weight
FP16/transformer.block_list.17.proj_norm.weight
FP16/transformer.block_list.18.attn_norm.weight
FP16/transformer.block_list.18.proj_norm.weight
FP16/transformer.block_list.19.attn_norm.weight
FP16/transformer.block_list.19.proj_norm.weight
FP16/transformer.block_list.2.attn_norm.weight
FP16/transformer.block_list.2.proj_norm.weight
FP16/transformer.block_list.20.attn_norm.weight
FP16/transformer.block_list.20.proj_norm.weight
FP16/transformer.block_list.21.attn_norm.weight
FP16/transformer.block_list.21.proj_norm.weight
FP16/transformer.block_list.22.attn_norm.weight
FP16/transformer.block_list.22.proj_norm.weight
FP16/transformer.block_list.23.attn_norm.weight
FP16/transformer.block_list.23.proj_norm.weight
FP16/transformer.block_list.24.attn_norm.weight
FP16/transformer.block_list.24.proj_norm.weight
FP16/transformer.block_list.25.attn_norm.weight
FP16/transformer.block_list.25.proj_norm.weight
FP16/transformer.block_list.26.attn_norm.weight
FP16/transformer.block_list.26.proj_norm.weight
FP16/transformer.block_list.27.attn_norm.weight
FP16/transformer.block_list.27.proj_norm.weight
FP16/transformer.block_list.28.attn_norm.weight
FP16/transformer.block_list.28.proj_norm.weight
FP16/transformer.block_list.29.attn_norm.weight
FP16/transformer.block_list.29.proj_norm.weight
FP16/transformer.block_list.3.attn_norm.weight
FP16/transformer.block_list.3.proj_norm.weight
FP16/transformer.block_list.30.attn_norm.weight
FP16/transformer.block_list.30.proj_norm.weight
FP16/transformer.block_list.31.attn_norm.weight
FP16/transformer.block_list.31.proj_norm.weight
FP16/transformer.block_list.4.attn_norm.weight
FP16/transformer.block_list.4.proj_norm.weight
FP16/transformer.block_list.5.attn_norm.weight
FP16/transformer.block_list.5.proj_norm.weight
FP16/transformer.block_list.6.attn_norm.weight
FP16/transformer.block_list.6.proj_norm.weight
FP16/transformer.block_list.7.attn_norm.weight
FP16/transformer.block_list.7.proj_norm.weight
FP16/transformer.block_list.8.attn_norm.weight
FP16/transformer.block_list.8.proj_norm.weight
FP16/transformer.block_list.9.attn_norm.weight
FP16/transformer.block_list.9.proj_norm.weight
FP16/transformer.layer_norm.weight
FP32-Chat/.gitattributes
FP32-Chat/.gitignore
FP32-Chat/Constant_68_attr__value
FP32-Chat/Constant_76_attr__value
FP32-Chat/LlamaV2_7B_FT_float32.onnx
ONNX
FP32-Chat/embeddings.data
FP32-Chat/onnx__MatMul_20605
FP32-Chat/onnx__MatMul_20606
FP32-Chat/onnx__MatMul_20607
FP32-Chat/onnx__MatMul_20627
FP32-Chat/onnx__MatMul_20628
FP32-Chat/onnx__MatMul_20629
FP32-Chat/onnx__MatMul_20630
FP32-Chat/onnx__MatMul_20631
FP32-Chat/onnx__MatMul_20632
FP32-Chat/onnx__MatMul_20633
FP32-Chat/onnx__MatMul_20653
FP32-Chat/onnx__MatMul_20654
FP32-Chat/onnx__MatMul_20655
FP32-Chat/onnx__MatMul_20656
FP32-Chat/onnx__MatMul_20657
FP32-Chat/onnx__MatMul_20658
FP32-Chat/onnx__MatMul_20659
FP32-Chat/onnx__MatMul_20679
FP32-Chat/onnx__MatMul_20680
FP32-Chat/onnx__MatMul_20681
FP32-Chat/onnx__MatMul_20682
FP32-Chat/onnx__MatMul_20683
FP32-Chat/onnx__MatMul_20684
FP32-Chat/onnx__MatMul_20685
FP32-Chat/onnx__MatMul_20705
FP32-Chat/onnx__MatMul_20706
FP32-Chat/onnx__MatMul_20707
FP32-Chat/onnx__MatMul_20708
FP32-Chat/onnx__MatMul_20709
FP32-Chat/onnx__MatMul_20710
FP32-Chat/onnx__MatMul_20711
FP32-Chat/onnx__MatMul_20731
FP32-Chat/onnx__MatMul_20732
FP32-Chat/onnx__MatMul_20733
FP32-Chat/onnx__MatMul_20734
FP32-Chat/onnx__MatMul_20735
FP32-Chat/onnx__MatMul_20736
FP32-Chat/onnx__MatMul_20737
FP32-Chat/onnx__MatMul_20757
FP32-Chat/onnx__MatMul_20758
FP32-Chat/onnx__MatMul_20759
FP32-Chat/onnx__MatMul_20760
FP32-Chat/onnx__MatMul_20761
FP32-Chat/onnx__MatMul_20762
FP32-Chat/onnx__MatMul_20763
FP32-Chat/onnx__MatMul_20783
FP32-Chat/onnx__MatMul_20784
FP32-Chat/onnx__MatMul_20785
FP32-Chat/onnx__MatMul_20786
FP32-Chat/onnx__MatMul_20787
FP32-Chat/onnx__MatMul_20788
FP32-Chat/onnx__MatMul_20789
FP32-Chat/onnx__MatMul_20809
FP32-Chat/onnx__MatMul_20810
FP32-Chat/onnx__MatMul_20811
FP32-Chat/onnx__MatMul_20812
FP32-Chat/onnx__MatMul_20813
FP32-Chat/onnx__MatMul_20814
FP32-Chat/onnx__MatMul_20815
FP32-Chat/onnx__MatMul_20835
FP32-Chat/onnx__MatMul_20836
FP32-Chat/onnx__MatMul_20837
FP32-Chat/onnx__MatMul_20838
FP32-Chat/onnx__MatMul_20839
FP32-Chat/onnx__MatMul_20840
FP32-Chat/onnx__MatMul_20841
FP32-Chat/onnx__MatMul_20861
FP32-Chat/onnx__MatMul_20862
FP32-Chat/onnx__MatMul_20863
FP32-Chat/onnx__MatMul_20864
FP32-Chat/onnx__MatMul_20865
FP32-Chat/onnx__MatMul_20866
FP32-Chat/onnx__MatMul_20867
FP32-Chat/onnx__MatMul_20887
FP32-Chat/onnx__MatMul_20888
FP32-Chat/onnx__MatMul_20889
FP32-Chat/onnx__MatMul_20890
FP32-Chat/onnx__MatMul_20891
FP32-Chat/onnx__MatMul_20892
FP32-Chat/onnx__MatMul_20893
FP32-Chat/onnx__MatMul_20913
FP32-Chat/onnx__MatMul_20914
FP32-Chat/onnx__MatMul_20915
FP32-Chat/onnx__MatMul_20916
FP32-Chat/onnx__MatMul_20917
FP32-Chat/onnx__MatMul_20918
FP32-Chat/onnx__MatMul_20919
FP32-Chat/onnx__MatMul_20939
FP32-Chat/onnx__MatMul_20940
FP32-Chat/onnx__MatMul_20941
FP32-Chat/onnx__MatMul_20942
FP32-Chat/onnx__MatMul_20943
FP32-Chat/onnx__MatMul_20944
FP32-Chat/onnx__MatMul_20945
FP32-Chat/onnx__MatMul_20965
FP32-Chat/onnx__MatMul_20966
FP32-Chat/onnx__MatMul_20967
FP32-Chat/onnx__MatMul_20968
FP32-Chat/onnx__MatMul_20969
FP32-Chat/onnx__MatMul_20970
FP32-Chat/onnx__MatMul_20971
FP32-Chat/onnx__MatMul_20991
FP32-Chat/onnx__MatMul_20992
FP32-Chat/onnx__MatMul_20993
FP32-Chat/onnx__MatMul_20994
FP32-Chat/onnx__MatMul_20995
FP32-Chat/onnx__MatMul_20996
FP32-Chat/onnx__MatMul_20997
FP32-Chat/onnx__MatMul_21017
FP32-Chat/onnx__MatMul_21018
FP32-Chat/onnx__MatMul_21019
FP32-Chat/onnx__MatMul_21020
FP32-Chat/onnx__MatMul_21021
FP32-Chat/onnx__MatMul_21022
FP32-Chat/onnx__MatMul_21023
FP32-Chat/onnx__MatMul_21043
FP32-Chat/onnx__MatMul_21044
FP32-Chat/onnx__MatMul_21045
FP32-Chat/onnx__MatMul_21046
FP32-Chat/onnx__MatMul_21047
FP32-Chat/onnx__MatMul_21048
FP32-Chat/onnx__MatMul_21049
FP32-Chat/onnx__MatMul_21069
FP32-Chat/onnx__MatMul_21070
FP32-Chat/onnx__MatMul_21071
FP32-Chat/onnx__MatMul_21072
FP32-Chat/onnx__MatMul_21073
FP32-Chat/onnx__MatMul_21074
FP32-Chat/onnx__MatMul_21075
FP32-Chat/onnx__MatMul_21095
FP32-Chat/onnx__MatMul_21096
FP32-Chat/onnx__MatMul_21097
FP32-Chat/onnx__MatMul_21098
FP32-Chat/onnx__MatMul_21099
FP32-Chat/onnx__MatMul_21100
FP32-Chat/onnx__MatMul_21101
FP32-Chat/onnx__MatMul_21121
FP32-Chat/onnx__MatMul_21122
FP32-Chat/onnx__MatMul_21123
FP32-Chat/onnx__MatMul_21124
FP32-Chat/onnx__MatMul_21125
FP32-Chat/onnx__MatMul_21126
FP32-Chat/onnx__MatMul_21127
FP32-Chat/onnx__MatMul_21147
FP32-Chat/onnx__MatMul_21148
FP32-Chat/onnx__MatMul_21149
FP32-Chat/onnx__MatMul_21150
FP32-Chat/onnx__MatMul_21151
FP32-Chat/onnx__MatMul_21152
FP32-Chat/onnx__MatMul_21153
FP32-Chat/onnx__MatMul_21173
FP32-Chat/onnx__MatMul_21174
FP32-Chat/onnx__MatMul_21175
FP32-Chat/onnx__MatMul_21176
FP32-Chat/onnx__MatMul_21177
FP32-Chat/onnx__MatMul_21178
FP32-Chat/onnx__MatMul_21179
FP32-Chat/onnx__MatMul_21199
FP32-Chat/onnx__MatMul_21200
FP32-Chat/onnx__MatMul_21201
FP32-Chat/onnx__MatMul_21202
FP32-Chat/onnx__MatMul_21203
FP32-Chat/onnx__MatMul_21204
FP32-Chat/onnx__MatMul_21205
FP32-Chat/onnx__MatMul_21225
FP32-Chat/onnx__MatMul_21226
FP32-Chat/onnx__MatMul_21227
FP32-Chat/onnx__MatMul_21228
FP32-Chat/onnx__MatMul_21229
FP32-Chat/onnx__MatMul_21230
FP32-Chat/onnx__MatMul_21231
FP32-Chat/onnx__MatMul_21251
FP32-Chat/onnx__MatMul_21252
FP32-Chat/onnx__MatMul_21253
FP32-Chat/onnx__MatMul_21254
FP32-Chat/onnx__MatMul_21255
FP32-Chat/onnx__MatMul_21256
FP32-Chat/onnx__MatMul_21257
FP32-Chat/onnx__MatMul_21277
FP32-Chat/onnx__MatMul_21278
FP32-Chat/onnx__MatMul_21279
FP32-Chat/onnx__MatMul_21280
FP32-Chat/onnx__MatMul_21281
FP32-Chat/onnx__MatMul_21282
FP32-Chat/onnx__MatMul_21283
FP32-Chat/onnx__MatMul_21303
FP32-Chat/onnx__MatMul_21304
FP32-Chat/onnx__MatMul_21305
FP32-Chat/onnx__MatMul_21306
FP32-Chat/onnx__MatMul_21307
FP32-Chat/onnx__MatMul_21308
FP32-Chat/onnx__MatMul_21309
FP32-Chat/onnx__MatMul_21329
FP32-Chat/onnx__MatMul_21330
FP32-Chat/onnx__MatMul_21331
FP32-Chat/onnx__MatMul_21332
FP32-Chat/onnx__MatMul_21333
FP32-Chat/onnx__MatMul_21334
FP32-Chat/onnx__MatMul_21335
FP32-Chat/onnx__MatMul_21355
FP32-Chat/onnx__MatMul_21356
FP32-Chat/onnx__MatMul_21357
FP32-Chat/onnx__MatMul_21358
FP32-Chat/onnx__MatMul_21359
FP32-Chat/onnx__MatMul_21360
FP32-Chat/onnx__MatMul_21361
FP32-Chat/onnx__MatMul_21381
FP32-Chat/onnx__MatMul_21382
FP32-Chat/onnx__MatMul_21383
FP32-Chat/onnx__MatMul_21384
FP32-Chat/onnx__MatMul_21385
FP32-Chat/onnx__MatMul_21386
FP32-Chat/onnx__MatMul_21387
FP32-Chat/onnx__MatMul_21407
FP32-Chat/onnx__MatMul_21408
FP32-Chat/onnx__MatMul_21409
FP32-Chat/onnx__MatMul_21410
FP32-Chat/onnx__MatMul_21411
FP32-Chat/onnx__MatMul_21412
FP32-Chat/onnx__MatMul_21413
FP32-Chat/onnx__MatMul_21433
FP32-Chat/onnx__MatMul_21434
FP32-Chat/onnx__MatMul_21435
FP32-Chat/onnx__MatMul_21436
FP32-Chat/onnx__MatMul_21437
FP32-Chat/transformer.block_list.0.attn_norm.weight
FP32-Chat/transformer.block_list.0.proj_norm.weight
FP32-Chat/transformer.block_list.1.attn_norm.weight
FP32-Chat/transformer.block_list.1.proj_norm.weight
FP32-Chat/transformer.block_list.10.attn_norm.weight
FP32-Chat/transformer.block_list.10.proj_norm.weight
FP32-Chat/transformer.block_list.11.attn_norm.weight
FP32-Chat/transformer.block_list.11.proj_norm.weight
FP32-Chat/transformer.block_list.12.attn_norm.weight
FP32-Chat/transformer.block_list.12.proj_norm.weight
FP32-Chat/transformer.block_list.13.attn_norm.weight
FP32-Chat/transformer.block_list.13.proj_norm.weight
FP32-Chat/transformer.block_list.14.attn_norm.weight
FP32-Chat/transformer.block_list.14.proj_norm.weight
FP32-Chat/transformer.block_list.15.attn_norm.weight
FP32-Chat/transformer.block_list.15.proj_norm.weight
FP32-Chat/transformer.block_list.16.attn_norm.weight
FP32-Chat/transformer.block_list.16.proj_norm.weight
FP32-Chat/transformer.block_list.17.attn_norm.weight
FP32-Chat/transformer.block_list.17.proj_norm.weight
FP32-Chat/transformer.block_list.18.attn_norm.weight
FP32-Chat/transformer.block_list.18.proj_norm.weight
FP32-Chat/transformer.block_list.19.attn_norm.weight
FP32-Chat/transformer.block_list.19.proj_norm.weight
FP32-Chat/transformer.block_list.2.attn_norm.weight
FP32-Chat/transformer.block_list.2.proj_norm.weight
FP32-Chat/transformer.block_list.20.attn_norm.weight
FP32-Chat/transformer.block_list.20.proj_norm.weight
FP32-Chat/transformer.block_list.21.attn_norm.weight
FP32-Chat/transformer.block_list.21.proj_norm.weight
FP32-Chat/transformer.block_list.22.attn_norm.weight
FP32-Chat/transformer.block_list.22.proj_norm.weight
FP32-Chat/transformer.block_list.23.attn_norm.weight
FP32-Chat/transformer.block_list.23.proj_norm.weight
FP32-Chat/transformer.block_list.24.attn_norm.weight
FP32-Chat/transformer.block_list.24.proj_norm.weight
FP32-Chat/transformer.block_list.25.attn_norm.weight
FP32-Chat/transformer.block_list.25.proj_norm.weight
FP32-Chat/transformer.block_list.26.attn_norm.weight
FP32-Chat/transformer.block_list.26.proj_norm.weight
FP32-Chat/transformer.block_list.27.attn_norm.weight
FP32-Chat/transformer.block_list.27.proj_norm.weight
FP32-Chat/transformer.block_list.28.attn_norm.weight
FP32-Chat/transformer.block_list.28.proj_norm.weight
FP32-Chat/transformer.block_list.29.attn_norm.weight
FP32-Chat/transformer.block_list.29.proj_norm.weight
FP32-Chat/transformer.block_list.3.attn_norm.weight
FP32-Chat/transformer.block_list.3.proj_norm.weight
FP32-Chat/transformer.block_list.30.attn_norm.weight
FP32-Chat/transformer.block_list.30.proj_norm.weight
FP32-Chat/transformer.block_list.31.attn_norm.weight
FP32-Chat/transformer.block_list.31.proj_norm.weight
FP32-Chat/transformer.block_list.4.attn_norm.weight
FP32-Chat/transformer.block_list.4.proj_norm.weight
FP32-Chat/transformer.block_list.5.attn_norm.weight
FP32-Chat/transformer.block_list.5.proj_norm.weight
FP32-Chat/transformer.block_list.6.attn_norm.weight
FP32-Chat/transformer.block_list.6.proj_norm.weight
FP32-Chat/transformer.block_list.7.attn_norm.weight
FP32-Chat/transformer.block_list.7.proj_norm.weight
FP32-Chat/transformer.block_list.8.attn_norm.weight
FP32-Chat/transformer.block_list.8.proj_norm.weight
FP32-Chat/transformer.block_list.9.attn_norm.weight
FP32-Chat/transformer.block_list.9.proj_norm.weight
FP32-Chat/transformer.layer_norm.weight
FP32/Constant_68_attr__value
FP32/Constant_76_attr__value
FP32/LlamaV2_7B_float32.onnx
ONNX
FP32/embeddings.data
FP32/onnx__MatMul_20605
FP32/onnx__MatMul_20606
FP32/onnx__MatMul_20607
FP32/onnx__MatMul_20627
FP32/onnx__MatMul_20628
FP32/onnx__MatMul_20629
FP32/onnx__MatMul_20630
FP32/onnx__MatMul_20631
FP32/onnx__MatMul_20632
FP32/onnx__MatMul_20633
FP32/onnx__MatMul_20653
FP32/onnx__MatMul_20654
FP32/onnx__MatMul_20655
FP32/onnx__MatMul_20656
FP32/onnx__MatMul_20657
FP32/onnx__MatMul_20658
FP32/onnx__MatMul_20659
FP32/onnx__MatMul_20679
FP32/onnx__MatMul_20680
FP32/onnx__MatMul_20681
FP32/onnx__MatMul_20682
FP32/onnx__MatMul_20683
FP32/onnx__MatMul_20684
FP32/onnx__MatMul_20685
FP32/onnx__MatMul_20705
FP32/onnx__MatMul_20706
FP32/onnx__MatMul_20707
FP32/onnx__MatMul_20708
FP32/onnx__MatMul_20709
FP32/onnx__MatMul_20710
FP32/onnx__MatMul_20711
FP32/onnx__MatMul_20731
FP32/onnx__MatMul_20732
FP32/onnx__MatMul_20733
FP32/onnx__MatMul_20734
FP32/onnx__MatMul_20735
FP32/onnx__MatMul_20736
FP32/onnx__MatMul_20737
FP32/onnx__MatMul_20757
FP32/onnx__MatMul_20758
FP32/onnx__MatMul_20759
FP32/onnx__MatMul_20760
FP32/onnx__MatMul_20761
FP32/onnx__MatMul_20762
FP32/onnx__MatMul_20763
FP32/onnx__MatMul_20783
FP32/onnx__MatMul_20784
FP32/onnx__MatMul_20785
FP32/onnx__MatMul_20786
FP32/onnx__MatMul_20787
FP32/onnx__MatMul_20788
FP32/onnx__MatMul_20789
FP32/onnx__MatMul_20809
FP32/onnx__MatMul_20810
FP32/onnx__MatMul_20811
FP32/onnx__MatMul_20812
FP32/onnx__MatMul_20813
FP32/onnx__MatMul_20814
FP32/onnx__MatMul_20815
FP32/onnx__MatMul_20835
FP32/onnx__MatMul_20836
FP32/onnx__MatMul_20837
FP32/onnx__MatMul_20838
FP32/onnx__MatMul_20839
FP32/onnx__MatMul_20840
FP32/onnx__MatMul_20841
FP32/onnx__MatMul_20861
FP32/onnx__MatMul_20862
FP32/onnx__MatMul_20863
FP32/onnx__MatMul_20864
FP32/onnx__MatMul_20865
FP32/onnx__MatMul_20866
FP32/onnx__MatMul_20867
FP32/onnx__MatMul_20887
FP32/onnx__MatMul_20888
FP32/onnx__MatMul_20889
FP32/onnx__MatMul_20890
FP32/onnx__MatMul_20891
FP32/onnx__MatMul_20892
FP32/onnx__MatMul_20893
FP32/onnx__MatMul_20913
FP32/onnx__MatMul_20914
FP32/onnx__MatMul_20915
FP32/onnx__MatMul_20916
FP32/onnx__MatMul_20917
FP32/onnx__MatMul_20918
FP32/onnx__MatMul_20919
FP32/onnx__MatMul_20939
FP32/onnx__MatMul_20940
FP32/onnx__MatMul_20941
FP32/onnx__MatMul_20942
FP32/onnx__MatMul_20943
FP32/onnx__MatMul_20944
FP32/onnx__MatMul_20945
FP32/onnx__MatMul_20965
FP32/onnx__MatMul_20966
FP32/onnx__MatMul_20967
FP32/onnx__MatMul_20968
FP32/onnx__MatMul_20969
FP32/onnx__MatMul_20970
FP32/onnx__MatMul_20971
FP32/onnx__MatMul_20991
FP32/onnx__MatMul_20992
FP32/onnx__MatMul_20993
FP32/onnx__MatMul_20994
FP32/onnx__MatMul_20995
FP32/onnx__MatMul_20996
FP32/onnx__MatMul_20997
FP32/onnx__MatMul_21017
FP32/onnx__MatMul_21018
FP32/onnx__MatMul_21019
FP32/onnx__MatMul_21020
FP32/onnx__MatMul_21021
FP32/onnx__MatMul_21022
FP32/onnx__MatMul_21023
FP32/onnx__MatMul_21043
FP32/onnx__MatMul_21044
FP32/onnx__MatMul_21045
FP32/onnx__MatMul_21046
FP32/onnx__MatMul_21047
FP32/onnx__MatMul_21048
FP32/onnx__MatMul_21049
FP32/onnx__MatMul_21069
FP32/onnx__MatMul_21070
FP32/onnx__MatMul_21071
FP32/onnx__MatMul_21072
FP32/onnx__MatMul_21073
FP32/onnx__MatMul_21074
FP32/onnx__MatMul_21075
FP32/onnx__MatMul_21095
FP32/onnx__MatMul_21096
FP32/onnx__MatMul_21097
FP32/onnx__MatMul_21098
FP32/onnx__MatMul_21099
FP32/onnx__MatMul_21100
FP32/onnx__MatMul_21101
FP32/onnx__MatMul_21121
FP32/onnx__MatMul_21122
FP32/onnx__MatMul_21123
FP32/onnx__MatMul_21124
FP32/onnx__MatMul_21125
FP32/onnx__MatMul_21126
FP32/onnx__MatMul_21127
FP32/onnx__MatMul_21147
FP32/onnx__MatMul_21148
FP32/onnx__MatMul_21149
FP32/onnx__MatMul_21150
FP32/onnx__MatMul_21151
FP32/onnx__MatMul_21152
FP32/onnx__MatMul_21153
FP32/onnx__MatMul_21173
FP32/onnx__MatMul_21174
FP32/onnx__MatMul_21175
FP32/onnx__MatMul_21176
FP32/onnx__MatMul_21177
FP32/onnx__MatMul_21178
FP32/onnx__MatMul_21179
FP32/onnx__MatMul_21199
FP32/onnx__MatMul_21200
FP32/onnx__MatMul_21201
FP32/onnx__MatMul_21202
FP32/onnx__MatMul_21203
FP32/onnx__MatMul_21204
FP32/onnx__MatMul_21205
FP32/onnx__MatMul_21225
FP32/onnx__MatMul_21226
FP32/onnx__MatMul_21227
FP32/onnx__MatMul_21228
FP32/onnx__MatMul_21229
FP32/onnx__MatMul_21230
FP32/onnx__MatMul_21231
FP32/onnx__MatMul_21251
FP32/onnx__MatMul_21252
FP32/onnx__MatMul_21253
FP32/onnx__MatMul_21254
FP32/onnx__MatMul_21255
FP32/onnx__MatMul_21256
FP32/onnx__MatMul_21257
FP32/onnx__MatMul_21277
FP32/onnx__MatMul_21278
FP32/onnx__MatMul_21279
FP32/onnx__MatMul_21280
FP32/onnx__MatMul_21281
FP32/onnx__MatMul_21282
FP32/onnx__MatMul_21283
FP32/onnx__MatMul_21303
FP32/onnx__MatMul_21304
FP32/onnx__MatMul_21305
FP32/onnx__MatMul_21306
FP32/onnx__MatMul_21307
FP32/onnx__MatMul_21308
FP32/onnx__MatMul_21309
FP32/onnx__MatMul_21329
FP32/onnx__MatMul_21330
FP32/onnx__MatMul_21331
FP32/onnx__MatMul_21332
FP32/onnx__MatMul_21333
FP32/onnx__MatMul_21334
FP32/onnx__MatMul_21335
FP32/onnx__MatMul_21355
FP32/onnx__MatMul_21356
FP32/onnx__MatMul_21357
FP32/onnx__MatMul_21358
FP32/onnx__MatMul_21359
FP32/onnx__MatMul_21360
FP32/onnx__MatMul_21361
FP32/onnx__MatMul_21381
FP32/onnx__MatMul_21382
FP32/onnx__MatMul_21383
FP32/onnx__MatMul_21384
FP32/onnx__MatMul_21385
FP32/onnx__MatMul_21386
FP32/onnx__MatMul_21387
FP32/onnx__MatMul_21407
FP32/onnx__MatMul_21408
FP32/onnx__MatMul_21409
FP32/onnx__MatMul_21410
FP32/onnx__MatMul_21411
FP32/onnx__MatMul_21412
FP32/onnx__MatMul_21413
FP32/onnx__MatMul_21433
FP32/onnx__MatMul_21434
FP32/onnx__MatMul_21435
FP32/onnx__MatMul_21436
FP32/onnx__MatMul_21437
FP32/transformer.block_list.0.attn_norm.weight
FP32/transformer.block_list.0.proj_norm.weight
FP32/transformer.block_list.1.attn_norm.weight
FP32/transformer.block_list.1.proj_norm.weight
FP32/transformer.block_list.10.attn_norm.weight
FP32/transformer.block_list.10.proj_norm.weight
FP32/transformer.block_list.11.attn_norm.weight
FP32/transformer.block_list.11.proj_norm.weight
FP32/transformer.block_list.12.attn_norm.weight
FP32/transformer.block_list.12.proj_norm.weight
FP32/transformer.block_list.13.attn_norm.weight
FP32/transformer.block_list.13.proj_norm.weight
FP32/transformer.block_list.14.attn_norm.weight
FP32/transformer.block_list.14.proj_norm.weight
FP32/transformer.block_list.15.attn_norm.weight
FP32/transformer.block_list.15.proj_norm.weight
FP32/transformer.block_list.16.attn_norm.weight
FP32/transformer.block_list.16.proj_norm.weight
FP32/transformer.block_list.17.attn_norm.weight
FP32/transformer.block_list.17.proj_norm.weight
FP32/transformer.block_list.18.attn_norm.weight
FP32/transformer.block_list.18.proj_norm.weight
FP32/transformer.block_list.19.attn_norm.weight
FP32/transformer.block_list.19.proj_norm.weight
FP32/transformer.block_list.2.attn_norm.weight
FP32/transformer.block_list.2.proj_norm.weight
FP32/transformer.block_list.20.attn_norm.weight
FP32/transformer.block_list.20.proj_norm.weight
FP32/transformer.block_list.21.attn_norm.weight
FP32/transformer.block_list.21.proj_norm.weight
FP32/transformer.block_list.22.attn_norm.weight
FP32/transformer.block_list.22.proj_norm.weight
FP32/transformer.block_list.23.attn_norm.weight
FP32/transformer.block_list.23.proj_norm.weight
FP32/transformer.block_list.24.attn_norm.weight
FP32/transformer.block_list.24.proj_norm.weight
FP32/transformer.block_list.25.attn_norm.weight
FP32/transformer.block_list.25.proj_norm.weight
FP32/transformer.block_list.26.attn_norm.weight
FP32/transformer.block_list.26.proj_norm.weight
FP32/transformer.block_list.27.attn_norm.weight
FP32/transformer.block_list.27.proj_norm.weight
FP32/transformer.block_list.28.attn_norm.weight
FP32/transformer.block_list.28.proj_norm.weight
FP32/transformer.block_list.29.attn_norm.weight
FP32/transformer.block_list.29.proj_norm.weight
FP32/transformer.block_list.3.attn_norm.weight
FP32/transformer.block_list.3.proj_norm.weight
FP32/transformer.block_list.30.attn_norm.weight
FP32/transformer.block_list.30.proj_norm.weight
FP32/transformer.block_list.31.attn_norm.weight
FP32/transformer.block_list.31.proj_norm.weight
FP32/transformer.block_list.4.attn_norm.weight
FP32/transformer.block_list.4.proj_norm.weight
FP32/transformer.block_list.5.attn_norm.weight
FP32/transformer.block_list.5.proj_norm.weight
FP32/transformer.block_list.6.attn_norm.weight
FP32/transformer.block_list.6.proj_norm.weight
FP32/transformer.block_list.7.attn_norm.weight
FP32/transformer.block_list.7.proj_norm.weight
FP32/transformer.block_list.8.attn_norm.weight
FP32/transformer.block_list.8.proj_norm.weight
FP32/transformer.block_list.9.attn_norm.weight
FP32/transformer.block_list.9.proj_norm.weight
FP32/transformer.layer_norm.weight
README.md
embeddings-chat.pth
embeddings.pth
llama2_onnx_inference.py
requirements.txt
tokenizer.model