Esperanto/llava-dermatology-7b-kvc-fp16-onnx

By Esperanto · ↓ 0 · ♥ 0 · Updated 2024-12-05

What's in this repo

This page lists the files in Esperanto/llava-dermatology-7b-kvc-fp16-onnx, including model.onnx, EtGlowExecutionProvider_GLOW_graph_Extracted_from_-torch_jit-_6806550636181209556_0_0_0.onnx and more.

5 ONNX models (.onnx files)
299 files, including 67 .weight, 5 .onnx, 1 .md
Last updated 2024-12-05

ONNX files

File	Size	Download
clip/model.onnx	—	Download
embeds/EtGlowExecutionProvider_GLOW_graph_Extracted_from_-torch_jit-_6806550636181209556_0_0_0.onnx	—	Download
embeds/model.onnx	—	Download
llama/model.onnx	—	Download
mmp/model.onnx	—	Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

Model Card for Model ID

Model Details

Fine tuned version of LLaVA 7B through transfer learning on Dermatology Images. This version is the ONNX model in fp16 precision and KVC. Stay tuned for instructions on how to run this ONNX pipeline with OnnxRuntime!

Model Description

Given the rise in demand for reliable and immediate medical advice, particularly in dermatology, this tool empowers users to consult an "online dermatologist" by providing essential information, an image of the affected area, and asking follow-up questions, closely mimicking an actual consultation.

To achieve this, we fine-tuned LLaVA 7B with LoRA on the Skin Condition Image Network (SCIN) dataset, equipping it with the ability to process and analyze user-provided images, such as rashes, inflammations, or other skin conditions, and give patients diagnoses with high accuracy.

Developed by: Esperanto Technologies
Finetuned from model: llava-hf/llava-1.5-7b-hf
Blog: Updating soon

Uses

Put the information in the demo questionnaire together and form context such as:

'This is a CLOSE UP picture of a patient's skin problem. The patient is within the age group of AGE 18 TO 29. The patient is a MALE. The patient is Hispanic Latino or Spanish Origin. The texture of the skin problem is flat, rough or flaky. The skin problem comes with increasing size, itching and burning symptoms. The skin problem comes with pain. The skin problem doesn't come with other symptoms. The patient's skin problem has been ONE TO FOUR WEEKS.'

Along with system prompt and user question like "Please diagnose what skin condition is most likely in the picture."

Model info

transformers

transformers onnx base_model:Esperanto/llava-dermatology-7b-v1.5-hf base_model:quantized:Esperanto/llava-dermatology-7b-v1.5-hf endpoints_compatible region:us

↓ 0 ♥ 0

Created: 2024-11-07

Updated: 2024-12-05

View on Hugging Face

Files (299)

.gitattributes

README.md

clip/model.onnx ONNX

embeds/EtGlowExecutionProvider_GLOW_graph_Extracted_from_-torch_jit-_6806550636181209556_0_0_0.onnx ONNX

embeds/model.embed_tokens.weight

embeds/model.onnx ONNX

llama/model.embed_tokens.weight

llama/model.layers.0.input_layernorm.weight

llama/model.layers.0.post_attention_layernorm.weight

llama/model.layers.1.input_layernorm.weight

llama/model.layers.1.post_attention_layernorm.weight

llama/model.layers.10.input_layernorm.weight

llama/model.layers.10.post_attention_layernorm.weight

llama/model.layers.11.input_layernorm.weight

llama/model.layers.11.post_attention_layernorm.weight

llama/model.layers.12.input_layernorm.weight

llama/model.layers.12.post_attention_layernorm.weight

llama/model.layers.13.input_layernorm.weight

llama/model.layers.13.post_attention_layernorm.weight

llama/model.layers.14.input_layernorm.weight

llama/model.layers.14.post_attention_layernorm.weight

llama/model.layers.15.input_layernorm.weight

llama/model.layers.15.post_attention_layernorm.weight

llama/model.layers.16.input_layernorm.weight

llama/model.layers.16.post_attention_layernorm.weight

llama/model.layers.17.input_layernorm.weight

llama/model.layers.17.post_attention_layernorm.weight

llama/model.layers.18.input_layernorm.weight

llama/model.layers.18.post_attention_layernorm.weight

llama/model.layers.19.input_layernorm.weight

llama/model.layers.19.post_attention_layernorm.weight

llama/model.layers.2.input_layernorm.weight

llama/model.layers.2.post_attention_layernorm.weight

llama/model.layers.20.input_layernorm.weight

llama/model.layers.20.post_attention_layernorm.weight

llama/model.layers.21.input_layernorm.weight

llama/model.layers.21.post_attention_layernorm.weight

llama/model.layers.22.input_layernorm.weight

llama/model.layers.22.post_attention_layernorm.weight

llama/model.layers.23.input_layernorm.weight

llama/model.layers.23.post_attention_layernorm.weight

llama/model.layers.24.input_layernorm.weight

llama/model.layers.24.post_attention_layernorm.weight

llama/model.layers.25.input_layernorm.weight

llama/model.layers.25.post_attention_layernorm.weight

llama/model.layers.26.input_layernorm.weight

llama/model.layers.26.post_attention_layernorm.weight

llama/model.layers.27.input_layernorm.weight

llama/model.layers.27.post_attention_layernorm.weight

llama/model.layers.28.input_layernorm.weight

llama/model.layers.28.post_attention_layernorm.weight

llama/model.layers.29.input_layernorm.weight

llama/model.layers.29.post_attention_layernorm.weight

llama/model.layers.3.input_layernorm.weight

llama/model.layers.3.post_attention_layernorm.weight

llama/model.layers.30.input_layernorm.weight

llama/model.layers.30.post_attention_layernorm.weight

llama/model.layers.31.input_layernorm.weight

llama/model.layers.31.post_attention_layernorm.weight

llama/model.layers.4.input_layernorm.weight

llama/model.layers.4.post_attention_layernorm.weight

llama/model.layers.5.input_layernorm.weight

llama/model.layers.5.post_attention_layernorm.weight

llama/model.layers.6.input_layernorm.weight

llama/model.layers.6.post_attention_layernorm.weight

llama/model.layers.7.input_layernorm.weight

llama/model.layers.7.post_attention_layernorm.weight

llama/model.layers.8.input_layernorm.weight

llama/model.layers.8.post_attention_layernorm.weight

llama/model.layers.9.input_layernorm.weight

llama/model.layers.9.post_attention_layernorm.weight

llama/model.norm.weight

llama/model.onnx ONNX

llama/onnx__MatMul_5891

llama/onnx__MatMul_5892

llama/onnx__MatMul_5893

llama/onnx__MatMul_5913

llama/onnx__MatMul_5914

llama/onnx__MatMul_5915

llama/onnx__MatMul_5916

llama/onnx__MatMul_5917

llama/onnx__MatMul_5918

llama/onnx__MatMul_5919

llama/onnx__MatMul_5937

llama/onnx__MatMul_5938

llama/onnx__MatMul_5939

llama/onnx__MatMul_5940

llama/onnx__MatMul_5941

llama/onnx__MatMul_5942

llama/onnx__MatMul_5943

llama/onnx__MatMul_5961

llama/onnx__MatMul_5962

llama/onnx__MatMul_5963

llama/onnx__MatMul_5964

llama/onnx__MatMul_5965

llama/onnx__MatMul_5966

llama/onnx__MatMul_5967

llama/onnx__MatMul_5985

llama/onnx__MatMul_5986

llama/onnx__MatMul_5987

llama/onnx__MatMul_5988

llama/onnx__MatMul_5989

llama/onnx__MatMul_5990

llama/onnx__MatMul_5991

llama/onnx__MatMul_6009

llama/onnx__MatMul_6010

llama/onnx__MatMul_6011

llama/onnx__MatMul_6012

llama/onnx__MatMul_6013

llama/onnx__MatMul_6014

llama/onnx__MatMul_6015

llama/onnx__MatMul_6033

llama/onnx__MatMul_6034

llama/onnx__MatMul_6035

llama/onnx__MatMul_6036

llama/onnx__MatMul_6037

llama/onnx__MatMul_6038

llama/onnx__MatMul_6039

llama/onnx__MatMul_6057

llama/onnx__MatMul_6058

llama/onnx__MatMul_6059

llama/onnx__MatMul_6060

llama/onnx__MatMul_6061

llama/onnx__MatMul_6062

llama/onnx__MatMul_6063

llama/onnx__MatMul_6081

llama/onnx__MatMul_6082

llama/onnx__MatMul_6083

llama/onnx__MatMul_6084

llama/onnx__MatMul_6085

llama/onnx__MatMul_6086

llama/onnx__MatMul_6087

llama/onnx__MatMul_6105

llama/onnx__MatMul_6106

llama/onnx__MatMul_6107

llama/onnx__MatMul_6108

llama/onnx__MatMul_6109

llama/onnx__MatMul_6110

llama/onnx__MatMul_6111

llama/onnx__MatMul_6129

llama/onnx__MatMul_6130

llama/onnx__MatMul_6131

llama/onnx__MatMul_6132

llama/onnx__MatMul_6133

llama/onnx__MatMul_6134

llama/onnx__MatMul_6135

llama/onnx__MatMul_6153

llama/onnx__MatMul_6154

llama/onnx__MatMul_6155

llama/onnx__MatMul_6156

llama/onnx__MatMul_6157

llama/onnx__MatMul_6158

llama/onnx__MatMul_6159

llama/onnx__MatMul_6177

llama/onnx__MatMul_6178

llama/onnx__MatMul_6179

llama/onnx__MatMul_6180

llama/onnx__MatMul_6181

llama/onnx__MatMul_6182

llama/onnx__MatMul_6183

llama/onnx__MatMul_6201

llama/onnx__MatMul_6202

llama/onnx__MatMul_6203

llama/onnx__MatMul_6204

llama/onnx__MatMul_6205

llama/onnx__MatMul_6206

llama/onnx__MatMul_6207

llama/onnx__MatMul_6225

llama/onnx__MatMul_6226

llama/onnx__MatMul_6227

llama/onnx__MatMul_6228

llama/onnx__MatMul_6229

llama/onnx__MatMul_6230

llama/onnx__MatMul_6231

llama/onnx__MatMul_6249

llama/onnx__MatMul_6250

llama/onnx__MatMul_6251

llama/onnx__MatMul_6252

llama/onnx__MatMul_6253

llama/onnx__MatMul_6254

llama/onnx__MatMul_6255

llama/onnx__MatMul_6273

llama/onnx__MatMul_6274

llama/onnx__MatMul_6275

llama/onnx__MatMul_6276

llama/onnx__MatMul_6277

llama/onnx__MatMul_6278

llama/onnx__MatMul_6279

llama/onnx__MatMul_6297

llama/onnx__MatMul_6298

llama/onnx__MatMul_6299

llama/onnx__MatMul_6300

llama/onnx__MatMul_6301

llama/onnx__MatMul_6302

llama/onnx__MatMul_6303

llama/onnx__MatMul_6321

llama/onnx__MatMul_6322

llama/onnx__MatMul_6323

llama/onnx__MatMul_6324

llama/onnx__MatMul_6325

llama/onnx__MatMul_6326

llama/onnx__MatMul_6327

llama/onnx__MatMul_6345

llama/onnx__MatMul_6346

llama/onnx__MatMul_6347

llama/onnx__MatMul_6348

llama/onnx__MatMul_6349

llama/onnx__MatMul_6350

llama/onnx__MatMul_6351

llama/onnx__MatMul_6369

llama/onnx__MatMul_6370

llama/onnx__MatMul_6371

llama/onnx__MatMul_6372

llama/onnx__MatMul_6373

llama/onnx__MatMul_6374

llama/onnx__MatMul_6375

llama/onnx__MatMul_6393

llama/onnx__MatMul_6394

llama/onnx__MatMul_6395

llama/onnx__MatMul_6396

llama/onnx__MatMul_6397

llama/onnx__MatMul_6398

llama/onnx__MatMul_6399

llama/onnx__MatMul_6417

llama/onnx__MatMul_6418

llama/onnx__MatMul_6419

llama/onnx__MatMul_6420

llama/onnx__MatMul_6421

llama/onnx__MatMul_6422

llama/onnx__MatMul_6423

llama/onnx__MatMul_6441

llama/onnx__MatMul_6442

llama/onnx__MatMul_6443

llama/onnx__MatMul_6444

llama/onnx__MatMul_6445

llama/onnx__MatMul_6446

llama/onnx__MatMul_6447

llama/onnx__MatMul_6465

llama/onnx__MatMul_6466

llama/onnx__MatMul_6467

llama/onnx__MatMul_6468

llama/onnx__MatMul_6469

llama/onnx__MatMul_6470

llama/onnx__MatMul_6471

llama/onnx__MatMul_6489

llama/onnx__MatMul_6490

llama/onnx__MatMul_6491

llama/onnx__MatMul_6492

llama/onnx__MatMul_6493

llama/onnx__MatMul_6494

llama/onnx__MatMul_6495

llama/onnx__MatMul_6513

llama/onnx__MatMul_6514

llama/onnx__MatMul_6515

llama/onnx__MatMul_6516

llama/onnx__MatMul_6517

llama/onnx__MatMul_6518

llama/onnx__MatMul_6519

llama/onnx__MatMul_6537

llama/onnx__MatMul_6538

llama/onnx__MatMul_6539

llama/onnx__MatMul_6540

llama/onnx__MatMul_6541

llama/onnx__MatMul_6542

llama/onnx__MatMul_6543

llama/onnx__MatMul_6561

llama/onnx__MatMul_6562

llama/onnx__MatMul_6563

llama/onnx__MatMul_6564

llama/onnx__MatMul_6565

llama/onnx__MatMul_6566

llama/onnx__MatMul_6567

llama/onnx__MatMul_6585

llama/onnx__MatMul_6586

llama/onnx__MatMul_6587

llama/onnx__MatMul_6588

llama/onnx__MatMul_6589

llama/onnx__MatMul_6590

llama/onnx__MatMul_6591

llama/onnx__MatMul_6609

llama/onnx__MatMul_6610

llama/onnx__MatMul_6611

llama/onnx__MatMul_6612

llama/onnx__MatMul_6613

llama/onnx__MatMul_6614

llama/onnx__MatMul_6615

llama/onnx__MatMul_6633

llama/onnx__MatMul_6634

llama/onnx__MatMul_6635

llama/onnx__MatMul_6636

llama/onnx__MatMul_6637

llama/onnx__MatMul_6638

llama/onnx__MatMul_6639

llama/onnx__MatMul_6657

llama/onnx__MatMul_6658

llama/onnx__MatMul_6659

llama/onnx__MatMul_6660

llama/onnx__MatMul_6661

mmp/model.onnx ONNX

Related models

More models

No task type declared.