mit-han-lab/efficientvit-sam
By mit-han-lab · ↓ 0 · ♥ 42 · Updated 2025-01-06
What's in this repo
This page lists the files in mit-han-lab/efficientvit-sam, including depth_m.onnx, evit_decoder_l0.onnx, evit_encoder_l0.onnx and more.
- 17 ONNX models (.onnx files)
- 38 files, including 17 .onnx, 9 .pt, 4 .json, 2 .cache, 1 .txt, 1 .md
- Last updated 2025-01-06
ONNX files
| File | Size | Download |
|---|---|---|
| gazesam/onnx/depth_m.onnx | — | Download |
| gazesam/onnx/evit_decoder_l0.onnx | — | Download |
| gazesam/onnx/evit_encoder_l0.onnx | — | Download |
| gazesam/onnx/face_detection.onnx | — | Download |
| gazesam/onnx/gaze_estimation.onnx | — | Download |
| gazesam/onnx/yolo_m.onnx | — | Download |
| gazesam/onnx/yolo_m_ort.onnx | — | Download |
| onnx/l0_decoder.onnx | — | Download |
| onnx/l0_encoder.onnx | — | Download |
| onnx/l1_decoder.onnx | — | Download |
Showing 10 of 17 .onnx files — see the full file list on the right.
How to use
These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.
README
EfficientViT-SAM: Accelerated Segment Anything Model Without Performance Loss
Pretrained Models
Latency/Throughput is measured on NVIDIA Jetson AGX Orin, and NVIDIA A100 GPU with TensorRT, fp16. Data transfer time is included.
| Model | Resolution | COCO mAP | LVIS mAP | Params | MACs | Jetson Orin Latency (bs1) | A100 Throughput (bs16) | Checkpoint |
|---|---|---|---|---|---|---|---|---|
| EfficientViT-SAM-L0 | 512x512 | 45.7 | 41.8 | 34.8M | 35G | 8.2ms | 762 images/s | link |
| EfficientViT-SAM-L1 | 512x512 | 46.2 | 42.1 | 47.7M | 49G | 10.2ms | 638 images/s | link |
| EfficientViT-SAM-L2 | 512x512 | 46.6 | 42.7 | 61.3M | 69G | 12.9ms | 538 images/s | link |
| EfficientViT-SAM-XL0 | 1024x1024 | 47.5 | 43.9 | 117.0M | 185G | 22.5ms | 278 images/s | link |
| EfficientViT-SAM-XL1 | 1024x1024 | 47.8 | 44.4 | 203.3M | 322G | 37.2ms | 182 images/s | link |
** Table1: Summary of All EfficientViT-SAM Variants.** COCO mAP and LVIS mAP are measured using ViTDet's predicted bounding boxes as the prompt. End-to-end Jetson Orin latency and A100 throughput are measured with TensorRT and fp16.
Usage
# segment anything
from efficientvit.sam_model_zoo import create_sam_model
efficientvit_sam = create_sam_model(
name="xl1", weight_url="assets/checkpoints/sam/xl1.pt",
)
efficientvit_sam = efficientvit_sam.cuda().eval()
from efficientvit.models.efficientvit.sam import EfficientViTSamPredictor
efficientvit_sam_predictor = EfficientViTSamPredictor(efficientvit_sam)
from efficientvit.models.efficientvit.sam import EfficientViTSamAutomaticMaskGenerator
efficientvit_mask_generator = EfficientViTSamAutomaticMaskGenerator(efficientvit_sam)
Model info
Created: 2023-09-30
Updated: 2025-01-06
View on Hugging FaceFiles (38)
Related models
More from mit-han-lab
No other models by this author.