ONNX Model Zoo

pesi/rtmo

By pesi · ↓ 0 · ♥ 2 · Updated 2024-09-04

What's in this repo

This page lists the files in pesi/rtmo, including rtmo-l.fp16.onnx, rtmo-l.onnx, rtmo-m.fp16.onnx and more.

  • 8 ONNX models (.onnx files)
  • 24 files, including 9 .py, 8 .onnx, 4 .sh, 1 .md, 1 .mp4
  • Last updated 2024-09-04

ONNX files

File Size Download
rtmo-l.fp16.onnx — Download
rtmo-l.onnx — Download
rtmo-m.fp16.onnx — Download
rtmo-m.onnx — Download
rtmo-s.fp16.onnx — Download
rtmo-s.onnx — Download
rtmo-t.fp16.onnx — Download
rtmo-t.onnx — Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

RTMO / YOLO-NAS-Pose Inference with CUDAExecutionProvider / TensorrtExecutionProvider DEMO

  • demo.sh: DEMO main program, which will first install rtmlib, and then use rtmo-s to analyze the .mp4 files in the video folder.
  • demo_batch.sh: Multi-batch version of demo.sh
  • rtmo_gpu.py: Defines an RTMO_GPU (& RTMO_GPU_BATCH) class, making fine adjustments to CUDA & TensorRT settings.
  • rtmo_demo.py: Python main program, which has three arguments:
    • path: The folder location that contains the .mp4 files to be analyzed.
    • model_path: The local path to the ONNX model or a URL pointing to the RTMO model published on mmpose.
    • --yolo_nas_pose: If you run inference with YOLO NAS Pose Model instead of RTMO model.
  • rtmo_demo_batch.py: Multi-batch version of demo_batch.sh
  • video: Contains one test video.

Note

  • Original ONNX models come from MMPOSE/RTMO Project Page trained on body7. We did only
  • DEMO Inferecne Code is modified from rtmlib
  • TensorrtExecutionProvider only supports Models with fixed batch size (*_batchN.onnx) while CUDAExecutionProvider can run with dynamic batch size.

We did the following to make them work with TensorRTExecutionProvdier

  1. Shape inference
  2. batch size 1,2,4 fixation

PS. FP16 ONNX model is also provided.

Model info

onnx Pose Estimation object-detection license:mit region:us
↓ 0 ♥ 2

Created: 2024-03-01

Updated: 2024-09-04

View on Hugging Face

Files (24)

.gitattributes
README.md
constant_folding.sh
convert_to_fp16.py
convert_to_fp16_all.py
convert_to_mixed.py
demo.sh
demo_batch.sh
onnx_to_engine-jetpack_4p6.py
onnx_to_engine-jetpack_5p1.py
rtmo-l.fp16.onnx ONNX
rtmo-l.onnx ONNX
rtmo-m.fp16.onnx ONNX
rtmo-m.onnx ONNX
rtmo-s.fp16.onnx ONNX
rtmo-s.onnx ONNX
rtmo-t.fp16.onnx ONNX
rtmo-t.onnx ONNX
rtmo_demo.py
rtmo_demo_batch.py
rtmo_gpu.py
symbolic_shape_infer.py
symbolic_shape_infer_all.sh
video/Oldest video ever - 1888 [tc-L9_4jGc4].mp4

Related models