shubha07m/yolo_phantom
By shubha07m · ↓ 0 · ♥ 1 · Updated 2024-02-29
What's in this repo
This page lists the files in shubha07m/yolo_phantom, including yolophantom.onnx.
- 1 ONNX models (.onnx files)
- 78 files, including 52 .yaml, 17 .py, 2 .md, 2 .png, 1 .pdf, 1 .onnx
- Last updated 2024-02-29
ONNX files
| File | Size | Download |
|---|---|---|
| yolo_phantom/multimodal_trained_weights/yolophantom.onnx | — | Download |
How to use
These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.
README
MODIPHY:
Multimodal Obscured Detection for IoT using PHantom Convolution-Enabled Faster YOLO
We developed “YOLO Phantom” for detection in low-light conditions and occluded scenarios within resource-constrained IoT applications. We proposed the novel "Phantom Convolution," which enables YOLO Phantom to achieve comparable accuracy to YOLOv8n with a 43% reduction in parameters and size, resulting in a 19% reduction in GFLOPs. By employing transfer learning on our multimodal dataset, the model demonstrates enhanced vision capabilities in adverse conditions. Our Raspberry Pi IoT platform equipped with noIR cameras and integration with AWS IoT Core and SNS showcases a substantial 17% and 14% boost in frames per second for thermal and RGB data detection, respectively, compared to the baseline YOLOv8n model.
Comparison of small models
Detection in various low light and occluded conditions
To know more about the MODIPHY please refer to the preprint available in arXiv
Please refer to yolo_phantom for the implementation.
Download the multimodal dataset
If you find this work useful consider citing us:
@article{mukherjee2024modiphy, title={MODIPHY: Multimodal Obscured Detection for IoT using PHantom Convolution-Enabled Faster YOLO}, author={Mukherjee, Shubhabrata and Beard, Cory and Li, Zhu}, journal={arXiv preprint arXiv:2402.07894}, year={2024} }
Model info
Created: 2024-02-29
Updated: 2024-02-29
View on Hugging FaceFiles (78)
Related models
More from shubha07m
No other models by this author.