commaai/commabody-gpt2
By commaai · ↓ 0 · ♥ 2 · Updated 2024-06-03
What's in this repo
This page lists the files in commaai/commabody-gpt2, including decoder.onnx, encoder.onnx, gpt2.onnx.
- 3 ONNX models (.onnx files)
- 5 files, including 3 .onnx, 1 .md
- Last updated 2024-06-03
ONNX files
How to use
These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.
README
This model has been trained on a larger version (194 minutes total) of the commabody dataset.
It includes a vqgan encoder/decoder fine tuned from imagenet. It compresses images of size 160x256 to 10x16 tokens.
It also includes a GPT2 model trained to predict the next frame, wheel speeds and actions. It can be used either as a simulator or as a policy. More details in our blog post.
You can run it on a comma body using our example script in body-jim.
Model info
Created: 2024-05-31
Updated: 2024-06-03
View on Hugging Face