ONNX Model Zoo

Sky-Kim/volumerendering-viewer-unity

By Sky-Kim · ↓ 0 · ♥ 1 · Updated 2026-03-12

What's in this repo

This page lists the files in Sky-Kim/volumerendering-viewer-unity, including brats_mri_segmentation.onnx.

  • 1 ONNX models (.onnx files)
  • 193 files, including 88 .meta, 31 .asset, 10 .cs, 7 .nrrd, 4 .json, 3 .shader
  • Last updated 2026-03-12

ONNX files

File Size Download
Assets/Models/brats_mri_segmentation.onnx — Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

Volume Rendering Viewer (Unity + SimpleITK)

Unity-based medical volume rendering viewer with SimpleITK loading, orthogonal MPR views, ROI editing, interactive 3D controls, cinematic volume rendering modes, and BraTS tumor segmentation overlay support.

Demo

Volume Rendering Viewer Unity Demo

Environment

  • Unity Editor: 6000.3.6f1
  • Sentis: 2.5.0
  • SimpleITK: 2.5.3
  • ITK: 5.4.5
  • Platform: macOS (arm64) / Windows (x86-64) / Android (arm64-v8a)

Controls

The viewer uses a 2x2 panel layout: ABC views, 3D view

Keyboard:

  • E / Q: Global zoom in/out
  • R: Reset volume rotation/scale, ROI, and zoom to the initial state

Mouse in 2D panes (A/B/C):

  • Mouse wheel: Move slice position on the pane axis
  • Drag ROI handles (overlay points): Adjust ROI box

Mouse in the 3D pane (bottom-right):

  • Left-click drag: Arcball-style 3D rotation
  • Mouse wheel: Global zoom

Rendering Modes

The SimpleITKVolumeRenderer component now exposes the following 3D rendering modes in the Inspector:

  • Unlit: transfer-function-based Direct Volume Rendering (DVR)
  • Isosurface: thresholded surface shading
  • CinematicStandard: gradient-based cinematic shading
  • CinematicAmbientOcclusion: cinematic shading with local ambient occlusion
  • CinematicHybrid: cinematic shading with volumetric shadowing and scattering blend

Notes:

  • CinematicAmbientOcclusion and CinematicHybrid are significantly more expensive than Unlit / Isosurface.
  • Desktop GPUs (macOS / Windows) are the intended target for the heavier cinematic modes.
  • Android can still run the same shader path, but lower maxSteps, cinematicShadowMaxSteps, and cinematicAoSamples are recommended.

VolView Porting

This Unity project was developed alongside Kitware VolView as a reference for cinematic volume rendering workflows and parameter tuning.

  • VolView is not a runtime dependency of this Unity viewer.
  • VolView keeps its own Apache-2.0 license.

Sample Data

Default sample path: Assets/StreamingAssets/Sample

  • Example formats: .mhd/.zraw, .nrrd, DICOM folder

Segmentation

This viewer can either load a pre-generated segmentation volume or generate one in the Unity Editor.

Editor generation:

  1. Put the volumes in Assets/StreamingAssets/Sample
  2. Set sampleFileName to a volume
  3. Use Generate Segmentation Volume from the SimpleITKVolumeLoader component menu on the Volume object
  4. The generated file is saved in Assets/StreamingAssets/Sample and assigned automatically

Overlay behavior:

  • The color map is loaded from StreamingAssets with segmentationColorMapFileName.txt
  • Text format: label,name,(r,g,b) or label,name,(r,g,b,a)

Segmentation Example:

This project uses the MONAI Model Zoo brats_mri_segmentation bundle and runs the exported ONNX model in Unity with Unity Sentis.

  • Model: brats_mri_segmentation
  • Architecture: SegResNet
  • Input: 4 aligned 3D MRI volumes (T1c, T1, T2, FLAIR)
  • Task: brain tumor subregion segmentation
  • Output: tumor core, whole tumor, and enhancing tumor
  • Reference: https://github.com/Project-MONAI/model-zoo/tree/dev/models/brats_mri_segmentation
  • Note: this is a research/demo workflow and not for diagnostic use

License

Unity Companion License

[volumerendering-viewer-unity] © 2026 Unity Technologies

Licensed under the Unity Companion License for Unity-dependent projects (see https://unity3d.com/legal/licenses/unity_companion_license). Unless expressly provided otherwise, the Software under this license is made available strictly on an "AS IS" BASIS WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED. Please review the license for details on these and other terms and conditions.

Model info

unity-sentis
unity-sentis onnx license:mit region:us
↓ 0 ♥ 1

Created: 2026-03-06

Updated: 2026-03-12

View on Hugging Face

Files (193)

.gitattributes
.gitignore
Assets/InputSystem_Actions.inputactions
Assets/InputSystem_Actions.inputactions.meta
Assets/Models.meta
Assets/Models/BratsSentisInference.cs
Assets/Models/BratsSentisInference.cs.meta
Assets/Models/brats_mri_segmentation.onnx ONNX
Assets/Models/brats_mri_segmentation.onnx.meta
Assets/Plugins.meta
Assets/Plugins/Android.meta
Assets/Plugins/Android/arm64-v8a.meta
Assets/Plugins/Android/arm64-v8a/libSimpleITKCSharpNative.so
Assets/Plugins/Android/arm64-v8a/libSimpleITKCSharpNative.so.meta
Assets/Plugins/SimpleITKCSharpManaged.dll
Assets/Plugins/SimpleITKCSharpManaged.dll.meta
Assets/Plugins/Windows.meta
Assets/Plugins/Windows/SimpleITKCSharpNative.dll
Assets/Plugins/Windows/SimpleITKCSharpNative.dll.meta
Assets/Plugins/macOS.meta
Assets/Plugins/macOS/libSimpleITKCSharpNative.dylib
Assets/Plugins/macOS/libSimpleITKCSharpNative.dylib.meta
Assets/Resources.meta
Assets/Resources/MedicalColorPresets.json
Assets/Resources/MedicalColorPresets.json.meta
Assets/Scenes.meta
Assets/Scenes/VolumeRenderingViewerScene.unity
Assets/Scenes/VolumeRenderingViewerScene.unity.meta
Assets/Scripts.meta
Assets/Scripts/SimpleITK.meta
Assets/Scripts/SimpleITK/SimpleITKNative.cs
Assets/Scripts/SimpleITK/SimpleITKNative.cs.meta
Assets/Scripts/SimpleITK/SimpleITKOrthogonalViewController.cs
Assets/Scripts/SimpleITK/SimpleITKOrthogonalViewController.cs.meta
Assets/Scripts/SimpleITK/SimpleITKPathUtility.cs
Assets/Scripts/SimpleITK/SimpleITKPathUtility.cs.meta
Assets/Scripts/SimpleITK/SimpleITKProcessingController.cs
Assets/Scripts/SimpleITK/SimpleITKProcessingController.cs.meta
Assets/Scripts/SimpleITK/SimpleITKRendererLocator.cs
Assets/Scripts/SimpleITK/SimpleITKRendererLocator.cs.meta
Assets/Scripts/SimpleITK/SimpleITKSliceRenderer.cs
Assets/Scripts/SimpleITK/SimpleITKSliceRenderer.cs.meta
Assets/Scripts/SimpleITK/SimpleITKTransferFunctionPresetLibrary.cs
Assets/Scripts/SimpleITK/SimpleITKTransferFunctionPresetLibrary.cs.meta
Assets/Scripts/SimpleITK/SimpleITKVolumeLoader.cs
Assets/Scripts/SimpleITK/SimpleITKVolumeLoader.cs.meta
Assets/Scripts/SimpleITK/SimpleITKVolumeRenderer.cs
Assets/Scripts/SimpleITK/SimpleITKVolumeRenderer.cs.meta
Assets/Settings.meta
Assets/Settings/DefaultVolumeProfile.asset
Assets/Settings/DefaultVolumeProfile.asset.meta
Assets/Settings/Mobile_RPAsset.asset
Assets/Settings/Mobile_RPAsset.asset.meta
Assets/Settings/Mobile_Renderer.asset
Assets/Settings/Mobile_Renderer.asset.meta
Assets/Settings/PC_RPAsset.asset
Assets/Settings/PC_RPAsset.asset.meta
Assets/Settings/PC_Renderer.asset
Assets/Settings/PC_Renderer.asset.meta
Assets/Settings/SampleSceneProfile.asset
Assets/Settings/SampleSceneProfile.asset.meta
Assets/Settings/UniversalRenderPipelineGlobalSettings.asset
Assets/Settings/UniversalRenderPipelineGlobalSettings.asset.meta
Assets/Shaders.meta
Assets/Shaders/SimpleITKCinematicVolumeRaymarch.shader
Assets/Shaders/SimpleITKCinematicVolumeRaymarch.shader.meta
Assets/Shaders/SimpleITKDirectVolumeRaymarch.shader
Assets/Shaders/SimpleITKDirectVolumeRaymarch.shader.meta
Assets/Shaders/SimpleITKSliceRenderer.shader
Assets/Shaders/SimpleITKSliceRenderer.shader.meta
Assets/Shaders/SimpleITKVolumeRaymarchCommon.hlsl
Assets/Shaders/SimpleITKVolumeRaymarchCommon.hlsl.meta
Assets/StreamingAssets.meta
Assets/StreamingAssets/BraTSSegmentationColorMap.txt
Assets/StreamingAssets/BraTSSegmentationColorMap.txt.meta
Assets/StreamingAssets/Sample.meta
Assets/StreamingAssets/Sample/BraTS2021_00000_flair.nrrd
Assets/StreamingAssets/Sample/BraTS2021_00000_flair.nrrd.meta
Assets/StreamingAssets/Sample/BraTS2021_00000_flair_seg.nrrd
Assets/StreamingAssets/Sample/BraTS2021_00000_flair_seg.nrrd.meta
Assets/StreamingAssets/Sample/BraTS2021_00000_t1.nrrd
Assets/StreamingAssets/Sample/BraTS2021_00000_t1.nrrd.meta
Assets/StreamingAssets/Sample/BraTS2021_00000_t1ce.nrrd
Assets/StreamingAssets/Sample/BraTS2021_00000_t1ce.nrrd.meta
Assets/StreamingAssets/Sample/BraTS2021_00000_t2.nrrd
Assets/StreamingAssets/Sample/BraTS2021_00000_t2.nrrd.meta
Assets/StreamingAssets/Sample/CTChest.nrrd
Assets/StreamingAssets/Sample/CTChest.nrrd.meta
Assets/StreamingAssets/Sample/DICOM_MR_SE000002.meta
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000000
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000000.meta
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000001
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000001.meta
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000002
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000002.meta
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000003
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000003.meta
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000004
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000004.meta
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000005
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000005.meta
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000006
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000006.meta
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000007
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000007.meta
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000008
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000008.meta
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000009
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000009.meta
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000010
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000010.meta
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000011
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000011.meta
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000012
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000012.meta
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000013
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000013.meta
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000014
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000014.meta
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000015
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000015.meta
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000016
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000016.meta
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000017
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000017.meta
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000018
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000018.meta
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000019
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000019.meta
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000020
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000020.meta
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000021
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000021.meta
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000022
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000022.meta
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000023
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000023.meta
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000024
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000024.meta
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000025
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000025.meta
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000026
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000026.meta
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000027
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000027.meta
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000028
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000028.meta
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000029
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000029.meta
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000030
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000030.meta
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000031
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/MR000031.meta
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/__manifest.txt
Assets/StreamingAssets/Sample/DICOM_MR_SE000002/__manifest.txt.meta
Assets/StreamingAssets/Sample/Kitware_Head_and_Neck.mha
Assets/StreamingAssets/Sample/Kitware_Head_and_Neck.mha.meta
Assets/StreamingAssets/Sample/MRHead.mhd
Assets/StreamingAssets/Sample/MRHead.mhd.meta
Assets/StreamingAssets/Sample/MRHead.nrrd
Assets/StreamingAssets/Sample/MRHead.nrrd.meta
Assets/StreamingAssets/Sample/MRHead.zraw
Assets/StreamingAssets/Sample/MRHead.zraw.meta
Packages/manifest.json
Packages/packages-lock.json
ProjectSettings/AudioManager.asset
ProjectSettings/ClusterInputManager.asset
ProjectSettings/DynamicsManager.asset
ProjectSettings/EditorBuildSettings.asset
ProjectSettings/EditorSettings.asset
ProjectSettings/GraphicsSettings.asset
ProjectSettings/InputManager.asset
ProjectSettings/MemorySettings.asset
ProjectSettings/MultiplayerManager.asset
ProjectSettings/NavMeshAreas.asset
ProjectSettings/PackageManagerSettings.asset
ProjectSettings/Packages/com.unity.dedicated-server/MultiplayerRolesSettings.asset
ProjectSettings/Physics2DSettings.asset
ProjectSettings/PresetManager.asset
ProjectSettings/ProjectSettings.asset
ProjectSettings/ProjectVersion.txt
ProjectSettings/QualitySettings.asset
ProjectSettings/SceneTemplateSettings.json
ProjectSettings/ShaderGraphSettings.asset
ProjectSettings/TagManager.asset
ProjectSettings/TimeManager.asset
ProjectSettings/URPProjectSettings.asset
ProjectSettings/UnityConnectSettings.asset
ProjectSettings/VFXManager.asset
ProjectSettings/VersionControlSettings.asset
ProjectSettings/XRSettings.asset
README.md
demo.gif

Related models

More from Sky-Kim

More models

No task type declared.

Popular models