YuanTang96/GreenPLM

By YuanTang96 · ↓ 9 · ♥ 1 · Updated 2025-05-27

What's in this repo

This page lists the files in YuanTang96/GreenPLM, including model.onnx, model_O1.onnx, model_O2.onnx and more.

9 ONNX models (.onnx files)
372 files, including 111 .py, 48 .json, 39 .sh, 26 .pyc, 12 .md, 12 .yaml
Last updated 2025-05-27

ONNX files

File	Size	Download
pretrained_weight/eval_model_weight/all-mpnet-base-v2/onnx/model.onnx	—	Download
pretrained_weight/eval_model_weight/all-mpnet-base-v2/onnx/model_O1.onnx	—	Download
pretrained_weight/eval_model_weight/all-mpnet-base-v2/onnx/model_O2.onnx	—	Download
pretrained_weight/eval_model_weight/all-mpnet-base-v2/onnx/model_O3.onnx	—	Download
pretrained_weight/eval_model_weight/all-mpnet-base-v2/onnx/model_O4.onnx	—	Download
pretrained_weight/eval_model_weight/all-mpnet-base-v2/onnx/model_qint8_arm64.onnx	—	Download
pretrained_weight/eval_model_weight/all-mpnet-base-v2/onnx/model_qint8_avx512.onnx	—	Download
pretrained_weight/eval_model_weight/all-mpnet-base-v2/onnx/model_qint8_avx512_vnni.onnx	—	Download
pretrained_weight/eval_model_weight/all-mpnet-base-v2/onnx/model_quint8_avx2.onnx	—	Download

How to use

These ONNX files can be loaded with ONNX Runtime. To inspect a model graph, upload the file to the Netron viewer. Download links point to the original files on Hugging Face.

README

More Text, Less Point: Towards 3D Data-Efficient Point-Language Understanding

Yuan Tang*&emsp; Xu Han*&emsp; Xianzhi Li✝&emsp; Qiao Yu&emsp; Jinfeng Xu&emsp; Yixue Hao&emsp; Long Hu&emsp; Min Chen 
  

Huazhong University of Science and Technology&emsp;South China University of Technology


AAAI 2025
[![](https://img.shields.io/badge/Paper-Arxiv-red)](https://arxiv.org/pdf/2408.15966)
[![](https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Model-blue)](https://huggingface.co/YuanTang96/GreenPLM)

🔍 Overview

pic_2

We introduce a new task of 3D data-efficient point-language understanding, aiming to enable LLMs to achieve robust 3D understanding with minimal 3D data.
We propose GreenPLM to tackle this 3D data-limited task from a novel perspective, enhancing point-LLM alignment with more free-text data.
we introduce a 6M T3D dataset, design a 3-stage training strategy, and present a 0M-Pooling module for token pooling.
We introduce the Accuracy-to-3D-Data Ratio (A3DR) to measure the efficiency of 3D data usage and establish an evaluation benchmark based on open-source LLMs.
GreenPLM outperforms previous models using only 12% of 3D data and even surpasses GPT4Point (660K 3D data) using only text, demonstrating superior 3D data efficiency.

📦 Training-and-Evaluation

Download project

The code, weights, and dataset of the project have already been uploaded to Hugging Face. Simply download them once to get started with the project.

Install Environment

Enter the project directory and execute the following command:

conda create -n greenplm python=3.10 -y
conda activate greenplm
bash  envInstall.sh

Project Directory Introduction

./greenplm/release contains the paper's weights, training scripts, and testing scripts.
./pretrained_weight stores the pre-trained weights required for the training and testing phases of the project.
./lava-vicuna_2024_4_Phi-3-mini-4k-instruct is the weight directory for Phi-3.
./dataset/T3D is the 6M dataset proposed in this project.
./dataset/T3D/stage_1/brief_1M_caption.json is the dataset for Stage I.
./dataset/T3D/stage_2/stage_2_data_210k.json is the dataset for Stage II.

Dataset Preparation

./dataset/Objaverse/8192_npy.zip contains the point cloud data from Objaverse that is required for this project. To unzip the dataset:

unzip ./dataset/Objaverse/8192_npy.zip -d ./dataset/Objaverse/

Inference

Paper Weights

GreenPLM-0

The model trained only on text data, i.e., (Stage I & Stage II).

bash ./release/paper/scripts/test/release_stage_2.sh

The output JSON results are saved in ./release/paper/result_json/stage_2.

GreenPLM

The model trained on a small amount of 3D data, i.e., (Stage I & Stage II & Stage III).

bash ./release/paper/scripts/test/release_stage_3.sh

The output JSON results are saved in ./release/paper/result_json/stage_3.

Weights Using All T3D Dataset

We also provide weights trained using the entire T3D dataset, meaning we use 5M data from T3D in Stage II, instead of just 210k as in our paper. (click to expand)

GreenPLM-0

The model trained only on text data, i.e., (Stage I & Stage II).

bash ./release/5M_data_seting/scripts/test/release_5M_stage_2.sh

The output JSON results are saved in ./release/5M_data_seting/result_json/stage_2.

GreenPLM

The model trained on a small amount of 3D data, i.e., (Stage I & Stage II & Stage III).

bash ./release/5M_data_seting/scripts/test/release_5M_stage_3.sh

The output JSON results are saved in ./release/5M_data_seting/result_json/stage_3.

Evaluation

Using LLM

You can get the DASHSCOPE_API_KEY from aliyun. The evaluation may require 9 CNY (~ 1.3 USD).
If you have enough GPU resources, you can also build your own Qwen2-72B-Instruct service, following the Qwen2. Then evaluate the results for free!

Evaluate the open vocabulary classification on objaverse

export PYTHONPATH=$PWD
export DASHSCOPE_API_KEY=sk-xxx
python ./pointllm/eval/evaluator_opensource_llm_QwenAPI.py  \
        --results_path /path/to/evaluation/PointLLM_brief_description_val_200_GT_Objaverse_classification_prompt0.json  \
        --eval_type open-free-form-classification  \
        --model_type qwen2-72b-instruct \
        --parallel --num_workers 4

export PYTHONPATH=$PWD
export DASHSCOPE_API_KEY=sk-xxx
python ./pointllm/eval/evaluator_opensource_llm_QwenAPI.py  \
        --results_path /path/to/evaluation/PointLLM_brief_description_val_200_GT_Objaverse_classification_prompt1.json  \
        --eval_type open-free-form-classification  \
        --model_type qwen2-72b-instruct \
        --parallel --num_workers 4

Evaluate the close-set zero-shot classification on ModelNet40

export PYTHONPATH=$PWD
export DASHSCOPE_API_KEY=sk-xxx
python ./pointllm/eval/evaluator_opensource_llm_QwenAPI.py  \
    --results_path /path/to/evaluation/ModelNet_classification_prompt0.json  \
    --eval_type modelnet-close-set-classification  \
    --model_type qwen2-72b-instruct \
    --parallel --num_workers 4

export PYTHONPATH=$PWD
export DASHSCOPE_API_KEY=sk-xxx
python ./pointllm/eval/evaluator_opensource_llm_QwenAPI.py  \
    --results_path /path/to/evaluation/ModelNet_classification_prompt1.json  \
    --eval_type modelnet-close-set-classification  \
    --model_type qwen2-72b-instruct \
    --parallel --num_workers 4

Evaluate the object captioning on objaverse

export PYTHONPATH=$PWD
export DASHSCOPE_API_KEY=sk-xxx
python ./pointllm/eval/evaluator_opensource_llm_QwenAPI.py  \
        --results_path /path/to/evaluation/PointLLM_brief_description_val_200_GT_Objaverse_captioning_prompt2.json  \
        --eval_type object-captioning  \
        --model_type qwen2-72b-instruct \
        --parallel --num_workers 4

Traditional Metric Evaluation

For the object captioning task, run the following command to evaluate model outputs with traditional metrics Sentence-BERT and SimCSE.

CUDA_VISIBLE_DEVICES=0 python pointllm/eval/traditional_evaluator.py --results_path /path/to/evaluation/PointLLM_brief_description_val_200_GT_Objaverse_captioning_prompt2.json

Training

Stage I

bash ./release/paper/scripts/train/1.sh

Stage II: GreenPLM-0

bash ./release/paper/scripts/train/2.sh

Stage III: GreenPLM

bash ./release/paper/scripts/train/3.sh

We also provide training scripts using the entire T3D dataset, meaning we use 5M data from T3D in Stage II, instead of just 210k as in our paper. (click to expand)

Stage II: GreenPLM-0

bash ./release/5M_data_seting/scripts/train/2.sh

Stage III: GreenPLM

bash ./release/5M_data_seting/scripts/train/3.sh

Note: You can modify the --output_dir argument in the scripts to set the output directory for the trained weights.

🔗 Citation

If you find our work helpful, please consider citing:

@inproceedings{tang2025more,
  title={More text, less point: Towards 3d data-efficient point-language understanding},
  author={Tang, Yuan and Han, Xu and Li, Xianzhi and Yu, Qiao and Xu, Jinfeng and Hao, Yixue and Hu, Long and Chen, Min},
  booktitle={Proceedings of the AAAI Conference on Artificial Intelligence},
  volume={39},
  number={7},
  pages={7284--7292},
  year={2025}
}

📄 License

This work is under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

📚 Related Work

Together, Let's make LLM for 3D great!

Point-Bind & Point-LLM: aligns point clouds with Image-Bind to reason multi-modality input without 3D-instruction data training.
3D-LLM: employs 2D foundation models to encode multi-view images of 3D point clouds.
PointLLM: employs 3D point clouds with LLaVA.
ShapeLLM: combines a powerful point cloud encoder with LLM for embodied scenes.
MiniGPT-3D : takes the first step toward efficient 3D-LLM, requiring only a single RTX 3090 GPU and one day of training time.

👏 Acknowledgements

We would like to thank the authors of PointLLM, Uni3D, Phi-3, and LLaVA-pp for their great works and repos.

Model info

onnx safetensors arxiv:2408.15966 arxiv:2309.00615 arxiv:2307.12981 arxiv:2308.16911 arxiv:2402.17766 arxiv:2405.01413 region:us

↓ 9 ♥ 1

Created: 2025-05-23

Updated: 2025-05-27

View on Hugging Face

Files (372)

.gitattributes

LICENSE

README.md

cog.yaml

config.json

dataset/Objaverse/8192_npy.zip

dataset/Objaverse/PointLLM_brief_description_val_200_GT.json

dataset/Objaverse/PointLLM_complex_50k_brief_40k_all_90k.json

dataset/T3D/stage_1/brief_1M_caption.json

dataset/T3D/stage_2/stage_2_data_210k.json

dataset/T3D/stage_2/stage_2_data_5M.json

dataset/modelnet40_data/modelnet40_test_8192pts_fps.dat

envInstall.sh

lava-vicuna_2024_4_Phi-3-mini-4k-instruct/.gitattributes

lava-vicuna_2024_4_Phi-3-mini-4k-instruct/CODE_OF_CONDUCT.md

lava-vicuna_2024_4_Phi-3-mini-4k-instruct/LICENSE

lava-vicuna_2024_4_Phi-3-mini-4k-instruct/NOTICE.md

lava-vicuna_2024_4_Phi-3-mini-4k-instruct/README.md

lava-vicuna_2024_4_Phi-3-mini-4k-instruct/SECURITY.md

lava-vicuna_2024_4_Phi-3-mini-4k-instruct/added_tokens.json

lava-vicuna_2024_4_Phi-3-mini-4k-instruct/config.json

lava-vicuna_2024_4_Phi-3-mini-4k-instruct/configuration_phi3.py

lava-vicuna_2024_4_Phi-3-mini-4k-instruct/generation_config.json

lava-vicuna_2024_4_Phi-3-mini-4k-instruct/model-00001-of-00002.safetensors

lava-vicuna_2024_4_Phi-3-mini-4k-instruct/model-00002-of-00002.safetensors

lava-vicuna_2024_4_Phi-3-mini-4k-instruct/model.safetensors.index.json

lava-vicuna_2024_4_Phi-3-mini-4k-instruct/modeling_phi3.py

lava-vicuna_2024_4_Phi-3-mini-4k-instruct/sample_finetune.py

lava-vicuna_2024_4_Phi-3-mini-4k-instruct/special_tokens_map.json

lava-vicuna_2024_4_Phi-3-mini-4k-instruct/tokenizer.json

lava-vicuna_2024_4_Phi-3-mini-4k-instruct/tokenizer.model

lava-vicuna_2024_4_Phi-3-mini-4k-instruct/tokenizer_config.json

llava/__init__.py

llava/__pycache__/__init__.cpython-310.pyc

llava/__pycache__/constants.cpython-310.pyc

llava/__pycache__/conversation.cpython-310.pyc

llava/__pycache__/mm_utils.cpython-310.pyc

llava/bpe_simple_vocab_16e6.txt.gz

llava/constants.py

llava/conversation.py

llava/eval/eval_gpt_review.py

llava/eval/eval_gpt_review_bench.py

llava/eval/eval_gpt_review_visual.py

llava/eval/eval_pope.py

llava/eval/eval_science_qa.py

llava/eval/eval_science_qa_gpt4.py

llava/eval/eval_science_qa_gpt4_requery.py

llava/eval/eval_textvqa.py

llava/eval/generate_webpage_data_from_table.py

llava/eval/m4c_evaluator.py

llava/eval/model_qa.py

llava/eval/model_vqa.py

llava/eval/model_vqa_loader.py

llava/eval/model_vqa_mmbench.py

llava/eval/model_vqa_science.py

llava/eval/qa_baseline_gpt35.py

llava/eval/run_llava.py

llava/eval/summarize_gpt_review.py

llava/eval/webpage/figures/alpaca.png

llava/eval/webpage/figures/bard.jpg

llava/eval/webpage/figures/chatgpt.svg

llava/eval/webpage/figures/llama.jpg

llava/eval/webpage/figures/swords_FILL0_wght300_GRAD0_opsz48.svg

llava/eval/webpage/figures/vicuna.jpeg

llava/eval/webpage/index.html

llava/eval/webpage/script.js

llava/eval/webpage/styles.css

llava/mm_utils.py

llava/model/__init__.py

llava/model/__pycache__/__init__.cpython-310.pyc

llava/model/__pycache__/builder.cpython-310.pyc

llava/model/__pycache__/llava_arch.cpython-310.pyc

llava/model/__pycache__/utils.cpython-310.pyc

llava/model/apply_delta.py

llava/model/bpe_simple_vocab_16e6.txt.gz

llava/model/builder.py

llava/model/consolidate.py

llava/model/language_model/__pycache__/llava_phi3.cpython-310.pyc

llava/model/language_model/llava_llama.py

llava/model/language_model/llava_mistral.py

llava/model/language_model/llava_mpt.py

llava/model/language_model/llava_phi3.py

llava/model/llava_arch.py

llava/model/make_delta.py

llava/model/multimodal_encoder/__pycache__/builder.cpython-310.pyc

llava/model/multimodal_encoder/__pycache__/clip_encoder.cpython-310.pyc

llava/model/multimodal_encoder/__pycache__/point_encoder.cpython-310.pyc

llava/model/multimodal_encoder/builder.py

llava/model/multimodal_encoder/clip_encoder.py

llava/model/multimodal_encoder/point_encoder.py

llava/model/multimodal_projector/__pycache__/Qformer.cpython-310.pyc

llava/model/multimodal_projector/__pycache__/builder.cpython-310.pyc

llava/model/multimodal_projector/builder.py

llava/model/utils.py

llava/serve/__init__.py

llava/serve/__pycache__/__init__.cpython-310.pyc

llava/serve/__pycache__/cli.cpython-310.pyc

llava/serve/controller.py

llava/serve/examples/extreme_ironing.jpg

llava/serve/examples/waterview.jpg

llava/serve/gradio_web_server.py

llava/serve/model_worker.py

llava/serve/register_worker.py

llava/serve/sglang_worker.py

llava/serve/test_message.py

llava/train/__pycache__/llava_trainer.cpython-310.pyc

llava/train/__pycache__/train.cpython-310.pyc

llava/train/llama_flash_attn_monkey_patch.py

llava/train/llama_xformers_attn_monkey_patch.py

llava/train/llava_trainer.py

llava/train/train.py

llava/train/train_mem.py

llava/train/train_xformers.py

llava/utils.py

media/3_stage.png

media/T3D.png

pointllm/__init__.py

pointllm/__pycache__/__init__.cpython-310.pyc

pointllm/__pycache__/conversation.cpython-310.pyc

pointllm/__pycache__/utils.cpython-310.pyc

pointllm/conversation.py

pointllm/data/__init__.py

pointllm/data/__pycache__/__init__.cpython-310.pyc

pointllm/data/__pycache__/modelnet.cpython-310.pyc

pointllm/data/__pycache__/object_point_dataset.cpython-310.pyc

pointllm/data/__pycache__/scanobjectNN.cpython-310.pyc

pointllm/data/__pycache__/utils.cpython-310.pyc

pointllm/data/modelnet.py

pointllm/data/modelnet_config/ModelNet40.yaml

pointllm/data/modelnet_config/modelnet40_shape_names_modified.txt

pointllm/data/modelnet_show.py

pointllm/data/object_point_dataset.py

pointllm/data/utils.py

pointllm/data/utils_backup.py

pointllm/eval/eval_modelnet_cls.py

pointllm/eval/eval_objaverse.py

pointllm/eval/evaluator_opensource_llm_QwenAPI.py

pointllm/eval/traditional_evaluator.py

pointllm/eval/utils.py

pointllm/model/__init__.py

pointllm/model/pointllm.py

pointllm/model/utils.py

pointllm/train/llama_flash_attn_monkey_patch.py

pointllm/train/pointllm_trainer.py

pointllm/train/train.py

pointllm/train/train_mem.py

pointllm/utils.py

pointnet++/Pointnet2_PyTorch/.pre-commit-config.yaml

pointnet++/Pointnet2_PyTorch/.travis.yml

pointnet++/Pointnet2_PyTorch/MANIFEST.in

pointnet++/Pointnet2_PyTorch/README.rst

pointnet++/Pointnet2_PyTorch/UNLICENSE

pointnet++/Pointnet2_PyTorch/pointnet2/__init__.py

pointnet++/Pointnet2_PyTorch/pointnet2/_version.py

pointnet++/Pointnet2_PyTorch/pointnet2/config/config.yaml

pointnet++/Pointnet2_PyTorch/pointnet2/config/model/msg.yaml

pointnet++/Pointnet2_PyTorch/pointnet2/config/model/ssg.yaml

pointnet++/Pointnet2_PyTorch/pointnet2/config/task/cls.yaml

pointnet++/Pointnet2_PyTorch/pointnet2/config/task/semseg.yaml

pointnet++/Pointnet2_PyTorch/pointnet2/config/task_model/cls-msg.yaml

pointnet++/Pointnet2_PyTorch/pointnet2/config/task_model/cls-ssg.yaml

pointnet++/Pointnet2_PyTorch/pointnet2/config/task_model/semseg-msg.yaml

pointnet++/Pointnet2_PyTorch/pointnet2/config/task_model/semseg-ssg.yaml

pointnet++/Pointnet2_PyTorch/pointnet2/data/.gitignore

pointnet++/Pointnet2_PyTorch/pointnet2/data/Indoor3DSemSegLoader.py

pointnet++/Pointnet2_PyTorch/pointnet2/data/ModelNet40Loader.py

pointnet++/Pointnet2_PyTorch/pointnet2/data/__init__.py

pointnet++/Pointnet2_PyTorch/pointnet2/data/data_utils.py

pointnet++/Pointnet2_PyTorch/pointnet2/models/__init__.py

pointnet++/Pointnet2_PyTorch/pointnet2/models/pointnet2_msg_cls.py

pointnet++/Pointnet2_PyTorch/pointnet2/models/pointnet2_msg_sem.py

pointnet++/Pointnet2_PyTorch/pointnet2/models/pointnet2_ssg_cls.py

pointnet++/Pointnet2_PyTorch/pointnet2/models/pointnet2_ssg_sem.py

pointnet++/Pointnet2_PyTorch/pointnet2/train.py

pointnet++/Pointnet2_PyTorch/pointnet2/utils/.gitignore

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/MANIFEST.in

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/build/lib.linux-x86_64-cpython-310/pointnet2_ops/__init__.py

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/build/lib.linux-x86_64-cpython-310/pointnet2_ops/_ext-src/include/ball_query.h

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/build/lib.linux-x86_64-cpython-310/pointnet2_ops/_ext-src/include/cuda_utils.h

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/build/lib.linux-x86_64-cpython-310/pointnet2_ops/_ext-src/include/group_points.h

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/build/lib.linux-x86_64-cpython-310/pointnet2_ops/_ext-src/include/interpolate.h

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/build/lib.linux-x86_64-cpython-310/pointnet2_ops/_ext-src/include/sampling.h

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/build/lib.linux-x86_64-cpython-310/pointnet2_ops/_ext-src/include/utils.h

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/build/lib.linux-x86_64-cpython-310/pointnet2_ops/_ext-src/src/ball_query.cpp

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/build/lib.linux-x86_64-cpython-310/pointnet2_ops/_ext-src/src/ball_query_gpu.cu

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/build/lib.linux-x86_64-cpython-310/pointnet2_ops/_ext-src/src/bindings.cpp

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/build/lib.linux-x86_64-cpython-310/pointnet2_ops/_ext-src/src/group_points.cpp

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/build/lib.linux-x86_64-cpython-310/pointnet2_ops/_ext-src/src/group_points_gpu.cu

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/build/lib.linux-x86_64-cpython-310/pointnet2_ops/_ext-src/src/interpolate.cpp

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/build/lib.linux-x86_64-cpython-310/pointnet2_ops/_ext-src/src/interpolate_gpu.cu

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/build/lib.linux-x86_64-cpython-310/pointnet2_ops/_ext-src/src/sampling.cpp

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/build/lib.linux-x86_64-cpython-310/pointnet2_ops/_ext-src/src/sampling_gpu.cu

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/build/lib.linux-x86_64-cpython-310/pointnet2_ops/_ext.cpython-310-x86_64-linux-gnu.so

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/build/lib.linux-x86_64-cpython-310/pointnet2_ops/_version.py

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/build/lib.linux-x86_64-cpython-310/pointnet2_ops/pointnet2_modules.py

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/build/lib.linux-x86_64-cpython-310/pointnet2_ops/pointnet2_utils.py

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/build/temp.linux-x86_64-cpython-310/.ninja_deps

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/build/temp.linux-x86_64-cpython-310/.ninja_log

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/build/temp.linux-x86_64-cpython-310/build.ninja

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/build/temp.linux-x86_64-cpython-310/pointnet2_ops/_ext-src/src/ball_query.o

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/build/temp.linux-x86_64-cpython-310/pointnet2_ops/_ext-src/src/ball_query_gpu.o

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/build/temp.linux-x86_64-cpython-310/pointnet2_ops/_ext-src/src/bindings.o

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/build/temp.linux-x86_64-cpython-310/pointnet2_ops/_ext-src/src/group_points.o

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/build/temp.linux-x86_64-cpython-310/pointnet2_ops/_ext-src/src/group_points_gpu.o

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/build/temp.linux-x86_64-cpython-310/pointnet2_ops/_ext-src/src/interpolate.o

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/build/temp.linux-x86_64-cpython-310/pointnet2_ops/_ext-src/src/interpolate_gpu.o

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/build/temp.linux-x86_64-cpython-310/pointnet2_ops/_ext-src/src/sampling.o

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/build/temp.linux-x86_64-cpython-310/pointnet2_ops/_ext-src/src/sampling_gpu.o

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/dist/pointnet2_ops-3.0.0-py3.10-linux-x86_64.egg

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/pointnet2_ops.egg-info/PKG-INFO

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/pointnet2_ops.egg-info/SOURCES.txt

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/pointnet2_ops.egg-info/dependency_links.txt

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/pointnet2_ops.egg-info/requires.txt

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/pointnet2_ops.egg-info/top_level.txt

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/pointnet2_ops/__init__.py

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/pointnet2_ops/_ext-src/include/ball_query.h

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/pointnet2_ops/_ext-src/include/cuda_utils.h

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/pointnet2_ops/_ext-src/include/group_points.h

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/pointnet2_ops/_ext-src/include/interpolate.h

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/pointnet2_ops/_ext-src/include/sampling.h

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/pointnet2_ops/_ext-src/include/utils.h

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/pointnet2_ops/_ext-src/src/ball_query.cpp

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/pointnet2_ops/_ext-src/src/ball_query_gpu.cu

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/pointnet2_ops/_ext-src/src/bindings.cpp

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/pointnet2_ops/_ext-src/src/group_points.cpp

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/pointnet2_ops/_ext-src/src/group_points_gpu.cu

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/pointnet2_ops/_ext-src/src/interpolate.cpp

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/pointnet2_ops/_ext-src/src/interpolate_gpu.cu

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/pointnet2_ops/_ext-src/src/sampling.cpp

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/pointnet2_ops/_ext-src/src/sampling_gpu.cu

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/pointnet2_ops/_version.py

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/pointnet2_ops/pointnet2_modules.py

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/pointnet2_ops/pointnet2_utils.py

pointnet++/Pointnet2_PyTorch/pointnet2_ops_lib/setup.py

pointnet++/Pointnet2_PyTorch/pyproject.toml

pointnet++/Pointnet2_PyTorch/requirements.txt

pointnet++/Pointnet2_PyTorch/setup.py

pointnet++/Pointnet2_PyTorch/tests/conftest.py

pointnet++/Pointnet2_PyTorch/tests/test_cls.py

pointnet++/Pointnet2_PyTorch/tests/test_semseg.py

pointnet++/Pointnet2_PyTorch/tox.ini

pretrained_weight/Uni3D_PC_encoder/.gitattributes

pretrained_weight/Uni3D_PC_encoder/modelzoo/uni3d-base/model.pt

pretrained_weight/Uni3D_PC_encoder/modelzoo/uni3d-giant/model.pt

pretrained_weight/Uni3D_PC_encoder/modelzoo/uni3d-large/model.pt

pretrained_weight/Uni3D_PC_encoder/modelzoo/uni3d-small/model.pt

pretrained_weight/Uni3D_PC_encoder/modelzoo/uni3d-tiny/model.pt

pretrained_weight/clip_used_in_Uni3D/.gitattributes

pretrained_weight/clip_used_in_Uni3D/README.md

pretrained_weight/clip_used_in_Uni3D/merges.txt

pretrained_weight/clip_used_in_Uni3D/open_clip_config.json

pretrained_weight/clip_used_in_Uni3D/open_clip_pytorch_model.bin

pretrained_weight/clip_used_in_Uni3D/special_tokens_map.json

pretrained_weight/clip_used_in_Uni3D/tokenizer.json

pretrained_weight/clip_used_in_Uni3D/tokenizer_config.json

pretrained_weight/clip_used_in_Uni3D/vocab.json

pretrained_weight/eval_model_weight/all-mpnet-base-v2/.gitattributes

pretrained_weight/eval_model_weight/all-mpnet-base-v2/1_Pooling/config.json

pretrained_weight/eval_model_weight/all-mpnet-base-v2/README.md

pretrained_weight/eval_model_weight/all-mpnet-base-v2/config.json

pretrained_weight/eval_model_weight/all-mpnet-base-v2/config_sentence_transformers.json

pretrained_weight/eval_model_weight/all-mpnet-base-v2/data_config.json

pretrained_weight/eval_model_weight/all-mpnet-base-v2/model.safetensors

pretrained_weight/eval_model_weight/all-mpnet-base-v2/modules.json

pretrained_weight/eval_model_weight/all-mpnet-base-v2/onnx/model.onnx ONNX

pretrained_weight/eval_model_weight/all-mpnet-base-v2/onnx/model_O1.onnx ONNX

pretrained_weight/eval_model_weight/all-mpnet-base-v2/onnx/model_O2.onnx ONNX

pretrained_weight/eval_model_weight/all-mpnet-base-v2/onnx/model_O3.onnx ONNX

pretrained_weight/eval_model_weight/all-mpnet-base-v2/onnx/model_O4.onnx ONNX

pretrained_weight/eval_model_weight/all-mpnet-base-v2/onnx/model_qint8_arm64.onnx ONNX

pretrained_weight/eval_model_weight/all-mpnet-base-v2/onnx/model_qint8_avx512.onnx ONNX

pretrained_weight/eval_model_weight/all-mpnet-base-v2/onnx/model_qint8_avx512_vnni.onnx ONNX

pretrained_weight/eval_model_weight/all-mpnet-base-v2/onnx/model_quint8_avx2.onnx ONNX

pretrained_weight/eval_model_weight/all-mpnet-base-v2/openvino/openvino_model.bin

pretrained_weight/eval_model_weight/all-mpnet-base-v2/openvino/openvino_model.xml

pretrained_weight/eval_model_weight/all-mpnet-base-v2/openvino/openvino_model_qint8_quantized.bin

pretrained_weight/eval_model_weight/all-mpnet-base-v2/openvino/openvino_model_qint8_quantized.xml

pretrained_weight/eval_model_weight/all-mpnet-base-v2/pytorch_model.bin

pretrained_weight/eval_model_weight/all-mpnet-base-v2/sentence_bert_config.json

pretrained_weight/eval_model_weight/all-mpnet-base-v2/special_tokens_map.json

pretrained_weight/eval_model_weight/all-mpnet-base-v2/tokenizer.json

pretrained_weight/eval_model_weight/all-mpnet-base-v2/tokenizer_config.json

pretrained_weight/eval_model_weight/all-mpnet-base-v2/train_script.py

pretrained_weight/eval_model_weight/all-mpnet-base-v2/vocab.txt

pretrained_weight/eval_model_weight/sup-simcse-roberta-large/.gitattributes

pretrained_weight/eval_model_weight/sup-simcse-roberta-large/README.md

pretrained_weight/eval_model_weight/sup-simcse-roberta-large/config.json

pretrained_weight/eval_model_weight/sup-simcse-roberta-large/flax_model.msgpack

pretrained_weight/eval_model_weight/sup-simcse-roberta-large/merges.txt

pretrained_weight/eval_model_weight/sup-simcse-roberta-large/pytorch_model.bin

pretrained_weight/eval_model_weight/sup-simcse-roberta-large/special_tokens_map.json

pretrained_weight/eval_model_weight/sup-simcse-roberta-large/tokenizer_config.json

pretrained_weight/eval_model_weight/sup-simcse-roberta-large/vocab.json

pyproject.toml

release/5M_data_seting/scripts/test/release_5M_stage_2.sh

release/5M_data_seting/scripts/test/release_5M_stage_3_lr_1e5.sh

release/5M_data_seting/scripts/train/2.sh

release/5M_data_seting/scripts/train/3.sh

release/5M_data_seting/weight/stage_2/5M_low_lr_1e5/README.md

release/5M_data_seting/weight/stage_2/5M_low_lr_1e5/adapter_config.json

release/5M_data_seting/weight/stage_2/5M_low_lr_1e5/adapter_model.safetensors

release/5M_data_seting/weight/stage_2/5M_low_lr_1e5/config.json

release/5M_data_seting/weight/stage_2/5M_low_lr_1e5/non_lora_trainables.bin

release/5M_data_seting/weight/stage_2/5M_low_lr_1e5/trainer_state.json

release/5M_data_seting/weight/stage_3/use_stage_5M_data_lr_1e5/README.md

release/5M_data_seting/weight/stage_3/use_stage_5M_data_lr_1e5/adapter_config.json

release/5M_data_seting/weight/stage_3/use_stage_5M_data_lr_1e5/adapter_model.safetensors

release/5M_data_seting/weight/stage_3/use_stage_5M_data_lr_1e5/config.json

release/5M_data_seting/weight/stage_3/use_stage_5M_data_lr_1e5/non_lora_trainables.bin

release/5M_data_seting/weight/stage_3/use_stage_5M_data_lr_1e5/trainer_state.json

release/paper/scripts/test/release_stage_2.sh

release/paper/scripts/test/release_stage_3.sh

release/paper/scripts/train/1.sh

release/paper/scripts/train/2.sh

release/paper/scripts/train/3.sh

release/paper/weight/stage_1/config.json

release/paper/weight/stage_1/mm_projector.bin

release/paper/weight/stage_1/trainer_state.json

release/paper/weight/stage_2/README.md

release/paper/weight/stage_2/adapter_config.json

release/paper/weight/stage_2/adapter_model.safetensors

release/paper/weight/stage_2/config.json

release/paper/weight/stage_2/non_lora_trainables.bin

release/paper/weight/stage_2/trainer_state.json

release/paper/weight/stage_3/README.md

release/paper/weight/stage_3/adapter_config.json

release/paper/weight/stage_3/adapter_model.safetensors

release/paper/weight/stage_3/config.json

release/paper/weight/stage_3/non_lora_trainables.bin

release/paper/weight/stage_3/trainer_state.json

scripts/convert_gqa_for_eval.py

scripts/convert_mmbench_for_submission.py

scripts/convert_mmvet_for_eval.py

scripts/convert_seed_for_submission.py

scripts/convert_sqa_to_llava.py

scripts/convert_sqa_to_llava_base_prompt.py

scripts/convert_vizwiz_for_submission.py

scripts/convert_vqav2_for_submission.py

scripts/extract_mm_projector.py

scripts/finetune.sh

scripts/finetune_full_schedule.sh

scripts/finetune_lora.sh

scripts/finetune_qlora.sh

scripts/finetune_sqa.sh

scripts/merge_lora_weights.py

scripts/pretrain.sh

scripts/pretrain_xformers.sh

scripts/sqa_eval_batch.sh

scripts/sqa_eval_gather.sh

scripts/upload_pypi.sh

scripts/v1_5/eval/gqa.sh

scripts/v1_5/eval/llavabench.sh

scripts/v1_5/eval/mmbench.sh

scripts/v1_5/eval/mmbench_cn.sh

scripts/v1_5/eval/mme.sh

scripts/v1_5/eval/mmvet.sh

scripts/v1_5/eval/pope.sh

scripts/v1_5/eval/qbench.sh

scripts/v1_5/eval/qbench_zh.sh

scripts/v1_5/eval/seed.sh

scripts/v1_5/eval/sqa.sh

scripts/v1_5/eval/textvqa.sh

scripts/v1_5/eval/vizwiz.sh

scripts/v1_5/eval/vqav2.sh

scripts/v1_5/finetune.sh

scripts/v1_5/finetune_lora.sh

scripts/v1_5/finetune_task.sh

scripts/v1_5/finetune_task_lora.sh

scripts/v1_5/pretrain.sh

scripts/zero2.json

scripts/zero3.json

scripts/zero3_offload.json

Related models

More models

No task type declared.

YuanTang96/GreenPLM

What's in this repo

ONNX files

How to use

README

More Text, Less Point: Towards 3D Data-Efficient Point-Language Understanding

📋 Contents

🔍 Overview

📦 Training-and-Evaluation

Download project

Install Environment

Project Directory Introduction

Dataset Preparation

Inference

Paper Weights

GreenPLM-0

GreenPLM

Weights Using All T3D Dataset

GreenPLM-0

GreenPLM

Evaluation

Using LLM

Traditional Metric Evaluation

Training

🔗 Citation

📄 License

📚 Related Work

👏 Acknowledgements

Model info

Files (372)

Related models

More from YuanTang96

More models

Popular models